# MuseDeck

- **Event:** [Meta Global AI Developer Hackathon](https://cerebralvalley.ai/e/meta-ai-developer-hackathon)
- **When:** Oct 26, 12:00 PM – Nov 4, 9:00 PM (EST)
- **Where:** Online
- **Team:** [Mehmet Akif Acar](https://cerebralvalley.ai/u/Akifin)
- **GitHub:** https://github.com/memetcircus/musedeck
- **Demo video:** https://youtu.be/WUwthuxRRIQ?si=l_ZruJfWlcQRhKSg
- **Gallery:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/832

Autonomous coding agents like Meta's Muse Code CLI excel at end-to-end repository refactoring, test generation across parallel git worktrees, and terminal automation. However, developer trust and velocity break down in daily engineering workflows due to three major bottlenecks:
1. Context-Switching Friction: Constant alt-tabbing between code editors, multiple terminal tabs, browsers, and architecture documentation drains time and mental space.
2. Human-in-the-Loop (HITL) Review Anxiety: Autonomous agents applying complex multi-file diffs without an unambiguous, immediate human verification gate.
3. Multimodal Bottlenecks: Manually taking screenshots of UI designs or recording buggy animations, saving files, and typing long prompts into terminal windows.

WHAT MUSEDECK IS & HOW IT SOLVES THIS:
Built 100% from scratch during the Meta Global AI Developer Hackathon ("Build for Your World"), MuseDeck transforms the Elgato Stream Deck MK.2 into a dedicated, self-contained physical Mission Control Console bridging Meta Muse Code CLI, Meta SAM 3.1, Meta Muse Spark 1.3, and Muse Voice Transcribe across 15 dynamic LCD keys and 9 interactive hardware submenus:

- Physical Human-in-the-Loop (HITL) Review Gate & Quantum Beam Wave: When Muse Code is synthesizing code, a 5x3 Quantum Beam wave animates across the hardware deck. When Muse Code pauses for diff confirmation, the status key pulses with a calm 650ms breathing alert; tapping it focuses the active terminal and opens the Review Submenu (Approve Once, Always Allow, Reject/Deny, or Tell Why/Feedback). When idle, tapping New Session opens a native macOS folder picker to launch a fresh Muse Code session in any project workspace.
- Image-to-Code Submenu (Meta SAM 3.1 + Muse Spark 1.3): Interactive macOS region capture isolates foreground UI components and spatial bounding coordinates via Meta SAM 3.1 (via the Screenshot key or directly inside Image-to-Code) and synthesizes production-ready UI components via Muse Spark 1.3 across 8 targets: Auto-Detect, React + Tailwind, HTML + CSS, Vue 3 SFC, SwiftUI Native, Jetpack Compose, Flutter Dart, and Python UI. Once synthesized, dedicated Open Code and Live Preview keys open the source file in Xcode, Android Studio, or VS Code and launch an interactive live preview.
- Video-to-Code Submenu (Temporal Storyboard Engine + Live Preview): Captures 5-second interactive screen recordings (with release-triggered hardware countdown and an early Stop key), validates perceptual motion delta via Sharp to prevent wasted tokens on static screens, extracts 8 sequential keyframes via FFmpeg into a timecoded 4x2 contact sheet (flow_montage.png + flow_manifest.json), and uses Muse Spark 1.3 to synthesize animated components across 8 targets: Framer Motion, Tailwind Keyframes, SwiftUI Spring, Compose Animation, Flutter Animated, Vue Transition, GSAP Timeline, and Auto Smart Flow. Includes an automated Swiftc compiler pre-check and AI auto-repair loop before launching the native macOS preview app or browser sandbox.
- Voice Transcribe, Prompt Snippets, Struct Prompt & Video Bug Recorder: The Voice key triggers hardware Option+V microphone streaming directly into the active Muse CLI cursor. The Snippets submenu injects steering qualifiers (Be Honest, Don't Code, Show Options, Explain Why, Keep Short, No Tests, plus a Go! submit key). The Struct Prompt key reads raw draft text from the terminal line and rewrites it in-place into a structured English prompt via Muse Spark 1.3. The Video Record key captures reproducible desktop bug flows and attaches the video path directly to the terminal prompt.
- Sessions Switcher, Living Memory, Developer Ops, Git Cockpit, Telemetry HUD & HALT: The Sessions drawer switches between live terminal tabs and restores historical workspaces with date badges (TODAY, YESTRDY). The Muse Memory submenu syncs living architecture docs (MUSE RULES, SPEC.md, PLAN.md, TODO.md, ARCH.md, PROGRESS.md, README.md, DECISIONS.md, API.md, TESTING.md, Sync Context, Update Log). The Muse Ops submenu runs clipboard-aware workflows (Fix Error, Refactor Code, Optimize Perf, Explain Code, Find Symbol, Code Review, Run Tests, Run Build, Type Check). The Git Commands submenu provides 12 protected version control actions (Status, Commit with focus/clean-tree guards, Pull, Push, Diff, Stash Save/Pop, 2-tap guarded Discard, Main Branch, Create PR, Open Repo, Git Log). Muse Settings opens a local Web Mission Control dashboard with live API ping diagnostics and a virtual deck mirror, Credits HUD displays a 10-key live token/cache/latency dashboard, and the physical HALT switch immediately aborts runaway agent actions.

## More from Meta Global AI Developer Hackathon

- [Agent Foundry](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/829)
- [Doby's Universe](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/830)
- [ArthNiti](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/831)
- [Rangrez Labs](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/833)
- [LLM Hub](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/834)
- [Capybara](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/835)

---

Markdown version of https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/832. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt