Skip to Main Content

Director's Chair

Built at Meta Global AI Developer Hackathon · Oct 26, 2026 · Remote

Director's Chair — Demo video

Director's Chair is a live AI film director. You type one sentence, and your webcam becomes the film crew. Muse Spark writes a four-shot script. Muse Image paints the sets and a title card. Then Muse Spark directs you shot by shot from your webcam frame, watches every take with audio, and calls "again" or "moving on". SAM 3.1 cuts you out of your room, and ffmpeg lays you into the generated set and cuts a 30-second trailer with subtitles and a score. It runs in a browser with a FastAPI backend. The whole premise-to-MP4 loop is real: in the live run, the script took about 6 s, all five images about 15 s in parallel, each review about 5–8 s, and the final cut about 5 s. Making even a 30-second trailer takes a writer, a production designer, a director, a VFX artist and an editor. Director's Chair compresses that crew into one browser tab: 1. Write. Muse Spark 1.3 turns a one-line premise into a four-shot script as strict JSON. Each shot has a slug, an action, a camera note, a set prompt, and one line of dialogue. 2. Design. Muse Image 1.0 generates four empty 16:9 sets and a title-card plate, all five in parallel. 3. Direct. On the floor, the app grabs a webcam frame. Muse Spark looks at it and gives a spoken note: action, eyeline, energy. The browser's speechSynthesis reads it out. 4. Shoot. 3-2-1, then a 4.5 s take is recorded in the browser and converted to H.264 MP4 by ffmpeg. 5. Review. Muse Spark watches the MP4, audio included, and returns a score and "again" or "moving on" with a one-sentence director's note. You get up to three takes, and the third one prints. 6. Composite. SAM 3.1 segments the person. It starts while the review is still running, so printing feels instant. ffmpeg mattes you into the Muse Image set. 7. Cut. ffmpeg assembles the title card, four shots with burned-in subtitles, a generated score and an end card into a 30-second MP4. The app also has a rehearsal mode that runs fully offline with no API key, so anyone can try the flow.

Team