Storieta

Storieta (storieta.com) is an existing reader for fiction that turns classic novels into illustrated books and comics. During the hackathon I used Meta's models to make those pictures come alive, and built two things on top of it. The problem: a book's illustrations sit flat on the page, and a full comic page is too small to read on a phone. 1. Layered book scenes. Muse Wonder reads a passage and picks the sentence to paint and the characters in it. Muse Image paints the scene. SAM 3.1 outlines every figure, Muse Wonder casts them from the numbered outlines, so the characters can lift off the page. 2. Comic reels: a comic page read one panel per swipe, with the characters lifted off the background. SAM 3.1 outlines every figure with one plain prompt such as "person". Muse Wonder sees the page with the outlines numbered and decides who is a story character, who leads, which figures stay painted in, and each panel's beat, hold time and camera. Muse Wonder cast and directed pages 1-5 of Romeo and Juliet and of Sherlock Holmes. Live now: storieta.com/discover/reels has reels for 8 catalog comics, the first 15 pages of each (120 pages, 576 panels), and the comic reader has a new Reel mode. Reels play from layers stored in R2, so no model runs when someone reads. The whole run cost under $10. What existed before the event: the Storieta reader with its illustrated editions and comics. The code is Apache-2.0; Storieta's art is excluded.