BeforeTheTape
Built at Meta Global AI Developer Hackathon · Oct 26, 2026 · Remote

A barcode scan proves an item was scanned, not that it went into the box. The mistake that actually happens at our packing bench is the right product in the wrong colour. Many of our orders are cash on delivery, so a wrong item is refused at the door and we pay the courier both ways. BeforeTheTape checks the packing video from one iPhone over the bench against the scan. SAM 3.1 segments and tracks the parcel and every scanned item. Muse Spark 1.3 follows the nested packing (wallet into pouch, pouch into box, care card, lid, mailer) and cites a frame for each step. The model reports; our code decides: consistent, mismatch or uncertain, never a pass on missing evidence. Live pause: the scan triggers a fast check while the packer is still working. On real-time replays of our bench clips it was 4 of 4 right, 7 to 9 s after the scan, so the bench says PAUSE before the seal. Agent loop: when Muse Spark cannot see a step in the frames it has, it asks for the evidence it needs (a frame range, a full-resolution close-up, or SAM re-tracking one named object) and checks again, up to 3 rounds. On one clip it asked for frames 46 to 60 and found the wallet going in at frame 53; the check passed only after that. Right variant: Muse Spark compares close-ups of the wallet in hand with shuffled, unlabelled catalogue photos of the scanned colour and its look-alikes, and must pick one or say it cannot tell. No training per product: the catalogue photo is the reference. Custody receipt: claims in India are often rejected on procedure. Each pack gets one proof image: an unbroken take (0 cuts), SAM following the exact wallet into the pouch and the pouch into the box, key frames, and the clip's SHA-256. Forgery check: we forged our own evidence. A re-encoded copy, a 2-second cut and a splice from another pack were all caught (hash mismatch, frame jumps), and Muse Spark says what changed. Claims desk: a claim like "only the empty pouch arrived, card missing" is answered point by point from the receipt, with the frames that show it. What happened in transit is marked unresolved. Returns bench: a returned wallet is compared with the close-ups from its own packing video. In a controlled test, a burgundy wallet returned on a brown order gave HOLD REFUND. Voice scan: a packer without a barcode scanner says the order in Hinglish, and Muse Voice Transcribe and Muse Spark turn it into the scan list. Packed for you: before a cash-on-delivery parcel arrives, the customer can watch their own wallet being packed. Early results on a few packs, not an accuracy rate yet: packing check 4 of 4 with SAM and Muse Spark, 2 of 4 with SAM tracks alone; variant check 5 right, 1 uncertain, 0 wrong in 6 runs. Under $0.20 (about Rs 17) a check at list prices.