Advision

## Inspiration Traditional digital advertising is broken. Viewers despise loud, unskippable commercial breaks that yank them out of emotional cinematic moments, causing ad-blocker adoption, audience churn, and subscription fatigue. Meanwhile, legacy product placement is static, expensive, and requires weeks of manual VFX rotoscoping—locking a single brand into footage forever regardless of who is watching. We asked: **What if ads lived naturally inside the film’s universe, personalized in real-time for each viewer, with zero commercial interruptions?** That is **AdVision**. --- ## What It Does AdVision transforms video streaming by dynamically embedding hyper-realistic, personalized brand campaigns directly onto in-scene architectural surfaces (billboards, LED screens, transit signage): 1. **Automated Spatial Surface Mapping**: Creators upload raw video footage. AdVision deploys Meta SAM 3.1 to scan frames, detecting planar surfaces with 99% certainty and computing sub-pixel 3D homography matrices in seconds. 2. **Meta AI Natural Language Intent Synthesizer**: Instead of privacy-invasive cookies, marketers input natural prompts (*"College students cramming for finals craving energy drinks"*). Meta Llama 3.3 deconstructs audience intent, scores in-scene receptivity (95%), and generates deployable Meta Audience Network Graph API v21 payloads. 3. **Generative Ad Studio**: Auto-synthesizes multi-aspect creatives (1:1, 4:5, 9:16) with Meta Muse models and localized copy across English, Japanese, Telugu, and French. 4. **Pause-to-Shop QR Checkout**: When viewers pause the movie, an interactive sponsor card surfaces with a scannable QR code and direct CTA ("Fuel Up")—converting visual attention into direct commerce without disrupting playback. 5. **Multi-Persona Synchronized Streaming**: Delivers unique, culture-tailored creatives to each viewer in frame-locked synchronization (e.g., Alex in the US sees RepBull Energy; Ren in Japan sees Sony Alpha Optics). 6. **Ad Scene Campaign Analytics**: Telemetry dashboard tracking viewability, 94% brand recall lift, zero audience churn, and CPM performance. --- ## How We Built It - **Vision & Surface Tracking**: Meta SAM 3.1 computer vision pipeline for automated planar boundary segmentation, 4-corner perspective homography, and ambient luminance adaptation. - **Audience & Intent Engine**: Meta Llama 3.3 70B via Fireworks AI orchestrating prompt synthesis and Meta Audience Network Graph API integration. - **Frontend & Rendering**: Next.js 15, TypeScript, Tailwind CSS, and hardware-accelerated CSS `matrix3d` transforms delivering 60 FPS zero-latency client-side compositing. - **Media Engine**: Playwright browser automation, Edge TTS Studio Neural Voiceover, and FFmpeg for broadcast-grade 1080p muxing. --- ## What’s Next for AdVision Expanding into live sports broadcasting, dynamic extension to. more spatial objects , and spatial computing for Meta Quest 3.