# Advision

- **Event:** [Meta Global AI Developer Hackathon](https://cerebralvalley.ai/e/meta-ai-developer-hackathon)
- **When:** Oct 26, 12:00 PM – Nov 4, 9:00 PM (EST)
- **Where:** Online
- **Team:** [Nandan HS](https://cerebralvalley.ai/u/Nandan14)
- **GitHub:** https://github.com/Nandanhs006/AdVision
- **Demo video:** https://youtu.be/EcSCmaXasTM
- **Gallery:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/4291

##  Inspiration
Traditional digital advertising is broken. Viewers despise loud, unskippable commercial breaks that yank them out of emotional cinematic moments, causing ad-blocker adoption, audience churn, and subscription fatigue. Meanwhile, legacy product placement is static, expensive, and requires weeks of manual VFX rotoscoping—locking a single brand into footage forever regardless of who is watching.

We asked: **What if ads lived naturally inside the film’s universe, personalized in real-time for each viewer, with zero commercial interruptions?** That is **AdVision**.

---

## What It Does
AdVision transforms video streaming by dynamically embedding hyper-realistic, personalized brand campaigns directly onto in-scene architectural surfaces (billboards, LED screens, transit signage):

1. **Automated Spatial Surface Mapping**: Creators upload raw video footage. AdVision deploys Meta SAM 3.1 to scan frames, detecting planar surfaces with 99% certainty and computing sub-pixel 3D homography matrices in seconds.
2. **Meta AI Natural Language Intent Synthesizer**: Instead of privacy-invasive cookies, marketers input natural prompts (*"College students cramming for finals craving energy drinks"*). Meta Llama 3.3 deconstructs audience intent, scores in-scene receptivity (95%), and generates deployable Meta Audience Network Graph API v21 payloads.
3. **Generative Ad Studio**: Auto-synthesizes multi-aspect creatives (1:1, 4:5, 9:16) with Meta Muse models and localized copy across English, Japanese, Telugu, and French.
4. **Pause-to-Shop QR Checkout**: When viewers pause the movie, an interactive sponsor card surfaces with a scannable QR code and direct CTA ("Fuel Up")—converting visual attention into direct commerce without disrupting playback.
5. **Multi-Persona Synchronized Streaming**: Delivers unique, culture-tailored creatives to each viewer in frame-locked synchronization (e.g., Alex in the US sees RepBull Energy; Ren in Japan sees Sony Alpha Optics).
6. **Ad Scene Campaign Analytics**: Telemetry dashboard tracking viewability, 94% brand recall lift, zero audience churn, and CPM performance.

---

## How We Built It
- **Vision & Surface Tracking**: Meta SAM 3.1 computer vision pipeline for automated planar boundary segmentation, 4-corner perspective homography, and ambient luminance adaptation.
- **Audience & Intent Engine**: Meta Llama 3.3 70B via Fireworks AI orchestrating prompt synthesis and Meta Audience Network Graph API integration.
- **Frontend & Rendering**: Next.js 15, TypeScript, Tailwind CSS, and hardware-accelerated CSS `matrix3d` transforms delivering 60 FPS zero-latency client-side compositing.
- **Media Engine**: Playwright browser automation, Edge TTS Studio Neural Voiceover, and FFmpeg for broadcast-grade 1080p muxing.

---

## What’s Next for AdVision
Expanding into live sports broadcasting, dynamic extension to. more spatial objects , and spatial computing for Meta Quest 3.

## More from Meta Global AI Developer Hackathon

- [CarLens](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/4288)
- [The Chini Saga](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/4289)
- [nsambleTeam](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/4290)
- [Wildseek](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/4292)
- [KnowMe](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/4293)
- [LawnLens](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/4294)

---

Markdown version of https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/4291. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt