# CacheLens

- **Event:** [Meta Global AI Developer Hackathon](https://cerebralvalley.ai/e/meta-ai-developer-hackathon)
- **When:** Oct 26, 12:00 PM – Nov 4, 9:00 PM (EST)
- **Where:** Online
- **Team:** [Praneeth Reddy Arikatla](https://cerebralvalley.ai/u/0xViking)
- **GitHub:** https://github.com/0xViking/cachelens
- **Demo video:** https://github.com/user-attachments/assets/0dcbe18c-d60c-48a7-8045-f5085820f847
- **Gallery:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2284

CacheLens finds where a prompt layout breaks prefix caching on a self-hosted vLLM server. On Meta Muse Glimmer 30B (official muse-glimmer vLLM image, one Modal A100-80GB) a synthetic 18-request workload with a per-request timestamp placed before a ~5.8k-token shared prompt got a 1.0% engine prefix-cache hit rate. CacheLens' analyzer located the first divergence at character 28 from the captured prompts. Moving the timestamp after the shared prefix raised the hit rate to 93.6% (engine counters, single run) and reduced median completion wall time from 3.69s to 2.42s. Limits: one synthetic serial run, no cache reset between variants, no TTFT/cost/answer-equivalence claims. The pre-event Oct 26 SmolLM2 prototype is disclosed in the README; the repo code and evidence were created Nov 3.

## More from Meta Global AI Developer Hackathon

- [Tribe](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2281)
- [Sovra](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2282)
- [Team Annihilus](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2283)
- [Haul Desk](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2285)
- [PruvChat](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2286)
- [Kiro](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2287)

---

Markdown version of https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2284. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt