# Quinn Avila

- **Event:** [Meta Global AI Developer Hackathon](https://cerebralvalley.ai/e/meta-ai-developer-hackathon)
- **When:** Oct 26, 12:00 PM – Nov 4, 9:00 PM (EST)
- **Where:** Online
- **Team:** [Quinn Avila](https://cerebralvalley.ai/u/rblo)
- **GitHub:** https://github.com/quinnavila/tokmachine
- **Demo video:** https://drive.google.com/file/d/1eKewySnbZYUiWwOZPecSEtOqHPVzcexW/view?usp=sharing
- **Gallery:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3716

Tokenization engine for agentic sessions. 
https://quinnavila.github.io/tokmachine/

Agentic sessions are growing in context size with millions of tokens repeatedly sent and resent for re-tokenization. If we only re-encode new text plus a short tail and stitch the results. We can achieve more efficient tokenization. CPU Serial, parallel, GPU

https://docs.google.com/presentation/d/1189cka65F5juo5I8xDHVbr-deTwK2dk0mCqGuALxfcA/edit?usp=sharing

## More from Meta Global AI Developer Hackathon

- [Vantiq Studio](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3713)
- [WorkLens](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3714)
- [Machine Vision Radar](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3715)
- [TeamTalk](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3717)
- [Nerdpace](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3718)
- [Navi](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3719)

---

Markdown version of https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3716. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt