# LinguaCheck

- **Event:** [Meta Global AI Developer Hackathon](https://cerebralvalley.ai/e/meta-ai-developer-hackathon)
- **When:** Oct 26, 12:00 PM – Nov 4, 9:00 PM (EST)
- **Where:** Online
- **Team:** [Maria Myers](https://cerebralvalley.ai/u/LadyLock)
- **GitHub:** https://github.com/Mariavmyers/linguacheck
- **Demo video:** https://drive.google.com/file/d/1JDe7ah_NMMV5kPeV_h3fer_Uvzlhyp1t/view?usp=sharing
- **Gallery:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3425

Does the AI say the same thing in every language? LinguaCheck asks Meta's Muse Spark Open (open weights, via Baseten) the same medical, legal or financial question in English and Brazilian Portuguese. Code compares numbers, units and dates exactly, and a Muse judge guided by an interpreter trap file quotes the exact evidence for each meaningful difference. A professional medical and legal interpreter then confirms or rejects each flag. Muse's original answers are never edited. It is built for developers testing multilingual AI and for people who rely on AI in a language other than English.

Results: on 75 deliberately difficult, fictional questions, the judge raised 143 flags. I reviewed 50 (all 45 high-severity) and confirmed 47 (94% of reviewed flags) in 28 of the 75 questions; 43 of the 47 were in the Portuguese answer. I also found 3 errors the judge missed, and one case where the judge blamed the wrong language. Small, challenging test set, not a general error rate; recall not measured.

Live app: https://huggingface.co/spaces/hugmarie/linguacheck
Built Oct 26 – Nov 4 by Maria Myers, interpreter (EN/PT-BR/ES, ~20 years). Code written with an AI coding assistant; test design, traps and expert review by me. Uses only Meta's Muse Spark Open inside the app (eligible for Best Build on Meta Open Weight Models).

## More from Meta Global AI Developer Hackathon

- [OVARA Arena](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3422)
- [Aeglos](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3423)
- [LosCommosHermanos](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3424)
- [Kleos9](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3426)
- [Minh Trinh](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3427)
- [OwlOwlOwl](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3428)

---

Markdown version of https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/3425. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt