# dvsh

- **Event:** [Meta Global AI Developer Hackathon](https://cerebralvalley.ai/e/meta-ai-developer-hackathon)
- **When:** Oct 26, 12:00 PM – Nov 4, 9:00 PM (EST)
- **Where:** Online
- **Team:** [Devansh Dubey](https://cerebralvalley.ai/u/dvsh)
- **GitHub:** https://github.com/0dvsh0/morpho-kernel
- **Demo video:** https://youtu.be/LBumcQyIfCo
- **Gallery:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery
- **Page:** https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2045

MorphoKernel integrates Meta's developer models via the Meta Model API to power "Cortex" the asynchronous semantic and perceptual reasoning subsystem that supervises the camera-rate local reflex:

1. Segment Anything Model 3.1 (SAM 3.1 / sam-3.1):
   - Zero-Shot Perceptual Grounding: SAM 3.1 provides asynchronous visual grounding for the robot's initial reference frame and dynamic obstacle detection (e.g., repulsive obstacles/landing rings in the workspace).
   - Dual-Lane Vision Pipeline: In "Gate 0" benchmarking, we proved hosted segmentation latency (2.5–3.2s) cannot track at 30 Hz. MorphoKernel uses SAM 3.1 to ground the object bounding box once, handing coordinates to a local high-rate optical flow tracker, achieving the reliability of Meta vision models alongside real-time reflex speed.

2. Muse Spark (muse-spark-1.3):
   - Natural Language Intent Compilation: Translates high-level mission goals (e.g., "Orbit the target and maintain 2 puck-widths clearance from obstacles") into validated, executable controller parameters (ControllerConfig JSON).
   - Rehearsal & Explainability: When an actuator failure occurs and the local reflex heals the body matrix, Muse Spark analyzes telemetry logs to generate plain-language diagnostic explanations of what changed and how control authority was redistributed.

3. Muse Voice Transcribe (muse-voice-transcribe-1.0):
   - Push-to-Talk Speech Interface: Provides hands-free operator interaction, streaming audio clips to Muse Voice Transcribe to dynamically re-task the autonomous drone in mid-flight.

By isolating Meta models on a dedicated Cortex worker thread, MorphoKernel leverages Meta's frontier multimodal intelligence for high-level decision-making while ensuring physical safety and reflex control remain guaranteed at 30 Hz.

## More from Meta Global AI Developer Hackathon

- [MIRAIWERK-AI](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2042)
- [akshay](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2043)
- [NightShift](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2044)
- [nyoriworks](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2046)
- [Dakota088](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2047)
- [SmallCrew](https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2048)

---

Markdown version of https://cerebralvalley.ai/e/meta-ai-developer-hackathon/hackathon/gallery/2045. Site index for agents: https://cerebralvalley.ai/llms.txt · full text: https://cerebralvalley.ai/llms-full.txt