Callout by Ozni AI
National Security Hackathon (by Army xTech)Callout is a dialogue-based command and control (C2) protocol that enables Machine-to-Machine-to-Operator collaboration with voice as the substrate. When dismounted and expeditionary tactical units are collaborating with autonomous warfighting systems the common operating picture (COP) gets left behind, Callout ensures that team commanders, team members, UxS, and sensors alike can all participate in the kill-chain even in disconnected and denied environments. Our demonstration illustrates the use of Callout when an operator needs to coordinate a ground sensor collection, a UAS flight plan, query previous data stored in the Palantir Foundry AIP, and issue commands by speaking into their radio. Each autonomous system enabled by Callout: 1. Receives the RF transmission and Demodulates the signal 2. Transcribes the voice message with OpenAI's Whisper 3. Performs intent-based reasoning using a locally deployed LLM 4. Executes commands or fulfills data requests internally 5. Responds with acknowledgements and asks for clarification if needed 6. Coordinates with other UxS assets to achieve stated objectives To build Callout, hardware we used includes an NVIDIA Orin AGX, two HackRF One Software defined radios, and a RemoteID transmitter. Software products included OpenAI's Whisper model, Palantir's Foundry AIP, Paige Text-To-Speech for on-device voice generation, and locally hosted LLM models for voice and text inference. The Callout protocol will fundamentally shift the way tactical operators think about collaborating with autonomous warfighting systems. By giving sensors and UxS a voice, they can participate, collaborate, and protect warfighters at the tactical edge. Whether for force protection or force multiplication, the Callout protocol will be the catalyst for widespread adoption of autonomous intelligent systems at the tactical edge.
