ArkAI

ArkAI: Smart Multimodal Family Finance Assistant Powered by Meta AI Overview ArkAI transforms personal and family financial management by eliminating manual tracking friction. Built as a cross-platform solution (iOS, Android, Web SPA via Expo/Cloudflare Pages) with zero-friction messaging integration (WhatsApp & Telegram), ArkAI empowers families to track expenses, manage budgets according to a proportional Financial Pyramid, monitor investment assets in real-time, and coordinate household wellbeing—all through spontaneous natural language, voice notes, and receipt photos. Core Role of Meta AI Models ArkAI's conversational intelligence is driven entirely by Meta’s advanced AI ecosystem, operating across two complementary pipelines: autonomous n8n AI agent workflows and serverless Supabase Edge Functions. Audio Transcription with Meta Muse ASR (muse-voice-transcribe-1.0): • Use Case: Ingests informal audio messages sent via WhatsApp and voice recordings from the in-app Journal. • Why It Matters: Native audio is resampled to 16kHz mono, enabling Muse ASR to transcribe colloquial accents, mixed numbers, and regional currency slang with high precision, converting casual voice notes into clean text in seconds. Multimodal Reasoning & OCR with Meta Muse Spark (muse-spark-1.3): • Receipt & Invoice Vision OCR: Users photograph tickets or bills. Muse Spark analyzes the image layout, recognizes merchants, dates, itemized costs, and totals even on wrinkled receipts. • Zero-Shot Structured Entity Extraction: Converts natural language into strict JSON schemas (amount, currency, category, date). Crucially, the LLM never generates raw SQL; its schema is strictly committed via PostgreSQL stored procedures protected by Row-Level Security (RLS). • Intelligent Household Planning: Synthesizes family dietary profiles and weekly meal plans with budget constraints. High-Throughput Reasoning with Meta Llama (Llama 3.3 70B): • Powers deep financial reasoning, over-budget alerts, and serves as an ultra-low latency fallback to guarantee uninterrupted availability. Meta WhatsApp Cloud API: • Serves as the primary zero-barrier gateway, enabling any family member to record expenses in seconds without ever having to navigate a complicated accounting dashboard. Architecture & Trust By bridging Meta’s multimodal models with Model Context Protocol (MCP) servers for real-time asset quotes and transactional PostgreSQL boundaries, ArkAI pairs the intuitive ease of conversational AI with mathematically strict financial integrity.