Team Carthij
Gemini 4 NYC HackathonCarthij is an autonomous, multimodal funding discovery and browser-assisted application pre-fill platform powered by Gemini (google-genai SDK), Tavily Search & Extract, Playwright Chromium, FastAPI, Next.js 15 THE PROBLEM Startups and 501(c)(3) non-profits leave billions in non-dilutive state, federal, and foundation funding unclaimed every year. Navigating fragmented portals (NYSTAR, NYSERDA, NJEDA, CA Competes, EPA/NSF SBIR, Grants.gov) takes 40+ hours per grant—and generic chatbots hallucinate expired deadlines, fake URLs, and fabricated compliance IDs (EIN, SAM.gov UEI). HOW CARTHIJ WORKS 1. Native Multimodal PDF Ingestion: Users drop a startup pitch deck, 501(c)(3) overview, or 10-K PDF directly into the intake form. Raw PDF bytes are sent natively to Gemini to auto-populate the intake and extract verified applicant facts without brittle OCR scrapers. 2. Deterministic Backbone + 4 Parallel Adaptive Specialists: Instead of an unconstrained LLM hub-and-spoke loop, Carthij uses a fixed-DAG orchestration pipeline: - Stage 1 (Hybrid Retrieval): Gemini rewrites the intake into 3–5 scoped queries fired in parallel into Tavily /search + selective /extract on authoritative .gov portals, populating a concurrency-safe [SRC-N] RetrievedSourceRegistry. - Stage 2 (Opinionated Specialists): 4 specialists run in parallel (State/Local Programs, Federal & Foundation Grants, routed Capital Strategy for Startups or Philanthropic Strategy for Non-Profits, and Eligibility/Compliance) using two-phase tool-calling -> strict Pydantic JSON execution with hard code-enforced tool caps (<= 2 calls). - Stage 3 (Zero-Hallucination Citation Grounding): A programmatic URL verifier checks every candidate opportunity against RetrievedSourceRegistry, drops unverified citations (0 hallucinated URLs), prefers official .gov sources on dedup, and synthesizes a Readiness Score (0–100), readiness gaps, and a 7/30/90-day action plan. 3. Live Vision + DOM Playwright Browser-Use Agent: Clicking "Draft & Pre-Fill" launches Playwright Chromium to inspect the portal DOM alongside live JPEG viewport screenshots (multimodal Vision + DOM with Gemini 3.8 Flash). It fills grounded fields from ApplicantFactLedger, streams live JPEG frames over SSE, refuses to fabricate missing Federal EIN / SAM.gov UEI (flagging them for human-in-the-loop v2 revision), and hard-stops before Final Submit. SAFETY, EVALS & CLOUD READINESS Includes SSRF protection, login/CAPTCHA halt, Semaphore(2) browser concurrency, Cloud Firestore + locked-down firestore.rules, Cloud Run Dockerfile, Cloud Tasks dispatcher, Firebase App Hosting, and 27 passing tests including Track 1 (OOD discovery) and Track 2 (unseen portal browser drafter) evaluation benchmarks. GitHub: https://github.com/osujii191/carthij





