Skip to Main Content

Carthij is an autonomous, multimodal funding discovery and browser-assisted application pre-fill platform powered by Gemini (google-genai SDK), Tavily Search & Extract, Playwright Chromium, FastAPI, Next.js 15 THE PROBLEM Startups and 501(c)(3) non-profits leave billions in non-dilutive state, federal, and foundation funding unclaimed every year. Navigating fragmented portals (NYSTAR, NYSERDA, NJEDA, CA Competes, EPA/NSF SBIR, Grants.gov) takes 40+ hours per grant—and generic chatbots hallucinate expired deadlines, fake URLs, and fabricated compliance IDs (EIN, SAM.gov UEI). HOW CARTHIJ WORKS 1. Native Multimodal PDF Ingestion: Users drop a startup pitch deck, 501(c)(3) overview, or 10-K PDF directly into the intake form. Raw PDF bytes are sent natively to Gemini to auto-populate the intake and extract verified applicant facts without brittle OCR scrapers. 2. Deterministic Backbone + 4 Parallel Adaptive Specialists: Instead of an unconstrained LLM hub-and-spoke loop, Carthij uses a fixed-DAG orchestration pipeline: - Stage 1 (Hybrid Retrieval): Gemini rewrites the intake into 3–5 scoped queries fired in parallel into Tavily /search + selective /extract on authoritative .gov portals, populating a concurrency-safe [SRC-N] RetrievedSourceRegistry. - Stage 2 (Opinionated Specialists): 4 specialists run in parallel (State/Local Programs, Federal & Foundation Grants, routed Capital Strategy for Startups or Philanthropic Strategy for Non-Profits, and Eligibility/Compliance) using two-phase tool-calling -> strict Pydantic JSON execution with hard code-enforced tool caps (<= 2 calls). - Stage 3 (Zero-Hallucination Citation Grounding): A programmatic URL verifier checks every candidate opportunity against RetrievedSourceRegistry, drops unverified citations (0 hallucinated URLs), prefers official .gov sources on dedup, and synthesizes a Readiness Score (0–100), readiness gaps, and a 7/30/90-day action plan. 3. Live Vision + DOM Playwright Browser-Use Agent: Clicking "Draft & Pre-Fill" launches Playwright Chromium to inspect the portal DOM alongside live JPEG viewport screenshots (multimodal Vision + DOM with Gemini 3.8 Flash). It fills grounded fields from ApplicantFactLedger, streams live JPEG frames over SSE, refuses to fabricate missing Federal EIN / SAM.gov UEI (flagging them for human-in-the-loop v2 revision), and hard-stops before Final Submit. SAFETY, EVALS & CLOUD READINESS Includes SSRF protection, login/CAPTCHA halt, Semaphore(2) browser concurrency, Cloud Firestore + locked-down firestore.rules, Cloud Run Dockerfile, Cloud Tasks dispatcher, Firebase App Hosting, and 27 passing tests including Track 1 (OOD discovery) and Track 2 (unseen portal browser drafter) evaluation benchmarks. GitHub: https://github.com/osujii191/carthij

Team

osujii191

More from Gemini 4 NYC Hackathon

We design an agentic system to automatically create + manage intelligent AI opponents/NPCs in video games. The suite of agents analyzes user gameplay…

Adaptive NPCs project preview

Manually routing PCBs is time-consuming and cost-inefficient. Current best algorithms (freerouting, PCBRouter) score very low on PCBWorld's hardest PCB…

routr project preview

Heliocam is a camera app where Gemini controls the camera. It watches what you're pointing at, sets the ISO, shutter, focus, white balance and zoom for you…

heliocam project preview

Repairs and assembly fail because manuals are lost, vague, missing, or nonexistent, so people break things or throw them out. KLIK turns a photo of any object…

Klik project preview

Iron Pulse turns your laptop into a 3D boxing ring. Fight an adaptive AI rival in real time using just your webcam. Throw real punches and lean to dodge…

Iron Pulse Arena project preview

Text your raw footage to an iMessage number and get a finished, trend-informed Reel back in the same thread.

Sticky project preview