TraceForage

TraceForge extracts insights from LLM traces to create fine-tuned models. It analyzes conversation patterns from Claude Code and Gemini CLI, generating custom models that incorporate your interaction data. - Captures OpenTelemetry traces via OTLP/HTTP and integrates with gemini cli and claude code - introspect and evaluate model interactions - Crafts system prompts incorporating conversation nuances, guiding models around core failure points identified in your traces - OpenAI-compatible endpoint for custom models on the spectrum of prompt to lora to full fine-tuning of models based on llm interaction metadata (traces, hard rules) - Browse and share quality traces, evaluating the quality of traces by utilizing llm-as-a-judge