otelite - local OTLP receiver for LLM dev
Single-binary Rust OpenTelemetry receiver and dashboard for local LLM development. Captures spans from agent runs without spinning up Jaeger or a vendor backend.
This entry doesn't have a long-form writeup yet. Follow the source link above for the full context.
Related entries
llm-ls - LSP server for LLM code completion
Hugging Face's language server that brings LLM-powered completion to any IDE that speaks LSP. Backends include llama.cpp, OpenAI-compatible APIs, and HF inference.
macmon - real-time system monitor for Apple Silicon
Rust TUI plus JSON/Prometheus metrics server for M1-M5 Macs. No sudo required, exposes CPU/GPU/power metrics for Grafana and ad-hoc inspection.
vllora - debug AI agents across providers
Rust gateway and debugger for AI agent traffic across Anthropic, OpenAI, Azure, Gemini, DeepSeek, and others. Trace and inspect tool calls in flight.
ThinkWatch - enterprise AI and MCP bastion host
Rust gateway in front of OpenAI, Anthropic, Gemini, and self-hosted LLMs (plus MCP servers) with RBAC, audit logs, rate limits, and cost tracking. The boring layer enterprises actually need.