Discovery
All entries

Collection ยท 58 entries

Self-hosted developer tools and PaaS

Open-source, self-hosted alternatives to Heroku, Render, GitHub Actions, and the rest of the SaaS dev stack.

Self-hosting used to mean accepting a worse UX for control. The tools here close the gap: Nixopus and Zane Ops are Heroku-class deploy UX on your own VPS; runs-on gives you self-hosted GitHub Actions runners with real cost savings; HolyClaude and ExpenseOwl are container-first single-purpose apps. The bar for 'is the polish there yet' has moved a lot.

GitHubToolFeatured

Rapid-MLX - 2-4x faster local LLM inference on Apple Silicon

MLX-native inference engine with OpenAI-compatible API. The novel piece: DeltaNet state snapshots bring prompt caching to non-trimmable architectures (Qwen3.5 hybrids), restoring RNN state in ~0.1ms. 2-5x faster TTFT, native Metal kernels, continuous batching.

Why I saved this - DeltaNet state snapshots are described as the first prompt-cache technique for non-trimmable MLX architectures - Ollama and llama.cpp can't match this on hybrid RNN-attention models today.

Related collections