guidesMay 9, 2026· 4m
Cache LangGraph in your research assistant with Crowkis
Building research assistants on LangGraph? Add a semantic cache so overlapping literature and summary questions stop costing full price.
Notes from the nest · 980 posts
The Roost
Engineering notes written by the people building Crowkis. Comparisons, use cases, economics, internals, security, operations, and nothing written just to rank.
guidesMay 9, 2026· 5m
How to cache LiteLLM LLM calls with Crowkis
Add a semantic cache to LiteLLM so repeated and reworded questions are served for free, no rewrite, self-hosted.
engineeringMay 9, 2026· 3m
Why we kept the Redis protocol instead of inventing an API
Every new API is a tax on adoption: clients, docs, muscle memory, tooling. RESP3 meant inheriting twenty years of all four on day one.
use casesMay 9, 2026· 3m
Multi-tenant SaaS: one cache, many customers, zero leaks
Caching across customers multiplies savings and multiplies risk. Tenant isolation has to be architecture, not a WHERE clause.
guidesMay 8, 2026· 4m
Cache Spring AI in your RAG document search with Crowkis
Building RAG document search on Spring AI? Add a semantic cache so the same questions re-running retrieval over the same corpus stop costing full price.
guidesMay 8, 2026· 4m
Cache the OpenAI Python SDK in your legal document assistant with Crowkis
Building legal document assistants on the OpenAI Python SDK? Add a semantic cache so the same clauses and questions across matters stop costing full price.
guidesMay 8, 2026· 4m
Cache DSPy in your data analysis agent with Crowkis
Building data analysis agents on DSPy? Add a semantic cache so repeated tool calls and the same analytical questions stop costing full price.
guidesMay 8, 2026· 4m
Cache LangGraph in your contract analysis tool with Crowkis
Building contract analysis tools on LangGraph? Add a semantic cache so the same clause questions across documents stop costing full price.
guidesMay 8, 2026· 5m
Give LiteLLM agents long-term memory with Crowkis
Durable, per-user memory for LiteLLM agents that survives restarts and consolidates contradictions, self-hosted, zero egress.
featuresMay 8, 2026· 3m
CPII: scrubbing personal data and honouring the right to be forgotten
A cache of LLM traffic is a cache of whatever users typed, including PII. CPII reports what personal data is present and executes right-to-erasure, so compliance is a command, not a project.
economicsMay 8, 2026· 3m
Provider arbitrage: paying frontier prices only for frontier questions
Model prices vary 50x for overlapping quality on easy queries. The arbitrage router exploits the spread automatically, with a quality bar you set per intent.
guidesMay 7, 2026· 4m
Cache Spring AI in your internal copilot with Crowkis
Building internal copilots on Spring AI? Add a semantic cache so employees asking overlapping questions of the same knowledge base stop costing full price.
guidesMay 7, 2026· 4m
Cache the OpenAI Python SDK in your education tutor with Crowkis
Building education tutors on the OpenAI Python SDK? Add a semantic cache so students asking the same concepts thousands of times stop costing full price.
guidesMay 7, 2026· 4m
Cache DSPy in your HR assistant with Crowkis
Building HR assistants on DSPy? Add a semantic cache so the same policy questions from every employee stop costing full price.
guidesMay 7, 2026· 4m
Cache LangGraph in your onboarding assistant with Crowkis
Building onboarding assistants on LangGraph? Add a semantic cache so every new hire asking the same first questions stop costing full price.
guidesMay 7, 2026· 5m
How to cache Ollama LLM calls with Crowkis
Add a semantic cache to Ollama so repeated and reworded questions are served for free, no rewrite, self-hosted.
vs the fieldMay 7, 2026· 3m
Crowkis vs Memcached: a beautiful fossil meets a new workload
Memcached is the purest cache ever written, and purity is exactly the problem when your keys are sentences.
guidesMay 6, 2026· 4m
Cache Spring AI in your chatbot with Crowkis
Building chatbots on Spring AI? Add a semantic cache so high-volume conversational traffic that repeats constantly stop costing full price.
guidesMay 6, 2026· 4m
Cache the OpenAI Python SDK in your multi-agent system with Crowkis
Building multi-agent systems on the OpenAI Python SDK? Add a semantic cache so a swarm of agents asking overlapping questions stop costing full price.
guidesMay 6, 2026· 4m
Cache DSPy in your IT helpdesk bot with Crowkis
Building IT helpdesk bots on DSPy? Add a semantic cache so the same tickets and fixes, endlessly stop costing full price.