guidesApr 30, 2026· 4m
Cache LlamaIndex in your RAG document search with Crowkis
Building RAG document search on LlamaIndex? Add a semantic cache so the same questions re-running retrieval over the same corpus stop costing full price.
Notes from the nest · 980 posts
The Roost
Engineering notes written by the people building Crowkis. Comparisons, use cases, economics, internals, security, operations, and nothing written just to rank.
guidesApr 30, 2026· 5m
Give the Anthropic SDK agents long-term memory with Crowkis
Durable, per-user memory for the Anthropic SDK agents that survives restarts and consolidates contradictions, self-hosted, zero egress.
engineeringApr 30, 2026· 3m
Three levels, one strategy: compaction without the tuning PhD
LSM compaction is where storage engines breed complexity. Crowkis ships exactly one strategy across three levels, chosen for cache workloads, closed for configuration.
use casesApr 30, 2026· 3m
Consumer chat at scale: when every millisecond and every token multiply
At consumer scale, traffic converges on shared intents while costs and latency multiply by millions. The cache becomes load-bearing infrastructure.
securityApr 30, 2026· 9m
Cache poisoning is the whole problem
Semantic caching has an obvious failure mode nobody likes to talk about: one bad write, served forever to everyone nearby. This is how Crowkis decides what to trust.
guidesApr 29, 2026· 4m
Cache Spring AI in your voice assistant with Crowkis
Building voice assistants on Spring AI? Add a semantic cache so latency-sensitive, repetitive spoken queries stop costing full price.
guidesApr 29, 2026· 4m
Cache the OpenAI Python SDK in your sales enablement tool with Crowkis
Building sales enablement tools on the OpenAI Python SDK? Add a semantic cache so reps asking the same product questions stop costing full price.
guidesApr 29, 2026· 4m
Cache DSPy in your SQL generation tool with Crowkis
Building SQL generation tools on DSPy? Add a semantic cache so the same schema questions and query shapes stop costing full price.
guidesApr 29, 2026· 4m
Cache LlamaIndex in your internal copilot with Crowkis
Building internal copilots on LlamaIndex? Add a semantic cache so employees asking overlapping questions of the same knowledge base stop costing full price.
guidesApr 29, 2026· 5m
How to cache the Gemini SDK LLM calls with Crowkis
Add a semantic cache to the Gemini SDK so repeated and reworded questions are served for free, no rewrite, self-hosted.
featuresApr 29, 2026· 3m
CTHINK and CREUSE: banking a chain of thought and replaying it
The reasoning is the expensive part of a hard answer. CTHINK stores a chain-of-thought trace as a reusable step graph; CREUSE fetches the matching plan for a new query at a fraction of the original token cost.
guidesApr 28, 2026· 4m
Cache Spring AI in your email drafting tool with Crowkis
Building email drafting tools on Spring AI? Add a semantic cache so similar drafts requested over and over stop costing full price.
guidesApr 28, 2026· 4m
Cache the OpenAI Python SDK in your knowledge base assistant with Crowkis
Building knowledge base assistants on the OpenAI Python SDK? Add a semantic cache so the same lookups across a team all day stop costing full price.
guidesApr 28, 2026· 4m
Cache DSPy in your devops copilot with Crowkis
Building devops copilots on DSPy? Add a semantic cache so the same runbook and incident questions stop costing full price.
guidesApr 28, 2026· 4m
Cache LlamaIndex in your chatbot with Crowkis
Building chatbots on LlamaIndex? Add a semantic cache so high-volume conversational traffic that repeats constantly stop costing full price.
guidesApr 28, 2026· 5m
Give the Gemini SDK agents long-term memory with Crowkis
Durable, per-user memory for the Gemini SDK agents that survives restarts and consolidates contradictions, self-hosted, zero egress.
vs the fieldApr 28, 2026· 3m
Crowkis vs Anthropic prompt caching: cache writes that bill you are telling you something
Anthropic's prompt caching is excellent at its actual job, cheap long contexts. It was never designed to be your response cache, and the pricing says so.
guidesApr 27, 2026· 4m
Cache Spring AI in your code review bot with Crowkis
Building code review bots on Spring AI? Add a semantic cache so the same review patterns across pull requests stop costing full price.
guidesApr 27, 2026· 4m
Cache the OpenAI Python SDK in your research assistant with Crowkis
Building research assistants on the OpenAI Python SDK? Add a semantic cache so overlapping literature and summary questions stop costing full price.
guidesApr 27, 2026· 4m
Cache DSPy in your API documentation bot with Crowkis
Building API documentation bots on DSPy? Add a semantic cache so the same endpoint questions from every developer stop costing full price.