Tags
Cost
4 posts
Cost7 minPrefix Caching Economics: When Does the Cache Actually Pay?
Cache reads cost 0.1x, writes 1.25x. Break-even is two requests. So why is your cache silently doing nothing? Minimum prefixes, the 20-block rule and the parallel trap.
Cost5 minFrom Thinking Budgets to Effort Levels: What Reasoning Actually Costs
You pay for hidden thinking tokens. Effort levels replaced thinking budgets, task budgets arrived, caching breaks when you change them, and more thinking can hurt.
Cost4 minEnterprise LLM Budgeting: Token Overhead, FX Risk and the Real Unit Cost
A measured token-overhead figure, cache economics and FX exposure combined into a working unit-cost model — and an honest API-versus-self-host break-even.
Cost9 minLLM Cost Optimization: Cutting the Bill with Tokens, Caching, Model Choice, and RAG
Practical levers for lowering your LLM bill: reducing token consumption, prompt caching, matching the task to the model, batch processing, and the small model + RAG balance. Cost optimization in the right order, with intuitive analogies and example code.