batchwatch

batchwatchQuestions › How much cheaper is the LLM batch API?

How much cheaper is the LLM batch API?

50% cheaper - half the synchronous price, on every token.

The answer

The batch endpoints at OpenAI, Anthropic, Google cost 50% of the synchronous rate on both input and output tokens. That is the providers' own published price, not a batchwatch figure - a job that costs $100 synchronously costs $50 in batch.

The reason people hesitate is the wait, so here is the part nobody else publishes: we measured a median of 77s for gpt-5.6-sol at OpenAI. Half price for a wait usually measured in minutes is the whole case for batching.

Questions this answers

How much cheaper is the LLM batch API?
50% cheaper - half the synchronous rate at OpenAI, Anthropic, Google, on every input and output token. And the wait is usually far shorter than the 24-hour ceiling: half of gpt-5.6-sol jobs finished within 77s in our measurements.

See it live

Every number here is measured, and it is all public.

The live dashboard shows every model with its distribution, n and confidence grade. /v1/coverage is the same data as JSON, no key required. Contributing five measurements in seven days cuts the public delay to five minutes and unlocks the decision endpoints (/v1/should-i-batch, /v1/estimate-batchtime).

More questions we have measured the answer to