Anthropic's new Message Batches API handles up to 10,000 queries per batch, reducing costs by 50% for non-time-sensitive task processing. It's currently in public beta, supports Claude models, and will soon extend to Google Cloud's Vertex AI.
alternativeto.net/news/2024/10