We Benchmarked Fireworks, Together, Baseten, Modal, DeepInfra, Z.ai and Keln
This post reports benchmark results for DeepSeek V4.1 Flash and GLM-5.3 Flash across seven inference providers, measuring turns answered, cache hit rate, decode speed, reasoning tokens and cost per 1,000 turns. Keln answered every turn on both models, had the highest median decode speed on GLM-5.3 Flash at 432 tokens/s, and retained 63.0% of the prompt cached after a 15–20 minute break versus 38.4% on DeepInfra and 0% on Baseten, Modal and Fireworks. Baseten refused about half the DeepSeek turns with rate-limit errors, Modal cut one stream, and Fireworks had 165 cold turns on DeepSeek, making it the most expensive there at $2.86 per 1,000 turns.