TCO calculator
Set a target interactivity (tokens/sec/user) and compare the throughput and cost across all chips. Values are interpolated from real benchmark data.
Throughput & TCO calculator
The throughput and total cost of ownership (TCO) calculator uses measured benchmark data to estimate cost per million tokens and performance per dollar for LLM serving on each chip config.