Previous-generation low-cost model. Still widely used for high-throughput workloads.
Performance
Time to first token
310ms
↓ 27%vs prior 24h
Total response time
750ms
↓ 17%vs prior 24h
Throughput
108.3tok/s
↑ 11%vs prior 24h
Inter-token latency
143.2ms
↓ 30%vs prior 24h