Baseten optimizes Qwen3-ASR 1.7B batch transcription, achieving throughput seven times that of the original vLLM version.
Baseten has optimized the deployment of Qwen3-ASR 1.7B for batch processing; at 64 concurrent requests, throughput exceeds native vLLM by more than seven times, with costs dropping to approximately $0.0013 per audio hour—about 277 times lower than closed-source providers.
Return to original text
A short introduction is retained here; the full text from the source website is not reposted. For specific wording and subsequent updates, please refer to the original article.
Open AIHOT original