Amazon and Booking.com accelerate travel LLMs using knowledge distillation and Medusa
Amazon and Booking.com combine knowledge distillation with Medusa to transfer capabilities from a 70B Llama-3.1 teacher model to a 1.1B TinyLlama student model, achieving the best open-source LLM quality while reducing costs to less than one-third and increasing speed by up to 20 times.
Return to original text
A short introduction is retained here; the full text from the source website is not reposted. For specific wording and subsequent updates, please refer to the original article.
Open AIHOT original