hotai.news
← Back to AI Newsflash
AI News / Event details
IT Home · Published

No GPU needed: A player ran the 2.8 trillion-parameter Kimi K3 model using discontinued Intel Optane memory, achieving a generation speed of 1.5 tokens per second.

Automated summary · Based on collected summaries; not individually verified
Prepared by HotAI

What happened

Reddit user u/IndividualSurvival shared a home lab experiment: Without a GPU, they ran the 2.8 trillion-parameter Moonshot AI Kimi K3 model using discontinued Intel Optane Persistent Memory Series 200 via llama.cpp. At 1-bit quantization, the initial generation speed was approximately 0.85 tokens per second; after disabling DAX, it improved to 1.50 tokens per second. At 3-bit quantization, the speed dropped to 0.75 tokens per second, taking about 18.5 hours to generate 50,000 tokens.

Background

What Is Llama? Meta’s Open Weights and Licensing

Llama is Meta’s AI model family with downloadable weights for building inference services and applications. It is distinct from the Meta AI chat product and from llama.cpp, a tool for running models. The family includes multiple generations and sizes. Check vision and language support in the specific model card. Open weights do not imply a standard MIT or Apache license: Llama 4 uses its own community license.

What Is Kimi? Models for Long Tasks and Legacy APIs

Kimi is the AI model and application brand of Moonshot AI. Using the Kimi chat app and integrating a model through the API are different approaches; downloading an older open-weight release is another deployment choice. Long-context and tool-task capabilities must be interpreted for a specific version. Retirement of a hosted API does not automatically invalidate downloaded files, but neither does it mean the old model remains callable at its former endpoint.

Reading notes

The event summary comes from collected excerpts. Background passages quote existing HotAI articles to explain terms and do not establish new facts about this event. Check the original sources for product results, conditions and subsequent updates.

Original source

Sources and collection timeline

SourceReport titleOriginal publication timeCollected by HotAI
IT HomeNo GPU needed: A player ran the 2.8 trillion-parameter Kimi K3 model using discontinued Intel Optane memory, achieving a generation speed of 1.5 tokens per second.2026-11-13 15:142026-11-13 15:27