Home / News / Moonshot AI's Kimi K3 Debuts With Trillion-Scale Parameters and Million-Token Memory
MLQ News

Moonshot AI's Kimi K3 Debuts With Trillion-Scale Parameters and Million-Token Memory

Jul 19, 20261 min read
Moonshot AI's Kimi K3 Debuts With Trillion-Scale Parameters and Million-Token Memory

News Summary

Chinese AI startup Moonshot AI introduced Kimi K3 on July 16, 2026, 8:00 PM Eastern Time, a large-scale open-weight language model built for long-context reasoning, coding, and agentic workflows. The launch adds to a wave of recent releases from AI labs around the world and highlights how quickly open-weight models are advancing toward the capabilities of leading proprietary systems, giving developers and researchers more options for building AI-powered tools.

Model Architecture and Scale

Kimi K3 is a mixture-of-experts (MoE) model reported to include roughly 2.8 trillion total parameters, making it one of the largest open-weight models released to date. The model supports a context window of up to 1 million tokens, which allows it to process very long documents, large codebases, and extended multi-step agent tasks in a single session without losing track of earlier information.

Moonshot AI says the model incorporates two new architectural techniques. The first, called Kimi Delta Attention (KDA), is designed to improve how the model manages long-range dependencies in text. The second, Attention Residuals (AttnRes), aims to stabilize training and improve reasoning quality across very deep networks. Together, the company says these innovations help the model process long inputs more efficiently while maintaining response quality.

Benchmark Performance

According to Moonshot AI's internal testing, Kimi K3 performs competitively with some of the most advanced AI models currently available, particularly on coding and reasoning benchmarks. Independent evaluators noted strong results on the Frontend Code Arena benchmark, a test that measures a model's ability to generate functional, well-structured front-end code. As with any newly announced benchmark result, the broader research community is expected to conduct further independent verification in the coming weeks.

Pricing and Availability

Moonshot AI has priced API access to Kimi K3 at $3 per million input tokens and $15 per million output tokens, which the company describes as competitive relative to other frontier-scale offerings while remaining accessible for research and commercial development. The company has stated that it plans to publish the full open model weights by July 27, 2026, 12:00 PM Eastern Time, allowing developers, universities, and research labs to download, study, and build on the model directly.

Why It Matters for the AI Community

The release of Kimi K3 is being viewed by many in the technology industry as a notable milestone for open-weight AI development. Open-weight models allow researchers, educators, and smaller companies to inspect, fine-tune, and deploy advanced AI systems without depending solely on proprietary APIs. Analysts covering the AI sector note that continued progress from labs across the globe is generally seen as a positive sign for the field, encouraging broader access to advanced AI tools, healthy technical competition, and faster innovation in areas like software development, scientific research, and education technology.

What Comes Next

With the full open-weight release expected by the end of July 2026, developers are anticipating hands-on access to test Kimi K3 across a range of applications, from coding assistants to research tools. The AI research community will likely spend the following weeks running independent benchmarks and building integrations, providing a clearer picture of how the model performs in real-world use cases.

MLQ NewsTechCrunch