DeepSeek-V4
The open-source era of 1M context intelligence
Visit website →About
DeepSeek-V4 Preview is a new series of mixture-of-experts language models, with V4-Pro at 1.6 trillion parameters and V4-Flash at 284 billion. Both support a one-million-token context window by default.
They use a new hybrid attention architecture that sharply reduces the compute and memory cost of long-context processing, making very large context practical rather than expensive.
It is aimed at developers and researchers who need long-context reasoning, over big codebases, document sets, or histories, and want an efficient open-weight option they can run and fine-tune themselves rather than paying frontier-lab API rates.
AI-assisted draft, human-reviewed before publishing — see how we choose & review tools.
Why we picked it
DeepSeek-V4 made the cut for the hybrid attention architecture specifically — a 1M-token context window is a common claim now, but making it computationally practical rather than prohibitively expensive is the actual engineering worth naming here.