Hy4 Preview (Tencent Hunyuan 4, 腾讯混元Hy4) is Tencent's next-generation Mixture-of-Experts flagship model — the successor to Hy3, built for complex reasoning, coding, and agentic tasks.
Model ID: tencent/hy4-preview · Available via OpenAI-compatible API
Announced by Tencent in its Q2 2026 earnings call and now in grey-testing, Hy4 is positioned as an "expert-level" model above Hy3 — with larger parameters, stronger reinforcement learning, and upgraded multimodal capabilities. It serves as the core engine of Tencent's WorkBuddy agent application. According to the official research page, Hy4 Preview is a new-generation Mixture-of-Experts (MoE) flagship model developed by the Tencent Hy Team.
The model comprises 770B total parameters, of which 49B are activated per token. Its backbone consists of 78 layers:
In addition to the backbone, 1 native MTP layer (Multi-Token Prediction, 10B total parameters, 0.7B activated) is built in for speculative decoding — accelerating inference by predicting multiple tokens ahead.
| Architecture Detail | Value |
|---|---|
| Total / Active parameters | 770B / 49B per token |
| Backbone layers | 78 |
| Layer 1 | Dense FFN |
| Layers 2–78 | MoE (256 routed + 1 shared expert each) |
| Activated experts per token | Top-8 routed + shared |
| MTP layer | 1 native (10B / 0.7B active), speculative decoding |
| Specification | Value |
|---|---|
| Architecture | Mixture-of-Experts (MoE) |
| Total / Active parameters | 770B / 49B |
| Backbone | 78 layers (1 dense + 77 MoE) |
| Context window | 1,048,576 tokens |
| Maximum output | 64,000 tokens |
| Input price | $0.834 / 1M tokens |
| Output price | $2.501 / 1M tokens |
| Provider | Tencent Hy Team |
| Official research page | hy.tencent.ai/research/hy4-preview |
Hy4 targets complex reasoning, coding, and agent scenarios — competing directly with DeepSeek, Kimi, and GPT-class frontier models. Full benchmark comparison on our Hy4 vs DeepSeek page.
| Model | Type | Positioning |
|---|---|---|
| Hy4 Preview | Tencent Hunyuan expert MoE | Complex reasoning / coding / agents |
| Hy3 Preview | Tencent Hunyuan MoE | General-purpose |
| DeepSeek V-series | MoE | Reasoning / coding |
| Kimi / GPT-class | MoE / dense | General assistant |
The model is currently delivered as a hosted API rather than a local download. Its model ID is tencent/hy4-preview, and the endpoint below follows the familiar OpenAI chat completions format. Existing clients can usually switch models by changing the base URL and model name instead of adopting a new SDK.
curl https://tokenra.io/v1/chat/completions \
-H "Authorization: Bearer $TOKENRA_KEY" \
-H "Content-Type: application/json" \
-d '{"model":"tencent/hy4-preview","messages":[{"role":"user","content":"Hi"}]}'
Create an account at tokenra.io/register to obtain access credentials, then keep the key in a server-side environment variable such as TOKENRA_KEY. Do not place a production key in browser JavaScript or a public repository. See the API docs for gateway-specific headers, streaming options, rate limits, and error responses.
The headline parameter count describes the capacity of the complete network, not the amount of computation used by every token. In a Mixture-of-Experts design, a router selects a small group of specialist feed-forward networks for each token. The listed 770B total parameters and 49B activated per token provide a large pool of learned capacity while limiting the active path for each step. Parameter totals alone do not predict latency, memory needs, or answer quality.
The first backbone layer uses a dense FFN. Layers 2 through 78 use 256 routed experts and one shared expert per layer, with the top eight routed experts selected alongside the shared path. The shared expert gives every token a common representation while routed experts can specialize in different patterns. This is an architectural description, not a promise that every request will be faster or more accurate. Real-world behavior depends on the gateway, hardware, prompt length, batching, and system instructions.
A native Multi-Token Prediction layer is also listed as part of the design. MTP can support speculative decoding by proposing several future tokens for verification, which may improve serving efficiency when the provider enables it. It does not change the maximum context or guarantee a fixed response time for every workload.
A context window of 1,048,576 tokens is useful for long technical documents, repository-level code review, research notes, and multi-step agent state. Sending a very large prompt costs more and may increase latency. A 64,000-token maximum output is a ceiling, not a target; applications should set an appropriate output limit and stream responses when supported. The gateway may impose its own request, timeout, file, or rate limits.
This service is a candidate for tasks that benefit from long context and deliberate multi-step reasoning: navigating a large codebase, drafting an implementation plan, extracting relationships across lengthy documents, or coordinating tools in an agent workflow. Coding teams can test it on bug diagnosis, refactoring proposals, and test generation. Product teams can compare it on support workflows that require a long conversation history. These are sensible evaluation areas, not claims that it wins every benchmark.
A useful trial should measure grounded accuracy, tool-call reliability, structured output validity, first-token latency, total completion time, and cost per successful task. Compare the same prompts and context against smaller models that may be cheaper for routine requests. Test failure cases such as ambiguous instructions, unsupported claims, malformed JSON, prompt injection, and context close to the provider limit.
Because this is a preview service, availability, pricing, supported features, and model behavior can change. Before sending private data, review the selected gateway's retention and processing terms. Before deployment, confirm current input and output prices, regional availability, uptime expectations, concurrency limits, streaming support, and tool calling. The comparison table is a positioning guide; benchmark results should come from a reproducible test set.
Hy4 Preview is Tencent Hunyuan's next-generation Mixture-of-Experts flagship model and the successor to Hy3. It has 770B total parameters with 49B activated per token, a 1,048,576 token context window, and a maximum output of 64,000 tokens.
Hy4 uses a Mixture-of-Experts architecture with a 78-layer backbone. The first layer is a standard dense FFN; the remaining 77 layers each contain 256 routed experts plus 1 shared expert, with every token activating the top-8 routed experts along with the shared expert. A native MTP layer (10B total parameters, 0.7B activated) is built in for speculative decoding.
Hy4 Preview is available through OpenAI-compatible API gateways. You can create a free account at tokenra.io/register to start calling the tencent/hy4-preview model ID.
Tencent has publicly documented Hy4's architecture on the official research page and HuggingFace. The release is currently served as a hosted API (model ID tencent/hy4-preview on OpenRouter). For the latest weight availability and license, check the official HuggingFace repository.
On OpenRouter, Hy4 Preview is priced at $0.834 per 1M input tokens and $2.501 per 1M output tokens, with a 1,048,576 token context window.
Hy4 Preview supports a 1,048,576 token context window with a maximum output of 64,000 tokens.