Skip to content

Models & products

Tencent releases Hy-Nomas for changing scenes during video generation

3-line summary

  1. New instructions and camera paths guide successive segments.
  2. A low-memory configuration targets one RTX 4090.
  3. The 280 benchmark cases do not include scores.
PracticalDevelopers
A speech bubble adds an instruction between video cards
Illustration: AI Ping

Tencent has published Hy-Nomas weights for video generation that accepts new instructions and camera movements as a sequence continues. The official Hugging Face repository records its initial commit on October 23 and lists about 196GB of files, separated into generation, prompt-processing and video-decoding components.

Base and distilled FP32 generation checkpoints are each roughly 34.2GB, while the INT8 generation checkpoint is about 9.06GB. These are individual file sizes, separate from the GPU memory required to run the model. The 196GB listing combines multiple variants and supporting components.

For each successive segment, Hy-Nomas can take text describing subjects, actions, scenes or styles, alongside camera trajectories. Cached information from earlier segments supplies context for continued generation.

The shared inference preset specifies 720-by-1280 output, a playback rate of 24 frames per second and eight denoising steps. It uses Qwen2.5-VL-7B-Instruct for text encoding and PixelUMM to decode compressed video representations. The default launch uses eight-way sequence parallelism, with eight GPUs in one documented inference group. The shared configuration leaves the history and segment caps unset, retaining earlier context as generation continues. These configuration values do not measure generation throughput or response latency; playback speed describes the resulting video.

A separate low-memory preset provides a configuration for one NVIDIA GeForce RTX 4090. It uses INT8 generation weights and cache, an FP8 decoder, and CPU offloading for the text encoder, generator and decoder. Its default GPU history budget is 18 latent frames, referring to historical context rather than the current segment’s video duration.

Two-way arrows between GPU and CPU cards
Figure: CPU offloading in the low-memory preset · AI Ping

In the online demo, Nomas-PE turns user instructions into generation prompts. It is a separate required service from the Qwen text encoder, with its own serving resources. The one-GPU configuration covers video inference. Offline inference can read prepared prompt files directly.

The accompanying Hy-Nomas-Bench contains 280 evaluation cases across text control, camera navigation, interleaved control and spatial memory. Text cases examine successive instructions and subject consistency. Memory cases use outbound-and-return paths to compare revisited scenes.

The benchmark repository includes instructions, interaction sequences and 220 reference camera trajectories. Generated videos, extracted revisit frames and evaluation scores are absent. Its published inference procedure produces videos; scoring is a separate step.

Four evaluation cards labeled Text, Camera, Mixed and Memory
Figure: Four tasks in the released evaluation inputs · AI Ping

Tencent’s released code, parameters and weights carry Apache 2.0. Third-party components retain their original terms. Redistribution requires preserving the license and relevant notices, with changed files marked as modified. The trademark clause also states that the license does not grant rights to use company or product names.

Sources

  • How-to guideAbout 18 min reading

    Evaluate AI work beyond first impressions

    Build a small evaluation set, compare drafts against evidence, change one instruction and test on a fresh case. No code required.

    AdvancedPlanningDesignersMarketersSalesProduct researchOffice workersDevelopers
  • How-to guideAbout 19 min reading

    Measure an AI pilot and decide when to stop

    Count review and repair as well as generation. Compare fictional task records with a baseline and decide whether to continue, revise or stop.

    AdvancedPlanningDesignersMarketersSalesProduct researchOffice workersDevelopers