Open H3 Regenerate 2K: ComfyUI Workflow, GitHub Weights & VRAM Fix
Open H3 Regenerate 2K is an open-source 3-step diffusion transformer refinement pipeline released by NVIDIA (NVlabs / Efficient-Large-Model) to enable high-resolution 2K video upscaling without relying on MiniMax’s closed-source paid cloud API. While local deployment delivers crisp texture synthesis via 3D latent upsamplers, standard execution demands 24GB of VRAM and can cause subtle character facial shifts. This guide details the complete ComfyUI setup, low-VRAM optimizations for 16GB GPUs, and hybrid web solutions.
Simulate local GPU allocations, refiner denoising sigma, and generate production-ready ComfyUI launch scripts.
# ComfyUI Custom Node Setup for Video Refinement git clone https://github.com/NVlabs/Open-H3-Regenerate-2K custom_nodes/ComfyUI-OpenH3-Regenerate2K cd custom_nodes/ComfyUI-OpenH3-Regenerate2K && pip install -r requirements.txt # Launch ComfyUI with Latent DiT Refiner Optimizations python main.py --preview-method auto --gpu-only --highvram \ --extra-model-paths-config models/open_h3_regenerate_config.yaml \ --vae-backend streamrender_noncausal_24 \ --refiner-sigma 0.35
1. What is Open H3 Regenerate 2K? (Architecture & NVIDIA Release)
The generative video ecosystem evolved rapidly when MiniMax released weights for its 33B foundational model, MiniMax H3-Base, enabling local 768p generation. However, independent creators encountered a limitation: MiniMax reserved its premier 2K refinement model behind a closed-source cloud API.
Breaking the MiniMax API Paywall
To dismantle this bottleneck, NVIDIA’s research team (NVlabs and the Efficient-Large-Model initiative) published Open H3 Regenerate 2K. Pipeline operators can execute this two-stage workflow on private hardware: generating an initial 768p draft on H3-Base and upsampling it through open weights directly into 2560×1440 (2K) video sequences.
3-Step Diffusion Refiner vs Traditional 2K Upscalers
Traditional spatial video upscalers (such as Real-ESRGAN or Topaz Video AI) operate on RGB pixel values, frequently introducing plastic smoothing and artificial halo artifacts. In contrast, this pipeline operates within the latent space of a Diffusion Transformer (DiT). By coupling a 3D-convolution latent upsampler with a specialized refiner LoRA adapter, the model synthesizes authentic micro-geometry in just 3 diffusion denoising steps.
2. Open H3 Regenerate 2K GitHub Code & Hugging Face Weights Download
Setting up a local ComfyUI workflow requires downloading model checkpoints from Hugging Face and installing the corresponding custom node wrapper.
Locating Model Checkpoints on Hugging Face
The authoritative model weights are distributed on Hugging Face under Efficient-Large-Model/Open-H3-Regenerate-2K. The download bundle contains three essential elements:
- open_h3_regenerate_2k_lora.safetensors: The merged DiT refiner LoRA driving detail synthesis.
- sharp_curve_branches.safetensors: Directional branch weights preventing texture swimming.
- latent_upsampler/: 3D-convolution weights transitioning 768p latent maps into 2K spatial representations.
Installing the ComfyUI Custom Node (Step-by-Step)
The community relies on custom node repositories like ComfyUI-OpenH3-Regenerate2K. To install the custom node in your terminal:
# Navigate to ComfyUI custom_nodes directory
cd ComfyUI/custom_nodes
git clone https://github.com/NVlabs/Open-H3-Regenerate-2K.git
cd Open-H3-Regenerate-2K && pip install -r requirements.txt
Note: On Windows workstations, ensure Visual Studio C++ Build Tools are present to compile FlashAttention-2 kernels smoothly.
3. Open H3 Regenerate 2K Hardware Specs & Low-VRAM CUDA OOM Fixes
While NVIDIA enterprise benchmarks highlight fast inference on Blackwell B200 accelerators, consumer hardware experiences notable memory spikes during latent upsampling and VAE decoding passes.
| GPU Hardware Tier | VRAM Allocation | 5s Clip Speed | Stability & Recommendation |
|---|---|---|---|
| NVIDIA RTX 4090 (24GB) | 21.2 GB Peak | 65 – 95 seconds | Optimal with StreamRender VAE |
| NVIDIA RTX 3090 (24GB) | 22.4 GB Peak | 110 – 140 seconds | Stable; recommended baseline |
| NVIDIA RTX 4070 / 4080 (12-16GB) | 15.8 GB (OOM Risk) | 220 – 380 seconds | Requires latent tiling & FP8 weights |
| Apple M3 / M4 Max (36-64GB) | 32.0 GB Unified | 300+ seconds | Experimental; lacks CUDA graphs |
| Qwen Image Editor (Cloud) | 0 GB Local VRAM | 4 – 8 seconds | Zero-VRAM in-browser 2K asset generation |
Optimizing for 16GB GPUs (Latent Tiling & VAE Offload)
If your ComfyUI session encounters CUDA out of memory errors, apply these three adjustments:
- StreamRender-H3 Non-Causal Decoder: Reduces peak VAE memory by up to 40% during spatial decompression.
- Latent Spatial Tiling: Insert a tiled decode node set to 512×512 with 64px overlap to process 2K frames without memory saturation.
- SageAttention Kernel Integration: Leverage SageAttention v2 to replace standard attention matrices with memory-efficient INT8 quantized kernels.
4. Open H3 Regenerate 2K Actor Drift & Typography: Reddit Community Insights
Analysis across Reddit AI communities (r/StableDiffusion and r/comfyui) indicates that the most common challenge in video regeneration is subject identity shift and text logo distortion.
| Reddit Community Discussion | Underlying Mechanism | Recommended Fix |
|---|---|---|
| Character Facial Morphing | Denoise Sigma > 0.40 triggers heavy facial regeneration | Clamp Sigma to 0.28–0.35; apply rank-384 refiner LoRA |
| Mangled Typography & Signs | Video DiTs lack character-level orthographic priors | Pre-inpaint text on keyframes before video animation |
| Background Texture Swimming | Missing sharp_curve_branches cross-attention weight | Verify branch weights are active in model loader |
| CUDA OOM on VAE Decoding | Uncompressed causal decoder memory expansion | Swap to StreamRender-H3 non-causal fast decoder |
Why Generative Refiners Mutate Faces, Ages and Text Logos
Because diffusion refiners perform an iterative forward pass, pixels are reconstructed based on learned generative priors rather than simple scaling. On human close-ups, excessive denoise values can subtly age subjects or alter delicate costume embroidery.
Tuning Denoising Sigma & Refiner LoRA Weights
Open-source developers have released lightweight rank-384 refiner LoRAs. Restricting refinement sigma between 0.28 and 0.35 preserves draft fidelity while synthesizing sharp 2K surface details.
5. Open H3 Regenerate 2K Zero-VRAM Workflow: Asset Prep with Qwen Image Editor
Professional generative video creators utilize a hybrid production pipeline that separates keyframe typography and facial consistency from motion rendering.
Step 1: Pristine Initial Keyframe Preparation: Create or refine your keyframe in Qwen Image Editor. Clean micro-geometry, adjust facial consistency, and position crisp typography that video diffusion models cannot render cleanly.
Step 2: Low-Resolution Motion Animation: Pass the 2K keyframe into your video engine (MiniMax H3 or CogVideoX) at 768p to generate fluid motion dynamics.
Step 3: Conservative Latent Refinement: Execute the 2K DiT refiner with a conservative Sigma (0.28–0.32). Because the keyframe already features high-fidelity textures, the pipeline preserves character identity cleanly.
Zero-VRAM In-Browser 2K Regeneration & Inpainting Alternative
For digital creators who do not possess a 24GB RTX 3090/4090 or who focus primarily on key visuals, concept art, and ecommerce banners, maintaining a local ComfyUI setup may be unnecessary overhead.
Using an in-browser platform like Qwen Image Editor, you can execute natural-language conversational inpainting, expand canvas frames, isolate backgrounds with the AI Background Remover, and export 2048px assets in seconds—leveraging server-side cloud acceleration without local setup.

Former neural rendering pipeline architect and diffusion researcher specializing in video latent architectures, temporal character consistency, and neural rendering workflows.
Frequently Asked Questions About Open H3 Regenerate 2K
It is an open-source video refinement pipeline created by NVIDIA research teams (NVlabs / Efficient-Large-Model). It serves as an open alternative to the closed MiniMax H3-Regenerate-2K API, allowing video editors to upscale low-resolution video drafts to crisp 2560×1440 (2K) resolution in just 3 diffusion refinement steps.
The official weights are hosted on Hugging Face under 'Efficient-Large-Model/Open-H3-Regenerate-2K'. ComfyUI custom node wrappers and execution scripts are accessible on GitHub under NVlabs and community repositories.
Running native 2K video refinement on 16GB cards like the RTX 4070 or 4080 requires memory optimizations: enabling latent tiling (512×512) and FP8 weights. A 24GB GPU such as the RTX 3090 or RTX 4090 offers the smoothest local inference experience.
Character identity variation happens when the refiner denoises too aggressively. To fix it: (1) clamp refiner Sigma between 0.28 and 0.35, (2) load Kijai's rank-384 refiner LoRA, or (3) pre-generate high-resolution keyframes in an online image studio before video generation.
Yes. For creators without a 24GB GPU, cloud-based visual platforms like Qwen Image Editor offer instant, zero-VRAM browser inpainting, canvas expansion, and 2K asset generation powered by enterprise cloud GPUs.
In-browser generative studio with conversational inpainting and 2048px exports.
MiniMax H3 ComfyUI Guide →Master SageAttention patches, 24GB VRAM optimization, and native stereo sound.
Strata Qwen Setup Guide →Learn to run Alibaba 125B coding models on consumer RTX 3090/4090 GPUs.
Credits & Pricing Plans →Affordable pay-as-you-go lifetime credits with commercial usage rights.