1. Flow Matching DiT vs Unified Multimodal Vision Transformer
At the heart of Black Forest Labs Flux is a 12-billion-parameter Flow Matching Diffusion Transformer (DiT). Rather than relying on traditional U-Net diffusion backbones, Flux treats image latents as sequences of spatial tokens and combines them with a dual text-encoder setup featuring CLIP and T5-XXL. This massive scale provides unprecedented visual depth, accurate human anatomical textures, and dramatic ambient lighting gradients.
In contrast, the vision foundation developed by Alibaba integrates a unified 7-billion-parameter multimodal architecture. Instead of decoupling text understanding into an external frozen text encoder, it shares deep representational layers with language intelligence. This gives the model superior comprehension of grammatical structures, spatial prepositions ("the golden cup behind the velvet curtains to the right of the candlestick"), and multi-subject composition.