LTX 2.3 video benchmarks

Test hardware and platform limits.

Leaf control: Windows and native Linux use Diffusers leaf offloading with use_stream=True. WSL uses use_stream=False because streamed leaf offloading was incompatible with the tested WSL environment; this is not a limitation established for every WSL setup. This setting concerns weight offloading, not video VAE decode streaming.

Distilled BF16, 1280×704, 5 seconds at 24 fps (121 frames), 8 steps, seed 43; real guitar image/prompt, no input audio, generated stereo audio. Shared official leaf encoder/auxiliaries and resident temporal GPU VAE decode.

Presets resolve to the executed transformer runtimes; the VAE route is independent. Scenario names link directly to measurement details. Times are seconds; GPU is sampled absolute driver usage, RAM is process RSS, and memory units are GiB. Average is denoise wall divided by steps, including warmup, not completed warm GPU timing. Tracked total excludes command startup and downloads. Before reading the tables, see the labels and memory glossary.

In comparable overview tables, official Diffusers leaf is the first row and the reference for that table: 🟢 ↓ is lower, 🔴 ↑ is higher. Equal displayed values have no arrow. Arrows describe measurements, not an overall preset ranking; higher memory can accompany faster execution. Phase tables and separate workloads without a leaf control have no arrows. Rows with different driver/cache sessions or a reused non-side-by-side observation also have no arrows.

Windows — BF16

The primary comparison uses the default PyTorch SDPA path for video self-attention. The external FlashAttention 2 and Sol-Attn options were not selected. The specific kernel chosen internally by SDPA was not recorded.

Phase-table rows identify the complete pipeline by its transformer route. Encoder, conditioning and VAE strategies are shared as stated above; a row labeled vmm_fast does not imply native VMM execution in every phase.

A separate two-step residual CPU source ownership validation recovered checkpoint-related commit headroom with exact output equivalence. Its larger conditioned workload and experimental backing policy are not rows in the matched performance table below.

Scenario (details) Transformer runtime VAE route Denoise (s) Average (s/step) Tracked total (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (reference) official leaf hooks resident, temporal streaming 392.91 49.11 452.33 4.72 41.34
one_shot_fast linear_runtime resident, temporal streaming 262.22 🟢 ↓ 32.78 🟢 ↓ 336.44 🟢 ↓ 4.72 47.87 🔴 ↑
low_ram_safe linear_runtime resident, temporal streaming 328.62 🟢 ↓ 41.08 🟢 ↓ 394.89 🟢 ↓ 6.81 🔴 ↑ 42.22 🔴 ↑
vmm_fast vmm_fast_runtime resident, temporal streaming 207.40 🟢 ↓ 25.92 🟢 ↓ 277.09 🟢 ↓ 5.21 🔴 ↑ 32.65 🟢 ↓
nvme_baseline vmm_runtime resident, temporal streaming 218.46 🟢 ↓ 27.31 🟢 ↓ 281.67 🟢 ↓ 5.24 🔴 ↑ 25.99 🟢 ↓

Phase measurements

These are selected separately monitored phases, not an additive decomposition of the tracked total. Cleanup, saving and other unlisted setup remain in the total.

Text encoder

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 16.67 3.28 25.75
one_shot_fast 17.15 3.28 25.75
low_ram_safe 16.79 3.28 25.75
vmm_fast 17.14 2.96 25.80
nvme_baseline 16.86 3.28 25.75

Connectors

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 7.00 2.73 25.99
one_shot_fast 7.59 2.73 25.99
low_ram_safe 7.12 2.73 25.99
vmm_fast 7.64 2.96 25.98
nvme_baseline 7.33 2.73 25.99

Image conditioning encoder

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 1.60 1.44 5.90
one_shot_fast 2.11 1.44 8.04
low_ram_safe 1.83 1.44 8.04
vmm_fast 2.07 2.96 8.05
nvme_baseline 1.59 1.44 5.90

Audio conditioning preparation

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 0.14 1.10 5.30
one_shot_fast 0.16 1.10 6.69
low_ram_safe 0.14 1.10 6.69
vmm_fast 0.16 2.96 6.69
nvme_baseline 0.14 1.10 5.30

Transformer load/prepare

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 1.55 1.59 5.45
one_shot_fast 1.73 1.59 6.84
low_ram_safe 1.53 1.59 6.84
vmm_fast 1.82 2.96 6.84
nvme_baseline 1.64 1.59 5.45

Transformer attachment

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 0.15 1.10 5.45
one_shot_fast 11.29 1.12 41.65
low_ram_safe 2.60 4.44 10.02
vmm_fast 4.65 2.96 8.36
nvme_baseline 2.92 1.89 7.25

Denoise

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 392.91 3.32 41.34
one_shot_fast 262.22 3.19 47.87
low_ram_safe 328.62 6.81 42.22
vmm_fast 207.40 5.08 32.65
nvme_baseline 218.46 5.24 7.30

Video VAE decode

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 22.52 4.72 11.57
one_shot_fast 23.47 4.72 33.02
low_ram_safe 22.84 4.72 12.49
vmm_fast 24.00 5.21 12.36
nvme_baseline 22.72 4.72 11.77

Audio VAE decode

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 0.06 1.20 9.59
one_shot_fast 0.08 1.20 31.31
low_ram_safe 0.06 1.20 10.47
vmm_fast 0.08 3.40 10.50
nvme_baseline 0.06 1.20 10.09

Vocoder

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 0.42 1.46 9.72
one_shot_fast 0.44 1.50 31.45
low_ram_safe 0.44 1.50 10.61
vmm_fast 0.52 3.40 10.63
nvme_baseline 0.42 1.47 10.23

Pipeline total

Measured tracked totals and global peaks for the same complete runs above. These are not sums of the phase tables. The encoder and VAE routes remain as stated for this workload; the runtime column identifies the transformer.

Method / scenario (details) Transformer runtime VAE route Tracked total (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (reference) official leaf hooks resident, temporal streaming 452.33 4.72 41.34
one_shot_fast linear_runtime resident, temporal streaming 336.44 4.72 47.87
low_ram_safe linear_runtime resident, temporal streaming 394.89 6.81 42.22
vmm_fast vmm_fast_runtime resident, temporal streaming 277.09 5.21 32.65
nvme_baseline vmm_runtime resident, temporal streaming 281.67 5.24 25.99

Linux — BF16

The NVMe observation uses a different driver/cache session from the route trio; it is not a controlled allocator-only A/B.

Scenario (details) Transformer runtime VAE route Denoise (s) Average (s/step) Tracked total (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (reference) official leaf hooks resident, temporal streaming 338.01 42.25 386.81 4.09 41.21
one_shot_fast + host-cache release linear_runtime resident, temporal streaming 216.16 🟢 ↓ 27.02 🟢 ↓ 296.27 🟢 ↓ 4.05 🟢 ↓ 43.30 🔴 ↑
vmm_fast vmm_fast_runtime resident, temporal streaming 188.83 🟢 ↓ 23.60 🟢 ↓ 239.87 🟢 ↓ 5.63 🔴 ↑ 32.85 🟢 ↓
nvme_baseline vmm_runtime resident, temporal streaming 318.65 39.83 379.54 5.27 41.90

Phase measurements

These are selected separately monitored phases, not an additive decomposition of the tracked total. Cleanup, saving and other unlisted setup remain in the total.

Text encoder

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 9.47 3.04 25.85
one_shot_fast + host-cache release 9.63 3.16 25.81
vmm_fast 9.52 2.90 25.82
nvme_baseline 10.30 3.18 25.85

Connectors

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 5.04 2.51 26.02
one_shot_fast + host-cache release 5.03 2.63 26.02
vmm_fast 4.93 2.90 26.00
nvme_baseline 5.24 2.64 26.06

Image conditioning encoder

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 1.33 1.04 5.56
one_shot_fast + host-cache release 1.69 1.17 7.71
vmm_fast 1.92 2.91 7.69
nvme_baseline 1.23 1.16 5.59

Audio conditioning preparation

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 0.15 0.87 4.96
one_shot_fast + host-cache release 0.16 1.01 6.36
vmm_fast 0.15 2.91 6.34
nvme_baseline 0.15 0.99 5.00

Transformer load/prepare

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 1.66 1.42 5.43
one_shot_fast + host-cache release 1.68 1.57 6.83
vmm_fast 1.64 2.91 6.81
nvme_baseline 1.70 1.55 5.47

Transformer attachment

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 0.12 0.87 5.43
one_shot_fast + host-cache release 24.67 1.10 43.30
vmm_fast 1.65 2.92 8.31
nvme_baseline 2.69 1.80 7.27

Denoise

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 338.01 3.33 41.21
one_shot_fast + host-cache release 216.16 3.01 32.56
vmm_fast 188.83 5.06 32.85
nvme_baseline 318.65 5.27 41.90

Video VAE decode

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 25.61 4.09 10.25
one_shot_fast + host-cache release 24.50 4.05 4.94
vmm_fast 24.84 5.63 10.74
nvme_baseline 33.06 4.13 10.74

Audio VAE decode

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 0.05 1.14 5.92
one_shot_fast + host-cache release 0.07 1.10 1.27
vmm_fast 0.06 3.25 6.69
nvme_baseline 0.06 1.16 6.26

Vocoder

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf 0.40 1.38 6.05
one_shot_fast + host-cache release 0.44 1.36 1.40
vmm_fast 0.50 3.25 6.81
nvme_baseline 0.43 1.44 6.39

Pipeline total

Measured tracked totals and global peaks for the same complete runs above. These are not sums of the phase tables. The encoder and VAE routes remain as stated for this workload; the runtime column identifies the transformer.

Method / scenario (details) Transformer runtime VAE route Tracked total (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (reference) official leaf hooks resident, temporal streaming 386.81 4.09 41.21
one_shot_fast + host-cache release linear_runtime resident, temporal streaming 296.27 4.05 43.30
vmm_fast vmm_fast_runtime resident, temporal streaming 239.87 5.63 32.85
nvme_baseline vmm_runtime resident, temporal streaming 379.54 5.27 41.90

WSL — BF16

Leaf controls are non-streamed; linear uses an explicit 3 GiB override and native uses bounded registration. These are not Windows/Linux parity claims.

Scenario (details) Transformer runtime VAE route Denoise (s) Average (s/step) Tracked total (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (no stream) (reference) official leaf hooks resident, temporal streaming 1419.53 177.44 1644.53 4.14 38.62
wsl_compat (3 GiB override) linear_runtime resident, temporal streaming 489.98 🟢 ↓ 61.25 🟢 ↓ 750.73 🟢 ↓ 6.67 🔴 ↑ 38.51 🟢 ↓
vmm_fast (bounded) vmm_fast_runtime resident, temporal streaming 372.65 🟢 ↓ 46.58 🟢 ↓ 604.45 🟢 ↓ 5.31 🔴 ↑ 38.54 🟢 ↓

Phase measurements

These are selected separately monitored phases, not an additive decomposition of the tracked total. Cleanup, saving and other unlisted setup remain in the total.

Text encoder

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (no stream) 132.55 2.98 38.54
wsl_compat (3 GiB override) 144.30 2.98 38.51
vmm_fast (bounded) 131.31 2.94 38.54

Connectors

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (no stream) 38.25 2.73 38.40
wsl_compat (3 GiB override) 42.82 2.73 38.29
vmm_fast (bounded) 39.46 2.91 38.36

Image conditioning encoder

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (no stream) 5.36 1.26 6.32
wsl_compat (3 GiB override) 6.16 1.26 6.33
vmm_fast (bounded) 5.95 1.42 6.33

Audio conditioning preparation

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (no stream) 0.30 1.10 5.73
wsl_compat (3 GiB override) 0.23 1.10 5.74
vmm_fast (bounded) 0.23 1.42 5.73

Transformer load/prepare

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (no stream) 2.68 1.63 5.84
wsl_compat (3 GiB override) 2.84 1.63 5.84
vmm_fast (bounded) 2.77 1.74 5.84

Transformer attachment

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (no stream) 0.09 1.10 5.73
wsl_compat (3 GiB override) 18.20 4.41 9.13
vmm_fast (bounded) 7.65 1.56 6.11

Denoise

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (no stream) 1419.53 3.03 38.62
wsl_compat (3 GiB override) 489.98 6.67 38.47
vmm_fast (bounded) 372.65 4.54 30.77

Video VAE decode

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (no stream) 24.38 4.14 17.34
wsl_compat (3 GiB override) 23.67 4.14 10.31
vmm_fast (bounded) 25.07 5.31 10.41

Audio VAE decode

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (no stream) 0.29 1.24 12.55
wsl_compat (3 GiB override) 0.07 1.20 5.73
vmm_fast (bounded) 0.07 1.54 5.74

Vocoder

Method / scenario (details) Latency (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (no stream) 0.56 1.47 12.57
wsl_compat (3 GiB override) 0.59 1.47 5.74
vmm_fast (bounded) 0.53 1.59 5.75

Pipeline total

Measured tracked totals and global peaks for the same complete runs above. These are not sums of the phase tables. The encoder and VAE routes remain as stated for this workload; the runtime column identifies the transformer.

Method / scenario (details) Transformer runtime VAE route Tracked total (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Official leaf (no stream) (reference) official leaf hooks resident, temporal streaming 1644.53 4.14 38.62
wsl_compat (3 GiB override) linear_runtime resident, temporal streaming 750.73 6.67 38.51
vmm_fast (bounded) vmm_fast_runtime resident, temporal streaming 604.45 5.31 38.54

VAE strategies — separate native-encoder workload

Five seconds, 1280×704, 24 fps, 8 steps, seed 43. Native text encoder; temporal GPU streaming in both decoder routes.

Platform / Scenario (details) Transformer runtime VAE route Denoise (s) Average (s/step) Tracked total (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Windows / vmm_fast / resident VAE vmm_fast_runtime resident, temporal streaming 198.58 24.82 261.67 5.14 28.42
Windows / vmm_fast / leaf VAE vmm_fast_runtime leaf, temporal streaming 199.30 24.91 271.83 4.96 28.42
Linux / vmm_fast / resident VAE vmm_fast_runtime resident, temporal streaming 209.75 26.22 266.51 4.87 28.42
Linux / vmm_fast / leaf VAE vmm_fast_runtime leaf, temporal streaming 209.50 26.19 272.25 4.79 28.42

Phase measurements

Scenario (details) Phase Wall (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
vmm_fast / resident VAE Text encoder 12.08 5.14 25.29
vmm_fast / resident VAE Connectors 6.50 2.82 11.31
vmm_fast / resident VAE Image conditioning encoder 3.85 1.45 8.09
vmm_fast / resident VAE Audio conditioning preparation 0.15 1.45 6.73
vmm_fast / resident VAE Transformer load/prepare 1.81 1.71 6.88
vmm_fast / resident VAE Transformer attachment 6.23 1.72 3.75
vmm_fast / resident VAE Denoise 198.58 4.57 28.42
vmm_fast / resident VAE Video VAE decode 22.66 4.81 7.16
vmm_fast / resident VAE Audio VAE decode 0.07 1.54 5.89
vmm_fast / resident VAE Vocoder 0.48 1.54 6.02
vmm_fast / leaf VAE Text encoder 12.15 4.96 25.29
vmm_fast / leaf VAE Connectors 6.47 2.82 11.36
vmm_fast / leaf VAE Image conditioning encoder 3.21 1.45 8.09
vmm_fast / leaf VAE Audio conditioning preparation 0.14 1.45 6.73
vmm_fast / leaf VAE Transformer load/prepare 1.99 1.71 6.88
vmm_fast / leaf VAE Transformer attachment 6.66 1.72 3.75
vmm_fast / leaf VAE Denoise 199.30 4.57 28.42
vmm_fast / leaf VAE Video VAE decode 32.88 3.02 9.27
vmm_fast / leaf VAE Audio VAE decode 0.06 1.57 7.06
vmm_fast / leaf VAE Vocoder 0.48 1.57 7.18
vmm_fast / resident VAE Text encoder 14.71 4.78 25.29
vmm_fast / resident VAE Connectors 5.41 2.43 11.06
vmm_fast / resident VAE Image conditioning encoder 1.83 1.04 7.78
vmm_fast / resident VAE Audio conditioning preparation 0.16 1.04 6.43
vmm_fast / resident VAE Transformer load/prepare 2.54 1.47 6.90
vmm_fast / resident VAE Transformer attachment 1.55 1.22 3.76
vmm_fast / resident VAE Denoise 209.75 4.14 28.42
vmm_fast / resident VAE Video VAE decode 24.39 4.87 6.23
vmm_fast / resident VAE Audio VAE decode 0.05 1.11 2.26
vmm_fast / resident VAE Vocoder 0.45 1.16 2.38
vmm_fast / leaf VAE Text encoder 14.65 4.79 25.29
vmm_fast / leaf VAE Connectors 4.65 2.43 11.15
vmm_fast / leaf VAE Image conditioning encoder 1.61 1.04 7.77
vmm_fast / leaf VAE Audio conditioning preparation 0.13 1.04 6.42
vmm_fast / leaf VAE Transformer load/prepare 2.01 1.47 6.89
vmm_fast / leaf VAE Transformer attachment 1.56 1.22 3.75
vmm_fast / leaf VAE Denoise 209.50 4.14 28.42
vmm_fast / leaf VAE Video VAE decode 32.50 2.59 7.51
vmm_fast / leaf VAE Audio VAE decode 0.03 1.13 2.53
vmm_fast / leaf VAE Vocoder 0.39 1.13 2.58

Saved FP8 weight-only — separate precision pairs

Five-second video; auxiliary components remain unchanged within each platform pair. Lower transformer storage does not imply faster denoising or lower peak GPU usage.

Platform / Scenario (details) Transformer runtime VAE route Denoise (s) Average (s/step) Tracked total (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
Windows / vmm_fast / BF16 control vmm_fast_runtime resident, temporal streaming 199.36 24.92 262.47 5.14 28.42
Windows / vmm_fast / saved FP8 vmm_fast_runtime resident, temporal streaming 218.59 27.32 312.98 5.92 25.38
Linux / vmm_fast / BF16 control vmm_fast_runtime resident, temporal streaming 188.83 23.60 239.87 5.63 32.85
Linux / vmm_fast / saved FP8 vmm_fast_runtime resident, temporal streaming 199.38 24.92 275.66 7.32 26.04

Phase measurements

Scenario (details) Phase Wall (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
vmm_fast / BF16 control Text encoder 12.22 5.14 25.29
vmm_fast / BF16 control Connectors 6.67 2.82 11.44
vmm_fast / BF16 control Image conditioning encoder 3.30 1.45 5.94
vmm_fast / BF16 control Audio conditioning preparation 0.13 1.45 5.34
vmm_fast / BF16 control Transformer load/prepare 1.40 1.78 5.49
vmm_fast / BF16 control Transformer attachment 6.52 1.72 3.75
vmm_fast / BF16 control Denoise 199.36 4.57 28.42
vmm_fast / BF16 control Decode/save aggregate 26.87 4.81 7.46
vmm_fast / saved FP8 Text encoder 9.77 5.14 25.29
vmm_fast / saved FP8 Connectors 3.59 2.82 11.43
vmm_fast / saved FP8 Image conditioning encoder 3.13 1.45 5.94
vmm_fast / saved FP8 Audio conditioning preparation 0.12 1.45 5.34
vmm_fast / saved FP8 Transformer load/prepare 32.43 1.78 25.38
vmm_fast / saved FP8 Transformer attachment 10.46 1.72 23.70
vmm_fast / saved FP8 Denoise 218.59 5.92 23.85
vmm_fast / saved FP8 Decode/save aggregate 26.94 4.81 9.17
vmm_fast / BF16 control Text encoder 9.52 2.90 25.82
vmm_fast / BF16 control Connectors 4.93 2.90 26.00
vmm_fast / BF16 control Image conditioning encoder 1.92 2.91 7.69
vmm_fast / BF16 control Audio conditioning preparation 0.15 2.91 6.34
vmm_fast / BF16 control Transformer load/prepare 1.64 2.91 6.81
vmm_fast / BF16 control Transformer attachment 1.65 2.92 8.31
vmm_fast / BF16 control Denoise 188.83 5.06 32.85
vmm_fast / BF16 control Video VAE decode 24.84 5.63 10.74
vmm_fast / BF16 control Audio VAE decode 0.06 3.25 6.69
vmm_fast / BF16 control Vocoder 0.50 3.25 6.81
vmm_fast / saved FP8 Text encoder 9.53 2.82 25.83
vmm_fast / saved FP8 Connectors 5.03 2.82 26.04
vmm_fast / saved FP8 Image conditioning encoder 1.94 2.82 7.73
vmm_fast / saved FP8 Audio conditioning preparation 0.15 2.82 6.38
vmm_fast / saved FP8 Transformer load/prepare 23.70 2.82 24.30
vmm_fast / saved FP8 Transformer attachment 5.93 2.83 25.70
vmm_fast / saved FP8 Denoise 199.38 7.32 21.36
vmm_fast / saved FP8 Video VAE decode 23.40 5.21 6.06
vmm_fast / saved FP8 Audio VAE decode 0.06 3.05 2.00
vmm_fast / saved FP8 Vocoder 0.46 3.05 2.02

WSL video with conditioning audio

Separate five-second workload with guitar image and input audio; not matched to the no-input-audio WSL comparison above.

Platform / Scenario (details) Transformer runtime VAE route Denoise (s) Average (s/step) Tracked total (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
WSL / vmm_fast / image + audio vmm_fast_runtime resident, temporal streaming 367.62 45.95 512.35 5.32 27.63

Phase measurements

Scenario (details) Phase Wall (s) Peak GPU (absolute, GiB) Peak RAM (RSS, GiB)
vmm_fast / image + audio Text encoder 41.74 5.19 24.21
vmm_fast / image + audio Connectors 38.45 2.87 14.01
vmm_fast / image + audio Image conditioning encoder 7.02 1.47 3.24
vmm_fast / image + audio Audio conditioning preparation 3.02 1.48 2.37
vmm_fast / image + audio Transformer load/prepare 2.88 1.82 2.60
vmm_fast / image + audio Transformer attachment 6.90 1.56 2.97
vmm_fast / image + audio Denoise 367.62 4.54 27.63
vmm_fast / image + audio Video VAE decode 25.20 5.32 6.89
vmm_fast / image + audio Audio VAE decode 0.04 1.56 2.50
vmm_fast / image + audio Vocoder 0.61 1.64 2.58

Recommendations

Hardware / priority Recommendation from these measurements
8 GiB GPU, ample system RAM, speed vmm_fast has the shortest tracked total in each primary platform set, with higher GPU peaks than the corresponding official leaf control.
Lower transformer-phase process RAM on Windows nvme_baseline has much lower denoise RSS than native/linear and a close tracked total; the common encoder still needs about 26 GiB RSS. OS file cache is not included in process RSS.
Lower decoder GPU pressure Leaf VAE with temporal streaming reduces decode GPU peak, at extra time and RAM. Prefer resident temporal decode when it fits.
Neither RAM nor GPU headroom is sufficient for decode Consider supported VAE tiling; validate quality and account for assembled output memory.
WSL Use documented bounded registration or the explicit 3 GiB wsl_compat override, not untested preset capacities.
Lower transformer storage / process RSS Saved FP8 is compatible in the measured pairs, but slower than BF16 and not lower in peak GPU usage.

low_ram_safe was not the lowest-memory Windows route. These five-second tables do not establish capacity or performance for longer videos.

Single observations, not statistical or arbitrary-model guarantees. Missing measurements are unavailable, not zero; phase peaks must not be summed. See presets, reproduction and measurement details before comparing different recipes.