Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
40 commits
Select commit Hold shift + click to select a range
ce8c1f1
Commit a few more docs
dmunch Mar 9, 2026
85cb7ab
feat: add Helios model with 3-stage pyramid denoising
dmunch Mar 5, 2026
5f4e8a8
fix: Helios grey output — wrong time_shift formula + VAE key mapping
dmunch Mar 5, 2026
f8f810c
Add CFG support and VAE frame trimming to Helios pipeline
dmunch Mar 5, 2026
17ca8d1
Fix pyramid denoising color distortion and improve pipeline robustness
dmunch Mar 5, 2026
7c2eb3b
Fix pyramid color bias with normalized start_point and bfloat16 inputs
dmunch Mar 5, 2026
fc7b017
Add Helios diagnostics and engineering notes
dmunch Mar 5, 2026
79e978c
Fix pure noise output: remove start-point normalization, add debug mode
dmunch Mar 5, 2026
3b66659
Fix Helios: correct zero-history timestep embedding and scheduler pre…
dmunch Mar 5, 2026
8609b38
Update HELIOS-DIAGNOSTICS.md with Bug 10 and Bug 11
dmunch Mar 5, 2026
d4152c3
Mitigate chunk boundary blur with latent-space temporal blend
dmunch Mar 6, 2026
47c7f7f
Improve chunk blend: mean-corrected to fix brightness shift
dmunch Mar 6, 2026
ad4e31a
Switch to per-chunk VAE decoding, revert blend default to off
dmunch Mar 6, 2026
f35d105
Implement adaptive anti-drifting for temporal consistency
dmunch Mar 6, 2026
2d5ccf6
Replace anti-drifting noise corruption with history normalization
dmunch Mar 6, 2026
7b868c1
Mitigate camera jumps: amplify first chunk + pixel cross-fade
dmunch Mar 6, 2026
2680755
Fix zoom bug: use float32 for residual connections in transformer blocks
dmunch Mar 6, 2026
80421ce
Disable pixel cross-fade by default to fix chunk boundary quality
dmunch Mar 6, 2026
fa0a9fc
Update diagnostics doc: boundary quality and camera jump issues resolved
dmunch Mar 6, 2026
bb912f0
Document resolution sensitivity as upstream model limitation
dmunch Mar 6, 2026
2f10b4c
Drop first pixel frame from each chunk to remove boundary distortion
dmunch Mar 6, 2026
4f6b27c
Fix brightness jumps at chunk boundaries with contrast correction
dmunch Mar 6, 2026
c551519
Upgrade boundary correction to per-channel brightness and contrast ma…
dmunch Mar 6, 2026
b9d3334
Add spatially-varying brightness correction at chunk boundaries
dmunch Mar 6, 2026
1016d6f
Add diagnostic scripts and update HELIOS-DIAGNOSTICS.md
dmunch Mar 6, 2026
4f12b32
Helios: Fix imports
dmunch Mar 12, 2026
7564c77
Helios: README.md add poodle example
dmunch Mar 12, 2026
4e354a2
Optimize Helios model: remove dead code, fuse ops, add mx.compile
dmunch Mar 12, 2026
c0f1bdf
Fix progress bar total to account for amplified first chunk
dmunch Mar 12, 2026
f5f08cd
perf(helios): Phase 2 — eliminate sync points and reduce eval boundaries
dmunch Mar 12, 2026
8850fd5
fix(helios): compute t=0 projection lazily after weights are loaded
dmunch Mar 12, 2026
b2f8439
perf(helios): hoist history astype(bf16) outside denoising loop
dmunch Mar 12, 2026
0fb8d6a
feat(helios): add 'quantize' subcommand for existing MLX models
dmunch Mar 12, 2026
192d2b6
docs(helios): update README with quantize subcommand usage
dmunch Mar 12, 2026
d3277e4
refactor(helios): align convert CLI with convert_wan pattern
dmunch Mar 12, 2026
b796756
Helios: Cleanup docs
dmunch Mar 12, 2026
bd43d77
Helios: Cleanup folder structure
dmunch Mar 12, 2026
f9cfdc0
Helios: Update README.md
dmunch Mar 12, 2026
a88f282
Helios: Add 41secs of poodles
dmunch Mar 12, 2026
27902e7
Helios: Add links to README.md
dmunch Mar 12, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/PORTING-GUIDE.md
Original file line number Diff line number Diff line change
Expand Up @@ -847,7 +847,7 @@ python scripts/video/video_quality.py output.mp4 --chunk-size 32
python scripts/video/compare_videos.py reference.mp4 output.mp4 --diff-video diff.mp4
```

### Model-specific diagnostics (`scripts/helios/`)
### Model-specific diagnostics (`mlx_video/models/helios/scripts/`)

| Script | Purpose |
|--------|---------|
Expand Down
Binary file added examples/poodles_helios.gif
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
717 changes: 717 additions & 0 deletions mlx_video/convert_helios.py

Large diffs are not rendered by default.

Loading