33 Second 1920x1088 video at 24fps (800 frames) on a single 4090 with memory to spare, this node should help out most people of any GPU size

Tools 424 points 134 comments 4 days ago

Made using a custom node which can be found on my github here: https://github.com/RandomInternetPreson/ComfyUI\_LTX-2\_VRAM\_Memory\_Management Used workflow from here: https://www.reddit.com/r/StableDiffusion/comments/1qae922/ltx2\_i2v\_isnt\_perfect\_but\_its\_still\_awesome\_my/ This video is uploaded to my github and has the workflow embedded \*\*Edit: I think it works with ggufs but I have not tested it. You will get greater frames when using t2v, I think it should still give more frames for i2v but not to the same extent. i2v uses 2 streams instead of 1, and this means you need a lot more vram. \*\*Edit: This is the first video from the workflow, I did not cherry pick anything; I'm also just not that experienced with prompting this AI and just wanted the character to say specific things in temporal order which I felt was accomplished well. \*\*Edit: Some final edits for the day, I'm tired and am glad the node is useful to many. 1. I've seen notes about LoRA compatibility, if you see this try running the same workflow with and without the node turned on (Ctrl+B). Whenever I encountered a LoRA compatibility issue it persisted with the node off, I think there are just some model-lora compatibility issues that are intrinsic to LTX-2 at the moment. 2. The multi-gpu sequence parallelism with ring attention will work for I2V and T2V, if you are interested in testing your multi-gpu rig. I would avoid using the V2 code, it is still buggy and leverages a different strategy that is still useful for specific cases. The V5 code will still cover those cases just a bit slower. Beware, it is spicy as stated in the video...it does a lot of switching between GPUs and with enough of them active my surge protector trips because of the continuous and abrupt power draws. 3. I've learned a lot doing this and reading the comments, I'm pretty new to ComfyUI, I'll make updates to the repo and if you have ideas or suggestions feel free to mention it at the repo.

More from r/StableDiffusion