Now that all my favourite AI video generators can do image-to-video, I thought I'd try a quick comparison test using the same prompt and image input.
Prompt: 𝗔 𝗰𝘂𝘁𝗲 𝗳𝗹𝘂𝗳𝗳𝘆 𝗺𝗼𝗻𝘀𝘁𝗲𝗿 𝘄𝗮𝘃𝗲𝘀 𝘁𝗼 𝗰𝗮𝗺𝗲𝗿𝗮, 𝘀𝗺𝗶𝗹𝗲𝘀 𝗮𝗻𝗱 𝘁𝗵𝗲𝗻 𝘄𝗮𝗹𝗸𝘀 𝗼𝗳𝗳 𝘁𝗼 𝗿𝗶𝗴𝗵𝘁 𝗮𝗻𝗱 𝗲𝘅𝗶𝘁𝘀 𝗳𝗿𝗮𝗺𝗲.
Tests like this only tell you so much. Results will be different with every re-roll, but I tried to give each model at least a few chances to show what it could do. Here's what I learnt...
🔹 𝗠𝗶𝗻𝗶𝗺𝗮𝘅 - Got closest to the prompt and did a great job with the animation and character consistency.
🔹 𝗞𝗹𝗶𝗻𝗴 - Very expressive. Lots of dynamic movement but the character changed somewhat from the initial frame.
🔹 𝗗𝗿𝗲𝗮𝗺 𝗠𝗮𝗰𝗵𝗶𝗻𝗲 - Performed the worst in this particular test with some very odd moves and warping/deflation!
🔹 𝗥𝘂𝗻𝘄𝗮𝘆 (Gen-3) - Great character consistency and image quality with a nice wave and walk cycle. Not great prompt adherence though. It’s missing the smile and walk off at the end.
I've linked each of these in the comments so you can try them out for yourself.
For now at least I'll be keeping all 4 in my AI tool-box. Although Luma's Dream Machine performed the worst, it still has its uses and is particularly good for transitions where the first and last frames are totally different images. Its very quick at generating now too - almost as fast as Runway's Turbo mode but without the pause you often get when using Gen-3. Kling can create some real money-shots on a single roll, but you have to wait for them. I'm fairly new to Minimax, but will definitely be using it more now it accepts image inputs.
If I had to choose one right now it would be Hailuoai's Minimax. Not only is it extremely capable but it's also currently free!
👉 Want to take a deeper dive into generative AI? Check out the live, online course I've been running for almost a year now. See link in the comments. 👀
#minimax #kling #lumadreammachine #runwaygen3
Director of Operations and Tech @ TNV Method | ex - AI Infrastructure and Software Engineer in Amazon.
1yThis is dreambooth training on SDXL and just not lora?