sora.ai-类似sora的高质量视频生成器Mora的实现.zip

# Mora: More like Sora for Generalist Video Generation ## Results ### Text-to-video generation <table class="left"> <tr> <th align="left"><b>Input prompt</b></th> <th align="left"><b>Output video</b></th> </tr> <tr> <td>A vibrant coral reef teeming with life under the crystal-clear blue ocean, with colorful fish swimming among the coral, rays of sunlight filtering through the water, and a gentle current moving the sea plants. </td> <td><img src="./image/task_1_demo_1.gif" width=480 height="auto"></td> </tr> <tr> <td>A majestic mountain range covered in snow, with the peaks touching the clouds and a crystal-clear lake at its base, reflecting the mountains and the sky, creating a breathtaking natural mirror.</td> <td><img src="./image/task_1_demo_2.gif" width=480 height="auto"></td> </tr> <tr> <td>In the middle of a vast desert, a golden desert city appears on the horizon, its architecture a blend of ancient Egyptian and futuristic elements.The city is surrounded by a radiant energy barrier, while in the air, seve</td> <td><img src="./image/task_1_demo_3.gif" width=480 height="auto"></td> </tr> </table> ### Text-conditional image-to-video generation <table class="left"> <tr> <th align="left"><b>Input prompt</b></th> <th align="left"><b>Input image</b></th> <th align="left"><b>Mora generated Video</b></th> <th align="left"><b>Sora generated Video</b></th> </tr> <tr> <td>Monster Illustration in the flat design style of a diverse family of monsters. The group includes a furry brown monster, a sleek black monster with antennas, a spotted green monster, and a tiny polka-dotted monster, all interacting in a playful environment. </td> <td><img src="./image/input1.jpg" width=600 height=90></td> <td><img src="./image/task2_demo1.gif" width=160 height=90></td> <td><img src="./image/sora_demo1.gif" width=160 height=90></td> </tr> <tr> <td>An image of a realistic cloud that spells “SORA”.</td> <td><img src="./image/input2.jpg" width=600 height=90></td> <td><img src="./image/task2_demo2.gif" width=160 height=90></td> <td><img src="./image/sora_demo2.gif" width=160 height=90></td> </tr> </table> ### Extend generated video <table class="left"> <tr> <th align="left"><b>Original video</b></th> <th align="left"><b>Mora extended video</b></th> <th align="left"><b>Sora extended video</b></th> </tr> <tr> <td><img src="./image/original video.gif" width=330 height="auto"></td> <td><img src="./image/mora_task3.gif" width=330 height="auto"></td> <td><img src="./image/task3_sora.gif" width=330 height="auto"></td> </tr> </table> ### Video-to-video editing <table class="left"> <tr> <th align="left"><b>Instruction</b></th> <th align="left"><b>Original video</b></th> <th align="left"><b>Mora edited Video</b></th> <th align="left"><b>Sora edited Video</b></th> </tr> <tr> <td>Change the setting to the 1920s with an old school car. make sure to keep the red color.</td> <td><img src="./image/task4_original.gif" width=240 height="auto"></td> <td><img src="./image/task4_mora_1920.gif" width=240 height="auto"></td> <td><img src="./image/task4_sora_1920.gif" width=240 height="auto"></td> </tr> <tr> <td>Put the video in space with a rainbow road</td> <td><img src="./image/task4_original.gif" width=240 height="auto"></td> <td><img src="./image/task4_mora_rainbow.gif" width=240 height="auto"></td> <td><img src="./image/task4_sora_rainbow.gif" width=240 height="auto"></td> </tr> </table> ### Connect videos <table class="left"> <tr> <th align="left"><b>Input previous video</b></th> <th align="left"><b>Input next video</b></th> <th align="left"><b>Output connect Video</b></th> </tr> <tr> <td><img src="./image/task5_mora1.gif" width=300 height="auto"></td> <td><img src="./image/task5_mora2.gif" width=300 height="auto"></td> <td><img src="./image/task5_mora.gif" width=300 height="auto"></td> </tr> <tr> <td><img src="./image/task5_sora1.gif" width=300 height="auto"></td> <td><img src="./image/task5_sora2.gif" width=300 height="auto"></td> <td><img src="./image/task5_sora.gif" width=300 height="auto"></td> </tr> </table> ### Simulate digital worlds <table class="left"> <tr> <th align="left"><b>Mora simulating video</b></th> <th align="left"><b>Sora simulating video</b></th> </tr> <tr> <td><img src="./image/task6_mora1.gif" width="100%" height="auto"></td> <td><img src="./image/task6_sora1.gif" width="100%" height="auto"></td> </tr> <tr> <td><img src="./image/task6_mora2.gif" width="100%" height="auto"></td> <td><img src="./image/task6_sora2.gif" width="100%" height="auto"></td> </tr> </table>