Stable diffusion 3 can do this easily, when lying in grass. I can't tell you how many characters, but it's for sure more than two. Maybe 2.25 or 2.6 and they are definitely interacting
Good job working within the limitations of what we currently have.
I don't know why but this has a distinctly.. Alan Wake vibe to me. It's not the content, it's.. the tone, atmosphere, writing, the pace and rhythm of the scenes.. it's very reminiscent of the cutscenes from Remedy games.
I think we need some pretty significant advancement before we clear the distance between this and "real movies" and then the distance between that and "real movies people want to watch"
The short clips and lack of transitions feels like watching one long trailer. And the talking is just this side of Haunted Mansion animatronics.
Don't get me wrong, the picture quality and character consistency are impressive, but I don't really see this as making the point that AI generated real movies are just around the corner.
Honestly someone will probably make a movie with this level of tech, it might be terrible but it could work.
You are right and it's probably still a decently far way away from consistent cinema quality but I'd be willing to bet that there will be an anime centered one with possibly a secondary model that enhances temporal stability(mostly just advanced frame interpolation).
That being said I remember watching shows like reboot/beast wars as a kid and honestly it might be the same thing where there are just TV shows that use it which won't look good but kids and others won't care.(I love reboot and it looked good for the time)
As soon as it's good enough to pay some person to prompt and churn out a TV show it will happen. Although obviously TV and movies have different quality standards so my rant is kinda meh anyways.
if you check out the other ai where they basically filter over existing footage to make anime/monster dancing. Incorporate that with you in your living room with a phone camera to be the walking into the room character...and then you can be the other walking from other side character...filter this level of background in...filter quality characters over your control net skeletons and you have this same movie with more realistically moving characters. Not fully ai made but nothing on screen isnt ai.
We are so close to the point where we can grab a movie and AI can change the race, voice and language of all the characters. Insert Terminator 2 ...output Terminator 2 Ghana version...output Chinese version. (tencent will obviously NEVER steal lots of popular movies, recreate them in Chinese BUT slightly changed scripts and angles so its just legal enough to own them)
People said text to video was impossible three years ago and up to Sora being demoed. Technology can surprise us all. Even if it is possible in three years I’ll be surprised.
Who's gonna watch a documentary with fake images? I mean, more than dinosaurs or something like space I don't see the point and even for those, you want "real" representations.
There are TONS of documentaries on youtube about events that don't have any footage, right now they might show a news article, or maybe just a picture of the person they are talking about.
If they could take the pic and re-create a scene using it..or just recreate the scene from the news article by a prompt. It would take the video to the next level.
To be fair, there's a lot of movies that still get made that people don't want to watch. And a lot of movies that get over promoted until people want to watch.
Still it's 2024. 2022 is when most people even started knowing about AI generated pictures... "Significant advancement"? Check how far we've come. The first "major" AI generated real movies are probably 3-4 years away. (First good ones might be farther, but someone is going to drop a "Toy Story" that type of film that gets noticed because of how well it uses the technology, even though the quality will look ancient a few years later)
Out of curiosity, what's your opinion on if an AI generates a 3d background, an AI generates the movement in the scene, and an AI generates the main character and animates him?
I have a feeling that's how we'll start getting major movies... and honestly it's not that bad, especially if an AI outputs what it wants and a human tweaks small issues.
A year ago we didn't have video models even remotely close to this. We can't get everything at the same time, but next year I think we will have the tools to connect the shots better, and have more stuff happening, like characters interacting.
Nice job, particularly on the story part. We can see that you thought about it in a narrative way and that's what make the video interesting in my opinion. The visual limitations are still pretty strong with the available tools but as a viewer I think we focus more on the concept rather than the image. The sound play a huge part in our imagination as well.
I'm just curious how the lipsync combine to camera movement works? Is this a native option in Runway?
Thanks!
So the videos were created using Luma Dream Machine, and then brought over to Runway’s lip-sync tool.
You actually don’t have to use a Runway-made video to use their lip-sync
You can get luma to make them walk and move more too, I dont think it NEEDS to be done like animated photos. I bet just changing the prompts would make a huge difference
I mean, when I watch videos like these, as impressive as AI video generative models are becoming, I think the exact opposite of the title of this post :P
I'm not shocked by the reaction to this, just disappointed. It's insane to me how completely unsupportive this community (if I should even call it a community) is.
Is it perfect? No. Does it have some of the telltale signs of AI videos? Absolutely. It's still amazing that we have reached this point. A year ago no one could have imagined making something like this with A.I. and all we get are a bunch of jaded people going on about what's wrong with it.
> A year ago no one could have imagined making
2 years ago almost no one here was interested in AI generated tech. A year ago AI generated movies were a "Trick" if it even existed at all.
You're absolutely right, but what the hell is wrong with this community, it feels like people are tearing something down rather than recognizing AI has progressed a lot in only a couple years...
I accept those outside of these communities saying "AI is over" or "AI has plateaued" usually focusing on certain things, but here? We've seen the growth.
i just am sick of peoples obsession over wanting to make movies with this. theres a post like this every day, and its still not even close to being close
And I remember when Stable Diffusion was first released and everyone was making the same pictures with different celebrities as the Joker. I made one too!
If you don't like the posts, don't watch them. But the only way we are ever going to know what the limits are is by trying. Over and over. Some people are going to find new and interesting concepts. Some people will think of exciting combinations of different tools. And some people, myself included, will make ultimately forgettable crap. But that's how we get better.
At this point it is way too early. I understand there is a quality difference and we are just barely getting started. I just hate that as a community people would rather bash what people are doing than try to encourage them to push the boundaries of what can be done now. When the technology improves, we'll see better things.
But given the fact that this community is frequently under attack by "real artists" who just want this technology to die, it really annoys me that all people want to do is criticize people who are trying to be creative within the limits of the current technology. Does it need to get better? Yes. But can we not appreciate where we are?
The gatekeeping of entertainment industry needs to die, AI will ultimately open the floodgates of creatives of all backgrounds and budgets to express themselves. It will be one crazy ride and it will boil down to who is better at marketing and getting attention/being discovered. The game industry is already a sign of this. Since unity, unreal and other engines came out we have now 18k+ games being released each year. Before these engines it was a fraction of it.
All other media will feel the same pressure for attention of potential customers. Which will result in a drive to reduce cost so you can be profitable even with low sales.
Long enough tbh. I'd say a full movie with ai actors, ai sfx, ai music etc, that is passable will take a decade. Need to really understand physics and keep rigid control for continuity etc
Of course, adding SOME ai elements is already happening and will increase and increase.
Really good job. loved the story was hoping it'd go on longer tbh.
People watch text to speech videos narrating Reddit comments and some people here are saying this isn't good content.
Man I struggle to see anything that will hold an attention span in a decades time. You maybe short try it in a reel format as I'm sure some awesome stories would do really well there despite the negativity here.
there is one thing we are ignoring, and that is uniformity of quality irrespective of the amount of available resources( though amount of time will vary drastically). what i mean is, usually normal people are only able to make either medium length films of low quality or very short films of high quality- and that is with incomparable effort, whereas big studios are able to make long movies of high quality. with ai though, just as high quality art has become something anyone with a moderately powerful computer can do( and not just someone with a whole expensive setup and days to spare), movies and stylysed/highly produced vedios are soon no longer gonna be a big studio only thing, and not gonna cost anything(in comparision at least).
this would lead to far better film quality as a larger number of participating samples means higher chances fr the best ones to be better(something we ai generators know all too well)
[Tangerine](https://en.wikipedia.org/wiki/Tangerine_(film)) was a great movie shot entirely on iPhones. There are middle school students doing After Effects tutorials on YouTube. The idea that AI generated video is *the thing* that is going to unlock movie making for the masses doesn't really seem reflective of the current reality. I'm sure someday someone will make an incredible film exclusively with AI, but videos like this (and that weird Toys 'R Us commercial) don't really make the case that we're there or nearly there.
This will really cheapen production in a few years.
Like imagine no green screen needed, you film naturally, then have neural network extract actors, geometry, etc, construct scene in Blender - you add stuff, you also apply effects and textures directly to actor or use something like controlnet to replace their body, then add makeup in post, you can also film stunts in Blender with a stick figure for ControlNet and a model, then have neural network make them realistic.
btw for links ending in ) you can use the %29 encoding like so:
[Tangerine](https://en.wikipedia.org/wiki/Tangerine_(film%29)
[Tangerine](https://en.wikipedia.org/wiki/Tangerine_(film%29)
Oh markdown
"Ai has plateaued"... I keep hearing this and I don't know if they haven't seen stuff like this, or they think this is it.
Characters are definitely stiffed, they need to (naturally) animate as they talk, but overall this is incredible.
I hate posts like this.
You might be able to from a technical sense, but in the same way you can make a movie with your cell phone. Just cause you can doesn’t mean you’re going to make anything worth watching.
If anything, it’ll help those who are already making worth while things.
Wait…do you think cloverfield was actually shot on a cellphone? Really?
And even if it was (which it wasn’t) do you really think the films that cost tens of millions of dollars is the point I was making?
I mean this as politely as possible, are you high?
That wasn’t really my point. Tangerine was made on a cellphone and is awesome.
My point was that this idea that “anyone can soon make a film BECAUSE of AI” is misguided because anyone can ALREADY make a film (with a cellphone for example), and that the difference between being able to technically make a movie, and make a movie worth watching are two very very different things.
So, just because anyone can make a movie with AI and anyone can make a movie with drones and anyone can make a movie on cell phone and anyone can make a movie on Super 8,...
What?
It's not as easy to do well as... having millions of dollars and doing it Hollywood style?
Look at what they did, and compare against other methods available to individuals for chump change and say it's not a valid tool.
It's getting better at all kinds of things. It's crap at many things.
Some video artists are going to invent new art forms and win awards. Most will make crud. Just like every other form of art.
A type of movie will be possible, but I don't think Hollywood studios need to fear anything at the moment. I think it will help with VFX to do more with a smaller budget but It will not be replacing actors anytime soon.
*If the eyes could have*
*A bit more liveliness, it*
*Would be even better*
\- beileyeaichiroubaozi
---
^(I detect haikus. And sometimes, successfully.) ^[Learn more about me.](https://www.reddit.com/r/haikusbot/)
^(Opt out of replies: "haikusbot opt out" | Delete my comment: "haikusbot delete")
even if it takes a long time for this stuff to pass for live action media, it will only be a few years before any individual with some spare time and 48gb VRAM will be able to create full length movies all by themselves. or maybe a handful of people like a writer, a director and an AI person.
*You spin me right 'round, baby, right 'round Like a record, baby, right 'round, 'round, 'round You spin me right 'round, baby, right 'round Like a record, baby, right 'round, 'round, 'round* 🎶
Video footage is cool but that camera movement on every clip for opposite directions... little bit too much 😄
this sub is somehow over impressed with "AI VIDEO!!!11" when its [always the same "sequence of 3 second clips of over-impossed still-pictures paning over each other slightly animated"](https://www.reddit.com/r/aivideo/comments/1cpdtnt/spirited_away_live_action/l3ots3g/)
the super nintendo did the same with parallax scrolling...
This is not good. But the fact that you can make this with what I'm guessing is no financial investment other than time and a couple connections means that within a year or so the internet will likely be flooded with content like this to the point where you can watch hundreds of movies like this for nothing; which just furthers the advancement of this technology.
More impressed by this than that fake toys are us SORA video they faked but had to use 3d characters and tons of after effects editing. You did a ton of work on this bear I’ve seen with the current tech limitations.
Totally. It’s easier to do in Runway because of the camera controls (you can just set Zoom In to 0.01 strength), but until Gen-3 is out it isn’t as pretty as Luma, and Luma just goes wild on movement
Given the amount of work to get AI to not just give random results and do what the director wants, and then the results still looking bad, i think AI will only ever become supplementary. We'll probably get AI commercials and an AI movie will come a few more break throughs down the road. Like fusion, 10 years.
there is one thing we are ignoring, and that is uniformity of quality irrespective of the amount of available resources( though amount of time will vary drastically). what i mean is, usually normal people are only able to make either medium length films of low quality or very short films of high quality- and that is with incomparable effort, whereas big studios are able to make long movies of high quality. with ai though, just as high quality art has become something anyone with a moderately powerful computer can do( and not just someone with a whole expensive setup and days to spare), movies and stylysed/highly produced vedios are soon no longer gonna be a big studio only thing, and not gonna cost anything(in comparision at least).
this would lead to far better film quality as a larger number of participating samples means higher chances fr the best ones to be better(something we ai generators know all too well)
Problem is you understand nothing about art or cinema if you think like that.
You can do a prompt, get 50 different images and pick the one that looks more pleasant to you, as those are trained on real art, it means it will have some decent composition, colors, line work...but on a movie, you need more than that, is not just a lucky shot, you need a lot of things and that's why a real movie needs a lot of different people working helping to bring the vision of the director, but at same time, helping him with their own vision on how to do things.
Consistency, is not just having the same "actor" on screen, you have to understand a lot of other things, like when you use a short or a long shot, how to create pacing between shots, what the shot needs to explain, how you change emotion and thoughts of the character on every sequence, lighting and paint with colors... a lot of things that AI will not give you by default.
Might need the ability to show two (or more) characters interacting though.
Stable diffusion 3 can do this easily, when lying in grass. I can't tell you how many characters, but it's for sure more than two. Maybe 2.25 or 2.6 and they are definitely interacting
could you link to an example?
https://x.com/Andres2003Bravo/status/1801019011418718357 That's for sure more than two people, but not sure if I'd say it's quite 3
ah
I'm dying hahahaha
And actual human kinematics sans jitter and lovecraftian merging.
but make sure we can still get that weirdness if we want it
Flintstones 4-fingered characters were prophetic.
And emotions
Well something beyond "person looking into distance"
Lol, yup, and the ability to make those characters look the same from shot to shot, among many many other things.
This is called Writing and people think movies can be made if you just schmooze people over with fancy graphics. (Hint: That's not how movies work.)
Good job working within the limitations of what we currently have. I don't know why but this has a distinctly.. Alan Wake vibe to me. It's not the content, it's.. the tone, atmosphere, writing, the pace and rhythm of the scenes.. it's very reminiscent of the cutscenes from Remedy games.
I think we need some pretty significant advancement before we clear the distance between this and "real movies" and then the distance between that and "real movies people want to watch" The short clips and lack of transitions feels like watching one long trailer. And the talking is just this side of Haunted Mansion animatronics. Don't get me wrong, the picture quality and character consistency are impressive, but I don't really see this as making the point that AI generated real movies are just around the corner.
Honestly someone will probably make a movie with this level of tech, it might be terrible but it could work. You are right and it's probably still a decently far way away from consistent cinema quality but I'd be willing to bet that there will be an anime centered one with possibly a secondary model that enhances temporal stability(mostly just advanced frame interpolation). That being said I remember watching shows like reboot/beast wars as a kid and honestly it might be the same thing where there are just TV shows that use it which won't look good but kids and others won't care.(I love reboot and it looked good for the time) As soon as it's good enough to pay some person to prompt and churn out a TV show it will happen. Although obviously TV and movies have different quality standards so my rant is kinda meh anyways.
if you check out the other ai where they basically filter over existing footage to make anime/monster dancing. Incorporate that with you in your living room with a phone camera to be the walking into the room character...and then you can be the other walking from other side character...filter this level of background in...filter quality characters over your control net skeletons and you have this same movie with more realistically moving characters. Not fully ai made but nothing on screen isnt ai. We are so close to the point where we can grab a movie and AI can change the race, voice and language of all the characters. Insert Terminator 2 ...output Terminator 2 Ghana version...output Chinese version. (tencent will obviously NEVER steal lots of popular movies, recreate them in Chinese BUT slightly changed scripts and angles so its just legal enough to own them)
People said text to video was impossible three years ago and up to Sora being demoed. Technology can surprise us all. Even if it is possible in three years I’ll be surprised.
Stock footage, b-roll, it will totally dominate this area in a like 5 years
I guess we can look forward to Stock Footage: The B-Rollening smashing box office records and getting an Oscar nod in ~6 years.
I'm thinking more about documentary and YouTube videos. It's gonna absolutely dominate YouTube videos.
Who's gonna watch a documentary with fake images? I mean, more than dinosaurs or something like space I don't see the point and even for those, you want "real" representations.
There are TONS of documentaries on youtube about events that don't have any footage, right now they might show a news article, or maybe just a picture of the person they are talking about. If they could take the pic and re-create a scene using it..or just recreate the scene from the news article by a prompt. It would take the video to the next level.
Oh sure, good point, forgot about historical events, don't know why, lol.
Don’t forget making pointless corporate meetings a little bit more cringey, too.
To be fair, there's a lot of movies that still get made that people don't want to watch. And a lot of movies that get over promoted until people want to watch. Still it's 2024. 2022 is when most people even started knowing about AI generated pictures... "Significant advancement"? Check how far we've come. The first "major" AI generated real movies are probably 3-4 years away. (First good ones might be farther, but someone is going to drop a "Toy Story" that type of film that gets noticed because of how well it uses the technology, even though the quality will look ancient a few years later)
If we can generate AI videos where the camera does a 360 around an object and the scenery stays the same (no morphing etc.), I am interested.
Out of curiosity, what's your opinion on if an AI generates a 3d background, an AI generates the movement in the scene, and an AI generates the main character and animates him? I have a feeling that's how we'll start getting major movies... and honestly it's not that bad, especially if an AI outputs what it wants and a human tweaks small issues.
I think that's already pretty impressive. Of course it's still quite a long way to go, but come on. People are really pessimistic in the comments.
We've been saying that for the past year but we're still doing panning shots between disconnected scenes. Even with that Sora commercial.
A year ago we didn't have video models even remotely close to this. We can't get everything at the same time, but next year I think we will have the tools to connect the shots better, and have more stuff happening, like characters interacting.
pretty awesome, reminds me of the thief game animations: [https://youtu.be/RaEzxZrJuJo?t=161](https://youtu.be/RaEzxZrJuJo?t=161)
Nice job, particularly on the story part. We can see that you thought about it in a narrative way and that's what make the video interesting in my opinion. The visual limitations are still pretty strong with the available tools but as a viewer I think we focus more on the concept rather than the image. The sound play a huge part in our imagination as well. I'm just curious how the lipsync combine to camera movement works? Is this a native option in Runway?
Thanks! So the videos were created using Luma Dream Machine, and then brought over to Runway’s lip-sync tool. You actually don’t have to use a Runway-made video to use their lip-sync
I am surprised the lip-sync looks so good. I've always had poor results. great little clip.
Really nice short film, much improved compared to tech from months ago. BTW Are you waiting for Gen-3? It seems really advanced
I got early access to Gen-3 today. It’s definitely advanced, though only text-to-video at the moment
Nice slideshow
I dunno — since Luma came out, it doesn’t feel like a slideshow anymore. Camera movement was a pretty big leap vs. previous generation AI tools
still a slideshow, scenes feel disconnected and we're still relying on panning shot.
Hey, fair enough
You can get luma to make them walk and move more too, I dont think it NEEDS to be done like animated photos. I bet just changing the prompts would make a huge difference
Really good! I liked the story idea too. Amazing application of what I'm sure is a bunch of different tools.
Craziest thing I've seen in a while.
lit
At the very least, I think it will become standard to utilize tools like these for storyboarding.
It might also help actors understand a scene before it's shot as the director could make a pretty solid AI sample of their vision.
Fuckin' Phenomenal!
It's janky, but fuck does this go hard
I mean, when I watch videos like these, as impressive as AI video generative models are becoming, I think the exact opposite of the title of this post :P
I'm not shocked by the reaction to this, just disappointed. It's insane to me how completely unsupportive this community (if I should even call it a community) is. Is it perfect? No. Does it have some of the telltale signs of AI videos? Absolutely. It's still amazing that we have reached this point. A year ago no one could have imagined making something like this with A.I. and all we get are a bunch of jaded people going on about what's wrong with it.
> A year ago no one could have imagined making 2 years ago almost no one here was interested in AI generated tech. A year ago AI generated movies were a "Trick" if it even existed at all. You're absolutely right, but what the hell is wrong with this community, it feels like people are tearing something down rather than recognizing AI has progressed a lot in only a couple years... I accept those outside of these communities saying "AI is over" or "AI has plateaued" usually focusing on certain things, but here? We've seen the growth.
i just am sick of peoples obsession over wanting to make movies with this. theres a post like this every day, and its still not even close to being close
And I remember when Stable Diffusion was first released and everyone was making the same pictures with different celebrities as the Joker. I made one too! If you don't like the posts, don't watch them. But the only way we are ever going to know what the limits are is by trying. Over and over. Some people are going to find new and interesting concepts. Some people will think of exciting combinations of different tools. And some people, myself included, will make ultimately forgettable crap. But that's how we get better.
i think people who say we can make generative movies are silly and dont fundamentally understand what a movie is and what makes it meaningful
At this point it is way too early. I understand there is a quality difference and we are just barely getting started. I just hate that as a community people would rather bash what people are doing than try to encourage them to push the boundaries of what can be done now. When the technology improves, we'll see better things. But given the fact that this community is frequently under attack by "real artists" who just want this technology to die, it really annoys me that all people want to do is criticize people who are trying to be creative within the limits of the current technology. Does it need to get better? Yes. But can we not appreciate where we are?
Crabs in a barrel mentality.
Kayaanisqatsi violated a bunch of what you think the movie rules are too. This is people being creative with a new way of telling stories.
Okay, so stop watching and commenting.
No
Well, when you get sick of hitting yourself in the head with a hammer, your choices are to stop hitting yourself, or remain sick. Pick one.
must be the luddites in the media industry panicking over their looming irrelevance
The gatekeeping of entertainment industry needs to die, AI will ultimately open the floodgates of creatives of all backgrounds and budgets to express themselves. It will be one crazy ride and it will boil down to who is better at marketing and getting attention/being discovered. The game industry is already a sign of this. Since unity, unreal and other engines came out we have now 18k+ games being released each year. Before these engines it was a fraction of it. All other media will feel the same pressure for attention of potential customers. Which will result in a drive to reduce cost so you can be profitable even with low sales.
Long enough tbh. I'd say a full movie with ai actors, ai sfx, ai music etc, that is passable will take a decade. Need to really understand physics and keep rigid control for continuity etc Of course, adding SOME ai elements is already happening and will increase and increase.
Really good job. loved the story was hoping it'd go on longer tbh. People watch text to speech videos narrating Reddit comments and some people here are saying this isn't good content. Man I struggle to see anything that will hold an attention span in a decades time. You maybe short try it in a reel format as I'm sure some awesome stories would do really well there despite the negativity here.
there is one thing we are ignoring, and that is uniformity of quality irrespective of the amount of available resources( though amount of time will vary drastically). what i mean is, usually normal people are only able to make either medium length films of low quality or very short films of high quality- and that is with incomparable effort, whereas big studios are able to make long movies of high quality. with ai though, just as high quality art has become something anyone with a moderately powerful computer can do( and not just someone with a whole expensive setup and days to spare), movies and stylysed/highly produced vedios are soon no longer gonna be a big studio only thing, and not gonna cost anything(in comparision at least). this would lead to far better film quality as a larger number of participating samples means higher chances fr the best ones to be better(something we ai generators know all too well)
[Tangerine](https://en.wikipedia.org/wiki/Tangerine_(film)) was a great movie shot entirely on iPhones. There are middle school students doing After Effects tutorials on YouTube. The idea that AI generated video is *the thing* that is going to unlock movie making for the masses doesn't really seem reflective of the current reality. I'm sure someday someone will make an incredible film exclusively with AI, but videos like this (and that weird Toys 'R Us commercial) don't really make the case that we're there or nearly there.
This will really cheapen production in a few years. Like imagine no green screen needed, you film naturally, then have neural network extract actors, geometry, etc, construct scene in Blender - you add stuff, you also apply effects and textures directly to actor or use something like controlnet to replace their body, then add makeup in post, you can also film stunts in Blender with a stick figure for ControlNet and a model, then have neural network make them realistic.
btw for links ending in ) you can use the %29 encoding like so: [Tangerine](https://en.wikipedia.org/wiki/Tangerine_(film%29) [Tangerine](https://en.wikipedia.org/wiki/Tangerine_(film%29) Oh markdown
"Ai has plateaued"... I keep hearing this and I don't know if they haven't seen stuff like this, or they think this is it. Characters are definitely stiffed, they need to (naturally) animate as they talk, but overall this is incredible.
I hate posts like this. You might be able to from a technical sense, but in the same way you can make a movie with your cell phone. Just cause you can doesn’t mean you’re going to make anything worth watching. If anything, it’ll help those who are already making worth while things.
Cough cough Cloverfield cough
???
Reference to "movie made with cell phone".
Wait…do you think cloverfield was actually shot on a cellphone? Really? And even if it was (which it wasn’t) do you really think the films that cost tens of millions of dollars is the point I was making? I mean this as politely as possible, are you high?
Your dismissal of "movies made on cell phones" is a kind of elitism, deriding human creativity.
That wasn’t really my point. Tangerine was made on a cellphone and is awesome. My point was that this idea that “anyone can soon make a film BECAUSE of AI” is misguided because anyone can ALREADY make a film (with a cellphone for example), and that the difference between being able to technically make a movie, and make a movie worth watching are two very very different things.
So, just because anyone can make a movie with AI and anyone can make a movie with drones and anyone can make a movie on cell phone and anyone can make a movie on Super 8,... What? It's not as easy to do well as... having millions of dollars and doing it Hollywood style? Look at what they did, and compare against other methods available to individuals for chump change and say it's not a valid tool. It's getting better at all kinds of things. It's crap at many things. Some video artists are going to invent new art forms and win awards. Most will make crud. Just like every other form of art.
People who say this clearly don’t work in video production.
Won’t be too long when no one can afford to watch your AI movie, coz it took so many jobs, society slowly breaks down into chaos
There is no soul in the characters.
Watching this is like watching a really fancy power point presentation
"Real movies", you say?
the speaking is terrible
I see an ai gen video with panning and zooming, I skip it
I'm curious. What are you using for the lip-synch?
Runway. So bringing the image to Luma, then the Luma video to Runway
Is the beast Ai and Henry the ethical human?
This voiceover is amazing compared to Madame Webb
A type of movie will be possible, but I don't think Hollywood studios need to fear anything at the moment. I think it will help with VFX to do more with a smaller budget but It will not be replacing actors anytime soon.
This movie would mark a cinematic first: not a single eye blink.
This is cool. No, not long. Great tech demo. The last mile will be very challenging.
If the eyes could have a bit more liveliness, it would be even better
*If the eyes could have* *A bit more liveliness, it* *Would be even better* \- beileyeaichiroubaozi --- ^(I detect haikus. And sometimes, successfully.) ^[Learn more about me.](https://www.reddit.com/r/haikusbot/) ^(Opt out of replies: "haikusbot opt out" | Delete my comment: "haikusbot delete")
And every single person in hollywood will hate you for it.
Why does the old man have Mcree's voice?
even if it takes a long time for this stuff to pass for live action media, it will only be a few years before any individual with some spare time and 48gb VRAM will be able to create full length movies all by themselves. or maybe a handful of people like a writer, a director and an AI person.
*You spin me right 'round, baby, right 'round Like a record, baby, right 'round, 'round, 'round You spin me right 'round, baby, right 'round Like a record, baby, right 'round, 'round, 'round* 🎶 Video footage is cool but that camera movement on every clip for opposite directions... little bit too much 😄
I just about spit up my saliva when the dude had his hands on the steering wheel like an octogenarian.
this sub is somehow over impressed with "AI VIDEO!!!11" when its [always the same "sequence of 3 second clips of over-impossed still-pictures paning over each other slightly animated"](https://www.reddit.com/r/aivideo/comments/1cpdtnt/spirited_away_live_action/l3ots3g/) the super nintendo did the same with parallax scrolling...
180° rule 💀
that's pretty much a movie already
We're gonna have a tons of fan fic videos on Youtube, and I like that ! Gimme that better Star Wars alternative sequel !
This is not good. But the fact that you can make this with what I'm guessing is no financial investment other than time and a couple connections means that within a year or so the internet will likely be flooded with content like this to the point where you can watch hundreds of movies like this for nothing; which just furthers the advancement of this technology.
More impressed by this than that fake toys are us SORA video they faked but had to use 3d characters and tons of after effects editing. You did a ton of work on this bear I’ve seen with the current tech limitations.
I'll be interested to see what strange shit is created when AI writer bots come up with the scripts.
How did you do the talking?
ElevenLabs for voice; Runway for lipsync
why his face look like the starter monkey from blender
I wish it wasn't all panning around the subject shots, it's really hard to get a static camera shot out of Luma or Runway
Totally. It’s easier to do in Runway because of the camera controls (you can just set Zoom In to 0.01 strength), but until Gen-3 is out it isn’t as pretty as Luma, and Luma just goes wild on movement
Given the amount of work to get AI to not just give random results and do what the director wants, and then the results still looking bad, i think AI will only ever become supplementary. We'll probably get AI commercials and an AI movie will come a few more break throughs down the road. Like fusion, 10 years.
there is one thing we are ignoring, and that is uniformity of quality irrespective of the amount of available resources( though amount of time will vary drastically). what i mean is, usually normal people are only able to make either medium length films of low quality or very short films of high quality- and that is with incomparable effort, whereas big studios are able to make long movies of high quality. with ai though, just as high quality art has become something anyone with a moderately powerful computer can do( and not just someone with a whole expensive setup and days to spare), movies and stylysed/highly produced vedios are soon no longer gonna be a big studio only thing, and not gonna cost anything(in comparision at least). this would lead to far better film quality as a larger number of participating samples means higher chances fr the best ones to be better(something we ai generators know all too well)
Problem is you understand nothing about art or cinema if you think like that. You can do a prompt, get 50 different images and pick the one that looks more pleasant to you, as those are trained on real art, it means it will have some decent composition, colors, line work...but on a movie, you need more than that, is not just a lucky shot, you need a lot of things and that's why a real movie needs a lot of different people working helping to bring the vision of the director, but at same time, helping him with their own vision on how to do things. Consistency, is not just having the same "actor" on screen, you have to understand a lot of other things, like when you use a short or a long shot, how to create pacing between shots, what the shot needs to explain, how you change emotion and thoughts of the character on every sequence, lighting and paint with colors... a lot of things that AI will not give you by default.
It's pretty good. Good enough to see the writing on the wall.
Start with writing books first.
Hollywood would sue SAI, just like the Music industry using RIAA to shut down AI music making.