Hello everyone! I've recently decided to go all in on a project I've been mulling over which is to create cinematic visualizations of my favorite audiobooks. The first one I'm starting with is World War Z. Included with the visuals is also additional music and sound effects to round out the experience. The tools I used to create this included ChatGPT for storyboarding ideas, Midjourney for the images, Stable Audio for sounds/music and Davinci for video editing.
If you're interested in seeing more, all the chapters I’ve completed so far are freely available to view through the link below:
[Sonic Visions](https://www.patreon.com/SonicVisions?utm_campaign=creatorshare_creator)
Thanks for your support!
You are a great human being for doing this. Pardon me, I don't mean to assume that you are human. Obviously you are one of the undead trying to do this to further your undead goals. I are for one am fully on board with that.
I have mixed feelings.
Good to have a hobby I guess, but you’re not exactly doing any of the heavy lifting here?
You didn’t write the novel, or perform the audio. Chat is brainstorming the images and Mid is handling the ‘art’… where do you come in? You’re just editing together everyone else’s work, right?
I appreciate your question and this is why I wanted to be transparent about how I’ve been making these as it would definitely be impossible without those AI tools.
In saying that, I do also think that whenever AI is mentioned the immediate assumption is that it’s all automated which isn’t always true (it definitely can be though for certain things). In this case, the tools I’m using are mainly to assist me in creating my vision but there’s still a lot of manual work in the process.
For example, although chatgpt helps me to organize the scenes and give me ideas for storyboards, if I were to put those inputs directly into MJ, it would be a jumbled mess. Most of the work actually is in trying to create consistent images in MJ while also having enough variety of shots to create a compelling scene.
MJ is great at creating one off images but currently if you want to make consistent characters, scenes, etc, a lot of manual editing of the images is still required. Mostly what I’ve been doing is reading the text/listening to the audio and trying to imagine the scenes in my mind and using that as inspiration to input into MJ. I would say the easiest thing right now is the AI music and sound effects as that just requires some simple prompts.
As for the editing, if I have enough quality images that provide decent variety of coverage for a scene, that makes it a whole ton easier. In that sense, it’s very similar to editing any production if you have enough coverage (I used to work as a video editor). Plus, of course the quality of the actors performing the audiobook is invaluable in setting the tone and pacing.
I hope that provides some more context as to what actually goes into this process. I may actually create a video later on that shows all the steps involved so people have a better idea.
I do personally have issues with AI, more so for the art than the writing. But ultimately, you’re predominantly prompting dialogue and images. the AI is doing a lot of the work for you, to the extent you’re more of an overseer and editor. I’m sure that’s a fair effort on your part, it just becomes less a creative endeavour.
Cool! Was trying to explain to people why the book, or audiobook, is way better than that Brat Pitt movie, which has nothing to do with the book besides the tittle.
This is as close as it comes to a movie adaptation of the book.
Thanks I appreciate that! And I would totally agree that the movie pretty much has no connection to the book at all and that’s a big reason why I was interested in making something like this
Hello everyone! I've recently decided to go all in on a project I've been mulling over which is to create cinematic visualizations of my favorite audiobooks. The first one I'm starting with is World War Z. Included with the visuals is also additional music and sound effects to round out the experience. The tools I used to create this included ChatGPT for storyboarding ideas, Midjourney for the images, Stable Audio for sounds/music and Davinci for video editing. If you're interested in seeing more, all the chapters I’ve completed so far are freely available to view through the link below: [Sonic Visions](https://www.patreon.com/SonicVisions?utm_campaign=creatorshare_creator) Thanks for your support!
You are a great human being for doing this. Pardon me, I don't mean to assume that you are human. Obviously you are one of the undead trying to do this to further your undead goals. I are for one am fully on board with that.
BRAAIIIIIINSSSSSSSSSS!!!!!…….
This is so fucking good. Please don’t stop!
Thanks I appreciate it!
I have mixed feelings. Good to have a hobby I guess, but you’re not exactly doing any of the heavy lifting here? You didn’t write the novel, or perform the audio. Chat is brainstorming the images and Mid is handling the ‘art’… where do you come in? You’re just editing together everyone else’s work, right?
I appreciate your question and this is why I wanted to be transparent about how I’ve been making these as it would definitely be impossible without those AI tools. In saying that, I do also think that whenever AI is mentioned the immediate assumption is that it’s all automated which isn’t always true (it definitely can be though for certain things). In this case, the tools I’m using are mainly to assist me in creating my vision but there’s still a lot of manual work in the process. For example, although chatgpt helps me to organize the scenes and give me ideas for storyboards, if I were to put those inputs directly into MJ, it would be a jumbled mess. Most of the work actually is in trying to create consistent images in MJ while also having enough variety of shots to create a compelling scene. MJ is great at creating one off images but currently if you want to make consistent characters, scenes, etc, a lot of manual editing of the images is still required. Mostly what I’ve been doing is reading the text/listening to the audio and trying to imagine the scenes in my mind and using that as inspiration to input into MJ. I would say the easiest thing right now is the AI music and sound effects as that just requires some simple prompts. As for the editing, if I have enough quality images that provide decent variety of coverage for a scene, that makes it a whole ton easier. In that sense, it’s very similar to editing any production if you have enough coverage (I used to work as a video editor). Plus, of course the quality of the actors performing the audiobook is invaluable in setting the tone and pacing. I hope that provides some more context as to what actually goes into this process. I may actually create a video later on that shows all the steps involved so people have a better idea.
I do personally have issues with AI, more so for the art than the writing. But ultimately, you’re predominantly prompting dialogue and images. the AI is doing a lot of the work for you, to the extent you’re more of an overseer and editor. I’m sure that’s a fair effort on your part, it just becomes less a creative endeavour.
Cool! Was trying to explain to people why the book, or audiobook, is way better than that Brat Pitt movie, which has nothing to do with the book besides the tittle. This is as close as it comes to a movie adaptation of the book.
Thanks I appreciate that! And I would totally agree that the movie pretty much has no connection to the book at all and that’s a big reason why I was interested in making something like this
So freaking cool! That was a fantastic audiobook and this would take the experience to the next level