A controversial AI Music video I made recently [ CHECK HOW TO EARN $HIVE TIPS ]

The other day I had the honor of working on an AI music video for @luca777. It all started with him seeing an ai video I made for one of my songs. Bu his project was gonna take a lot more effort as he wanted to include some human elements ( scenes of him in his home studio) as well as story told through ai video.

The good thing was that he had the story in mind already and I added to that along the way. The song is about Geoengineering an chemtrials, quite the controversial topic. At first I was wondering if I wanted my name attached to something like that as many see it as a conspiracy theory. But after doing some thorough research I realized that it is real, the patents are there for anyone to see.

The story

The story follows a pilot who started getting paid to spray chemtrails in the air during his flights. He sees first hand how it affects the planet and also the health of people. It even affects his son's health ( something I added to the storyboard) and in the end, he quits his job as a pilot and starts protesting along with his family for "them" to stop spraying chemtrails.

The process

STEP 1

The first step was to flesh out the story and scenes and for that I used Chatgpt. I simply promoted it to create a storyboard with image to video prompts for each scene ( all based on what Luca1777 wanted in the story). I also made it create the look of the main character in order to keep him consistent.

Main Character Description (For Consistency Across All Scenes)
Name (optional): Captain Elias
Age: Late 40s
Appearance: Caucasian male, rugged features, slight beard stubble, tired blue eyes, short brown hair graying at temples
Outfit: Modern pilot uniform – white shirt with epaulets, dark navy slacks, black tie, captain's hat (optional in some scenes)
Mood progression: Stoic → Haunted → Guilt-ridden → Determined → Resigned

Note: while Chatgpt gave the ending for the story, it wasn't to our liking so I tweaked a few things in the storyboard.

Step 2

For each scene, a first image/frame was generated or referenced and then a video generated from that image ( using the storyboard prompts from Chatgpt):

There were times when I could just use the main character reference image to generate a video.
There where also times where I had to drag images into Canva and add or remove characters and elements.
Some scenes were straight prompt to video like the airplanes flying in the sky, natural disaster etc.

I did the process of image to video for each scene, not creating all the images at once but on a need and creative basis. But to be more organized, it may be better generating all the images you need first. My AI image / video tool of choice, Leonardo ai.

NB: I did not put the storyboard prompts as is but I changed a few lines that would make it easy for the model to understand and leave less room for error. Here is an example of one of the scene prompts from Chatgpt.

🎬 SCENE 2: BRIEFING FLASHBACK (0:30–1:00)

Prompt:

“In a dimly lit hangar, the same pilot (Captain Elias) stands among a group of shadowy government agents in suits. He is handed a sealed folder. His face shows concern. Jet aircraft are visible in the background being loaded with large unmarked metallic canisters. Close-ups on the containers being bolted into cargo bays.”

With this prompt I did a simple edit of deleting the characters name and using a reference image of the pilot. The model I used is called Motion 2.0. at that time Veo 3 was just getting started and was released a few days after I finished this project. The tokens used to generate using VEO 3 via leonardo are outrageous though.

Step 3

Now, if this were an AI only video, the process would have been much easier but as I mentioned Luca wanted scenes of him in his home studio rapping as well as the Ai story being told, matching his lyrics. So, after each scene was generated, I had to arrange it in an editor along with Luca1777's video, get it synced and see how well it looked before creating another scene. Once a clip was good in the editor then I would start the process again of generating the image > generate the video till I got it right> then bring it into the video editor and add it in. What a process. Here is the final result, I hope you like it. be sure to give Luca a like and sub, maybe even leave a comment saying "I came here from hive" If you do and leave evidence, a tip will be given in the comments.