AI-Powered MIDI Generation: Advanced Mode

[@TrippSaaS]

Blown away by how much work you put into these videos. Thanks

[@AngusGiorgi]

Love the way you brought all the characters from music and science to life. Has to be one of the greatest vids I’ve seen on You Tube

[@vinylarchaeologist]

The DOMi and JD Beck one was actually pretty on point. Not as in “their finest moment” but certainly something they could have played during a 3-second uninspired stretch on a random evening.

[@llav3-d7j]

the only thing i would add is more hihat

[@brucesmith3740]

Dom and jd beck mist often in a formula. So you didnt need ai to recreate that. As far as zappa style is concerned. I could randomly picked chords and added a simple drum beat manually got as good of result.

[@knoopx]

quite impressed about how much chatgpt knows about them

[@gameslikezone2046]

Beautiful video editing effort and illustrative too. Amazing work!

[@audiocipher]

Nice - your GPT midi experiments are getting better with each video. Our app offers text-to-midi as a VST and we're actively building toward AI MIDI API integration. It's a long and expensive process so it's taken us a few years but we're getting there. Would love to collab with you some time!

[@nitin4108]

text-to-midi AND INTELLIGENT MUSIC PROCESSING WILL BE MY PhD Topic, Seems like its going to be fun

[@Average-AL]

Whats the name of that VST?

[@thisisreallychris]

The amount of effort that went into this video will have me hard for the next three days. Bruh, do you need a hug dude? I reeaaalllyyy want to give you one. Haha, jokes aside, amazing, AMAZING video. I've subbed and will be all over your content from now on. I'm in love with you. 🖤

[@JellyMonster1]

D'angelo sounded really impressive, as did Domi and JD Beck. Thank you man.

[@edouardratiarson5084]

The video production is outstanding. Content and is great too!

[@dmwalker24]

Truly one of the more productive uses of large quantities of electricity I've ever seen. It's honestly hard to see how we ever used to manage using controlled parametric inputs instead of prompts.

[@JohnNesbit1957]

That female voice is of Scarlett Johansson. She was the actress in the movie "Lucy" (2014). About a woman who became 1,000,000 times more advanced than a quantum computer. Good choice.

[@tonycowin]

She was more contextually the voice of the OS in Her.

[@JohnNesbit1957]

@@tonycowin Yes I had seen that a couple of times but I had almost forgotten about it when I saw this. It was good.

[@tonycowin]

@@JohnNesbit1957 Yeah really enjoyed it. Johansson has done some great sci-fi. Under the Skin and The Island are my two favourites.

[@CristianSinH]

"Wow, this AI-Powered MIDI Generation in Advanced Mode is mind-blowing! The level of creativity and musicality it brings is simply remarkable. It's incredible to witness how AI has evolved to compose music that rivals human composers. The melodies, harmonies, and rhythms produced are truly mesmerizing. This technology has the potential to revolutionize the music industry and open up endless possibilities for musicians and artists. Kudos to the developers for pushing the boundaries of AI and music. I can't wait to see what the future holds for AI in music composition!" Positive coment made with IA

[@Exrotr]

😂😂

[@ricomajestic]

Not even close! Has a long way to go before it rivals a mediocre human composer!

[@videray6812]

furball

[@alexpugliese6720]

Woah, that's impressive, expecially the chords in the neo-soul style (8:49). It's almost unbelievable that AI composed all of this!

[@luiscanela1321]

YOU are a master of creativity, god bless you my friend! I´m super engaged with your videos

[@Gelato__33]

The editing on this video is incredible. It reminds me of the "How to turn s sphere inside out" video that went viral on KZbin years ago

[@rowancant3071]

So, I wonder if there would be anything like the kind of prompt mashing that stable diffusion and other image generators have, where you can just throw it a whole heap of names and tell it to make a collab between a wide range of artists to get a mashup style in quite a specific way.

[@OctopusMovement]

Such a beautiful video + sound + storytelling + voice over. Unbelievable. How long did it take you to make it?

[@TheRealDahli]

Yes, I second that. Inquiring minds would like to know. 😎

[@wernervannuffel2608]

This video was made by ChatGPT

[@sketchbackSTUDIO]

With your help, I've been able to use a midi sequence file and use it as an output on a analog hardware instrument (microKORG). I mean, If I had been told 4 months ago, that an artificial intelligence would be able to generate a sequence capable of interacting in the material world trough an analog instrument. I wouldn't have believed it. THANK YOU SO MUCH.

[@n64remix]

love your vids! I can tell you used musiclm for the music at :25, it gave me an extremely similar sounding piece of music that I then used as inspiration for a piece of my own so its basically embedded into my ear. keep killing it bro

[@VincentNeemie]

Wow, I can't help but chuckle! Is this the kind of job prompt that engineers aspire to? Great job, my friend! I believe there might be even more ingenious ways to tackle this challenge. In fact, I'm so passionate about it that I'm considering maybe to create a video showcasing my research on this topic-for free! Stay tuned for that, and let's explore this fascinating topic together!

[@just-groove-it-records]

Amazing Work, Sir! Love you're super unimpressed delivery :)

[@chadwys8038]

can't believe u got ScarJo to do this for you, king. 🙌🏻

[@Heisenberg2097]

WOW³... not the AI output... the meticulous work you put into the video!!! How did you find and edit all these funny old clips? GREAT WORK.

[@disuko]

as a music producer, composer, and jazz pianist nearly all of melodies were like literally terrible. sure, they sound decent in some places but there's no structure and none of that human "feel" that actually makes music be a reasonable display of emotion. looks like a fun tool to mess with but in no way ready for production ready music

[@finlay1702]

Almost as if it’s beta

[@danielkillorin9742]

@@finlay1702it’ll never be able to come close to a talented human. Personally, when I listen to music I always think wow there’s a human behind this what a creative dream they’ve let me into but obviously if you use ai it won’t have any of that

[@disectormusic]

😂

[@RNDMTRNGR]

​@@danielkillorin9742 AI will never create Art. I've heard that before 😅

[@enginerdy]

Many actual musically talented humans have difficulty using music as an expressive medium, how well do you think something without feelings will be able to do it?

[@backupforthevideos3861]

I'd love to see you generate Chopin-style music, I think his music is very nice and it'd be interesting to see how AI does it 😊

[@anakakaenekulo2975]

The prompt: I need assistance in producing AI-generated text that I convert to music using MIDI files. Initially, I'll provide a description of the format I need for the textual representation of the music. Since music is a time-based art form, the notes follow each other in time, and sometimes there are no notes, that is, silences. The way I would like you to generate them is as follows: Each note is represented as a tuple of two elements: The pitch of the note (integer value). Because I will use this text representation and convert to MIDI the note should be a number from 21 (that is note A0 - 27,50 Hz) to 96 (that is C7 - 2093 hz) so use these numbers to represent the note. The duration of the note (float value) represented as: 0.125 for an eighth note 0.25 for a quarter note 0.5 for a half note 1 for a whole note 2 for a double whole note But could be any number between 0 and 2, bocouse you know, musician are creative so why not 0.29 or 1.22, etc. With this format i need you generate a text that i will covert in music in this format: melody_pitch_duration_data = [ (note, duration), (note, duration), (note, duration), etc, ] And when there is a silence the note should be 0 and the duration is how long is that silence. A melody is a linear sequence of notes that the listener hears as a single entity. It is the foreground to the backing elements and is a combination of pitch and rhythm. Sequences of notes that comprise melody are musically satisfying and are often the most memorable part of a song. There are many ways to describe a melody. Here are a few: ● Pitch: The pitch of a melody is the relative highness or lowness of the notes. Melodies can be high, low, or somewhere in between. ● Rhythm: The rhythm of a melody is the pattern of long and short notes. Melodies can have a slow, steady rhythm, a fast, syncopated rhythm, or something in between. ● Intervals: Intervals are the distance between notes. Melodies can use a variety of intervals, from small steps to large leaps. ● Contour: The contour of a melody is the overall shape of the melody. Melodies can be ascending, descending, or something in between. ● Tonal center: The tonal center of a melody is the note that the melody feels like it is centered around. Melodies can have a strong tonal center, a weak tonal center, or no tonal center at all. When describing a melody, it is important to consider all of these factors. The pitch, rhythm, intervals, contour, and tonal center all contribute to the overall sound of the melody. Here are some examples of how to describe melodies: ● The melody of "Happy Birthday" is simple and repetitive, with a clear tonal center. ● The melody of "Yesterday" by The Beatles is more complex, with a variety of intervals and a changing tonal center. ● The melody of "Bohemian Rhapsody" by Queen is highly dramatic, with a wide range of pitches and rhythms. Quality melodies typically limit their range to about an octave-and-a-half, feature repeating elements like melodic intervals and rhythmic patterns, and consist of stepwise motion with occasional energetic leaps. Good melodies also interact meaningfully with the bass line, employing a mix of parallel, similar, oblique, or contrary motions for a dynamic, counter melodic effect. Finally, a standout melody tends to have a climactic moment, often a high note with significant harmonization and strong rhythmic placement, which then descends to a restful cadence. No matter how it is described, a melody is one of the most important elements of music. It is what gives a song its identity and makes it memorable. Please note that AI-generated music may not sound pleasing as it is randomly generated so we will use music theory but not random math so don't randomize the generation process. take into account musical concepts like scales, modes, etc. Now that you have a full understanding of the text representation, we will create some awesome music! Are you ready to start generating music? If so, respond with ‘YES’ and nothing else.

[@amelophile]

These Videos are so well produced and Fantastic Content .... Skynet is just a step away lol 😁, Thank You 👌

[@kaminu_]

really good style of videos, i'm here before you get big, keep up the good work i'm really liking these and many other people will aswell

[@Sphinxhsu]

The AI generated D’Angelo just gave me a shiver(compliment)

[@stubbsmusic543]

I am much more interested in how you got Scarlett Johansson's voice to read the text and how you got a singer to do a whole bunch of complex harmonies in the middle of the video. Where is that coming from? What apps are you using?

[@Q_Basic]

OK my friend, please can you point me in the direction of how you created the voices used in this video, like the one in the intro. Thanks for all your hard work!

[@Blue-pd3dv]

You successfully make this video looks like uploaded 30 years ago, but I love it🤣

[@bowbassist]

This is exactly what i was looking for. Please keep it up. Any idea how to add harmonic parts including unique styles of other instruments?

[@michelpixel]

Love the combination of exploration and comedy in your videos!

[@saladdays180s9]

It feels like the internet is starting all over again. There are obvious dangers, but opportunities for those whom are clever. I believe inspired visionaries utilizing AI will quickly spawn a new set of moguls. Brave new world.

[@point-rat]

This is fantastic! Like an AI collage. I would love to know which AI you're using for the talking pictures and voices.

[@Abattoirville]

might not be ai..possibly something like 'crazy talk' they often give out free versions of early editions. GAOTD often feature such.

[@daftstuff6406]

oh mate. please keep going with these ideas . push the envelope further. i am a programmer and musician from way yonder and am embarking on the same adventure. ai is not going to replace musicianship but is becoming an amazing tool in assisting us build all future generations of music. Thank you for your inspiration

[@75Krusty]

A heartfelt tear fell down from from my eye.... So touching yet so cool and funky 😀 Keep up the good work and put those jamming AI's to their toes....

[@elanfrenkel8387]

Wait but how did he generate the voices so well.. like in the D Angelo example. Can anyone help me with that part? Clearly that has nothing to do with the midi chords.

[@kubita-thecall8795]

Watching for the first time from Eswatini 🇸🇿. Just subscribed. I loved the neo soul hords🏆

[@AI-gd9ri]

And then you feed those melodies to MusicGen. Wow, much productivity, very smartz.

[@csansolo]

I am impressed, good work mate.

[@CG64Mushro0m]

i had this exact thought a few weeks ago. glad to see someone can do it better than i!

[@LoveExcelsAll]

Nice work, but how are you generating those singing, and talking images like D'Angelo, and The Beatles?

[@Lucas_umOutro]

I see the effort to make this piece. Was fun, and nice job at all. Want to see what's next!

[@JakeDownsWuzHere]

love the "The Mother of All Demos" homage, and the HER AI voice, so great

[@katlegotladi2116]

Ooh you should try Chordjam. Impressively musical AI generated chords and phrases. All in midi with adjustable velocity and timing for each note, it also offers inversions and scales. What you’ve done here is super cool! Nice that you can try different interpretations of your own musical rules👌🏽 Also, this video is high art

[@tonyrapa-tonyrapa]

Can ChordJam conjure a chord progression and melody in the style of xxx?

[@katlegotladi2116]

@@tonyrapa-tonyrapa Yes absolutely

[@godned74]

Bard more than likely slowed down its melodies because it doesn't understand when it's looping a sequence If the next sequence doesn't have the exact same amount of ticks or if there was a duration of time where no note was played in the melody where Bard didn't count the empty space of ticks, will caused it to screw up its timing. Thus if you tell it to strictly stay with in the confines of 60 ticks per 32nd note or 1960 ticks per bar and make sure it counts any empty space as well. It should work. Or simply changing all of the 0.5 and 1.0 to 0.25 would have worked also.

[@jarivanlennep3979]

now i want to put that midi file into another AI that will make its own interpretation of what music instruments are being played and create a song out of it. kinf of like color photo to black and white photo and then use an ai to colorise the photo again

[@userrelkjwrweefdggfdgsagsadgw]

i love your editing style its so good

[@bratislavabr]

Awesome, I'd watch your experiments with AI weekly :)

[@42jerseydawn]

Art Blakey too cool. He always keeps the high hat going start to finish

[@wildbird78]

is it not easier to just use the piano roll and all the tools that DAWs already have? This seems like a ton of work.

[@Fhalei]

It's more about research and technological advancement than trying to find a way out of learning/doing music production

[@heckYEAHman.]

Yes of course LOL. But once you have found a prompt that gets back better musical results, that work is done - save it and you’ll never have to make it again. If someone’s already found that prompt for you, that’s a whole lot of work you’ve skipped already. And, in the future, if somebody makes an online interface that takes your text as input, prompts ChatGPT for you, and sends the created song back to you as a MIDI file, you can now run through this whole process in a fraction of the effort and time. It’s far from being a replacement for human creativity, and it should remain that way. But at this point it is a semi-competent musical idea generator, with some actual interesting melodies/progressions among the noise it spits out. With enough time and better models, the idea generation could become more consistent and the process more streamlined. And I mean, that sounds pretty neat. I know I really enjoyed messing with MuseNet when it was online, so the idea that a general-purpose LLM could someday serve the same role is pretty wild to me.

[@johnwayne9364]

damn you did tha damn thang on putting all this together.

[@hyperactivists9390]

nicely done video and intelligent experiments

[@alfredogarbanzo2276]

This video is a whole ass trip

[@timothyclemson]

Beautiful. Just beautiful.

[@craigpurdie3528]

You folks did one HELLUVALOTTAWOIK!!! Zappa's piece was pretty close to bein' sumpin'...the rest (sept4 Domi-Beck) was pretty un-inspiring. Let's hope AI doesn't get the creative love & passion that the future artists of the World put their minds to. You really saved us a LOT of time...For that, I AM TRULY grateful!!!

[@murataydogdu4581]

scarlett 🥰

[@Robnoble206]

damn bruv, well done ~ I'm scared and excited to see what's next, this shit is moving so fast

[@GoGetFletch]

Congratulations on producing a very educational video. To all you doubters out there - Wake Up! This stuff is only going to get better and at a rate we will find difficult to comprehend. Remember what was heard at the other end of the line when the first transatlantic radio broadcast was made. Who could have foreseen where we would end up today. This is not IT! This is not yet the future.

[@hiltonsheppard6223]

G'day Is it possible to take a modern midi file [such as a phonodisc file] with the 127 velocity levels and convert it into a midi file that can be played through the historic Ampico or Duo Art pianola systems [eg change the 127 velocity levels to the 7 intensity levels of the Ampico system together with sustain pedal coding]?

[@nahlene1973]

Your video quality is so high, respect

[@HipHopBeatSource]

Is Bard voiced by Scarlet Johanssen? The edits are amazing bro. Keep them coming.

[@707daryllick]

now you can sell your prompts for us to imput into our own chatgpt! great

[@Edbrad]

Million dollar idea, make a virtual instrument that uses GPt API calls to generate MIDI data that one can drag and drop and have it all work properly, Might have to program a plugin for it

[@chad0x]

That suspenseful "melody" like Hitchcocks was so shite. Hahahaha The Frank Zappa stuff - on point!

[@beckwalter-e4t]

How did you get Scarlet Johansson to do the voice work?.......oh, right.

[@kevinpannetiermusic]

Damn that quality ! You are totally remind me of "You suck at producing" in your way of narrating. Great job ;)

[@EZBOT_]

Is that Scarjo on the voice?

[@tcby2332]

Wow this was so entertaining and informative. Great work, Sir!

[@seanfeldman5544]

WOW - how did you create the intro???? (the vintage man)

[@oystercatcher943]

First time watching. An awesomely fun and interesting video. Loved the start. We shouldn’t underestimate that by discussing music with ‘AI’ we all learnt a lot about musical styles

[@mioszkarpowicz3012]

Your videos are mind blowing. Thanks!!!!

[@421.Soundlab]

Incredible, we need more people like you on this collapsing planet, thanks for this gem!

[@SelfQare-k6c]

how did you generate dangelo singing such a complex line over those chords?

[@SelfQare-k6c]

did you train the dance diffusion ai on Dangelo acapella?

[@freenando75]

thank you for the work in editing this video

[@oemusik]

Domi JD Beck was spot on

[@cerveraux]

nailed with Domi and JDbeck

[@PresleyS1012]

Im getting an error in Colab running the chord cells. It says missing import package: midiutil.MidiFile import MIDIFile

[@jocomend]

well it seems you can certainly make music with a computer but it still has to be good and inspired...

[@andymorrell6485]

superb work my man.

[@Koettnylle]

That straight ascending domi chord progression tho

[@geesus2963]

Damn I love how you use ai to create your content its awesome and creative!

[@kirtandreamrezzer]

Genius work!!! I figured this would be possible, now you've bridged the gap! Still, I can hear how ChatGPT is still a baby learning from what it has scanned or been given. Lots of potential for inspirational creative ideas to further one's craft. Although I can see how lazy people could just pass these results as finished, like some did with computer generated elevator music. Thank you. 👾🤖💖

[@lilth501]

I'm of the Mind music is a reflection of the human experience born from organic elements. Believing that AI will somehow capture the complexity that lies within the human brain that is expressed through word and music is merely a fantasy.

[@cconley2112]

AI is still in its beginning phases for music production. Yet, certainly has potential. Especially regarding electronic music. The human feel is missing yet people seem in some ways becoming more robotic. So the technology improvements continue and people become more technology focused and less humanity based. AI does have a chance of meeting this situation in the middle and taking off. However, we probably have a good 10 years before it does. Great use and music demonstrations regarding AI in this video.

[@jaredf6205]

The issue is there simply isn’t any current AI trained on MIDI. The company that makes chatGPT used a very old version of their AI, gpt2, about 4 or 5years ago, which by the way could barely construct a understandable sentence, and they trained that on midi songs, they called it musenet. It was able to make incredibly good music. If ChatGPT or the paid version ,GPT4, was trained on Midi like that, I doubt you could tell the difference between a real musician and the AI. it’s not a limit of technology, no one who has access to train any of these new models has bothered to train one on midi again yet. There is some new music generation a I but it focuses entirely on audio generation which I guess is more exciting to people, but I’m hoping one of these new models gets trained to create midi soon.

[@cldbrbn6070]

That is one well done video!

[@joefiorini]

I tried having GPT generate a number of clips in a Phrygian key. It did… okay after awhile but nothing inspiring. Eventually it gave up and told me I need to try a different algorithm.

[@RaincloudReviews]

i like to make my own music. but i am trying to see how i can make chat gbt usful to me and my work flow . if i know how to make hip hop beats i prolly wont need ai to help me unless it can help me master my music . or if i am working on a new genre of music that i have never done before it could be useful . but would it give me midi information ? or actual audio samples ?

[@xsploit]

What did you use for the avatars?

[@BilSchimchelevitz]

how could we code the golden number series into a melody ???

[@MoonerBand]

Impressive as always!

[@juancarlosvelasquez9172]

What software is used to replacate the voice of Scarlett ?

[@rjw8631]

great video. intro was superb, which grabbed my attention and motivated me to keep watching -- and i watched to the end. an enormous amount of work must have gone into this, especially if you created the AI-driven vids of the beatles, hitch and satie, et al. they were most appropriate and quite comical to boot. can't say the same about the music generated by AI, though. one question: did you leave "dissonance" in the chatGPT prompts for all music created here? it sounded ok in the first song, where you mentioned it beforehand. but the dissonance and other unsavoury harmonics seemed to do harm to all the other AI tunes (and i'm a big fan of dissonance and avant-garde music -- classical and jazz, where noises of dubious origin figure prominently). but if you didn't add the "dissonance" prompt, then chatGPT still has a long way to go on this front. i guess an algorithm is only as good as the human initiated training it gets. keep up the great work

[@oystercatcher943]

Personally I love a bit of dissonance in my music. Taste is everything in music of course. I also loved the start!

[@MarkoTManninen]

Quite a sick development. Think it just a few months old infant with insane literazy skills. Lets see a new Mozart being able to syncretize all know music styles and giving a full 8 hour opera with libretto and graphics in no time, 2026.

[@6lack5ushi]

WILD STUFF keep it up

[@anakakaenekulo2975]

Text to Chords (only for patreons): I need assistance in producing AI-generated text that I convert to music using MIDI files. Initially, I'll provide a description of the format I need for the textual representation of the music. Since music is a time-based art form, the notes follow each other in time, and sometimes there are no notes, that is, silences. Here I need you to generate Chords, so, more than one note each time, could be 2, 3, 4, etc. The way I would like you to generate them is as follows: Each chord is represented by these elements: The pitches of the notes (integer values). Because I will use this text representation and convert it to MIDI, the note should be a number from 21 (that is note A0-27.50 Hz) to 96 (that is C7-2093 Hz), so use these numbers to represent the note. The duration of the note (float value) represented as: 0.125 for an eighth note 0.25 for a quarter note 0.5 for a half note 1 for a whole note 2 for a double whole note But it could be any number between 0 and 2, because you know, musicians are creative, so why not 0.29 or 1.22, etc. With this format, I need you to generate a text that I will convert into music in this format: chords_pitch_duration_data = [ ((note, note, note), duration), ((note, note), duration), (note, duration), etc ] And when there is a silence, the note should be 0 and the duration is how long that silence lasts. The key is that harmony is the vertical aspect of music, or the combination of different pitches sounding at the same time. Chords are the building blocks of harmony, and they are made up of two or more notes that are played together. The simplest type of chord is a two-note chord, also known as a diatonic chord. Diatonic chords are made up of two notes that are next to each other on the musical scale. For example, a C major chord is made up of the notes C and E. Three-note chords are also known as triads. Triads are made up of a root note, a third, and a fifth. The root note is the lowest note in the chord, the third is the note that is two semitones above the root, and the fifth is the note that is seven semitones above the root. For example, a C major triad is made up of the notes C, E, and G. Four-note chords are also known as seventh chords. Seventh chords are made up of a root note, a third, a fifth, and a seventh. The seventh note can be either major or minor. For example, a C major seventh chord is made up of the notes C, E, G, and B. And you also have: Sus chords: Sus chords are made up of a root note, a third, and a fifth, but the third is replaced with a suspended fourth or second. For example, a Csus4 chord is made up of the notes C, F, and G. Add chords: Add chords are made up of a root note, a third, a fifth, and an additional note. For example, a Cadd9 chord is made up of the notes C, E, G, and D. Augmented chords: Augmented chords are made up of a root note, a major third, and a perfect fifth. For example, a C augmented chord is made up of the notes C, E#, and G#. Diminished chords: Diminished chords are made up of a root note, a minor third, and a diminished fifth. For example, a C diminished chord is made up of the notes C, Eb, and Gb. Harmony is an important part of music, and it can be used to create a variety of different moods and emotions. For example, major chords are often used to create a sense of happiness or joy, while minor chords are often used to create a sense of sadness or melancholy. Please note that AI-generated music may not sound pleasing as it is randomly generated. So, we will use music theory, not random math. Take into account musical concepts like scales, modes, etc. Now that you have a full understanding of the text representation, we will create some awesome music! Are you ready to start generating music? If so, respond with 'YES' and nothing else.

[@nurogl-studio]

Uhm.... This is great but can this prompt you've given the AI a bit vague in terms of Electronic music producers? I want to do trance music - I create it myself and I dont have issues with making my own melodies but Id like to see it do one that represents trance ... it currently just goes up & down notes like a 2 year old on a harmonica 🤣🤣

[@fernandomasotto]

Just awesome. I really enjoyed it

[@Philosophies_life]

May I know how to put the human AI voice to the song?