360 Virtual Reality Views in Midjourney

Link to Discounted Midjourney Prompt Digital PDF Booklets (For a limited time only):
www.coorlasarch.com/products
Tried something new here. I'm testing Midjourney's capability of generating 360 photo sphere images for design in Virtual Reality. Right now, landscape images work best.
My original idea was to reverse engineer a VR design by uploading an existing equirectangular panoramic design and prompting new variations referencing the image; but the results were not favorable.
Soon, I imagine, Midjourney will be able to decipher between these unique image types and assist in design iterations more specific to the reference image's perspective and geometry.
Here's a link to the 360 view:
momento360.com/e/u/6c58864ab2...
The 360 View hosting website (Momento360)
www.momento360.com/
*Note per comment provided by ‪@jobigoud‬ that the true aspect ratio for equirectangular images is 2:1. In this video 16:9 is used specifically for use in alternate media types.
Prompt:
an equirectangular panorama photo of a prairie grass field during an epic sunrise during autumn with colorful trees and fog --ar 16:9
0:00 - Introduction (Equirectangular Panoramic View)
0:30 - Prompt (See Video Description)
0:50 - Equirectangular Image Type
1:38 - VR 360 Photo Host (Momento360)
2:00 - Midjourney Reference Images
3:00 - 360 Image Issue
3:45 - Reverse Engineering VR Designs
#artificialintelligence #midjourney #virtualreality

[@KrisKashtanova]

Thanks for making a tutorial on this!

[@StephenCoorlas]

My pleasure 🤘🏼

[@giri.goyo_yt]

Sweet. Thanks.

[@StephenCoorlas]

For sure.

[@RZFBRS-W-]

é incrivel pensar que a tecnologia está evoluindo tão rápido, gostei muito do seu conteúdo, sou arquiteto e fico imaginado as milhares de possibilitas que nos teremos no futuro, é louco pensar, continue com os seus vídeos por favor.

[@StephenCoorlas]

Gracias por las amables palabras. Es increíble ser testigo de la evolución tan rápida de la tecnología, y tratamos de mantenernos en sintonía con ella en relación con la arquitectura. Seguiremos haciendo videos amigo. ¡Gracias!

[@bigCAS650]

I wish midjourney could render a 360 image that’s Facebook ready. I could plug in some 360 drone photos and it would be next level stuff! Hopefully they implement that technology soon

[@StephenCoorlas]

You can try! Some people were also adding -- tile at the end of their prompt which would help to make the image seamless. Experiment!

[@comeforaride]

You can plug it into a different tool and it will create Facebook ready images.

[@eldowden]

There has been an update to allow other aspect ratios like16:9 however i the seams dont match up if you are interested the prompt is panorama::1 --ar 16:9.

[@StephenCoorlas]

I think there's still some photoshopping that needs to be done on the 16:9 or 2:1 but some people have tried making seamless images with --tile with success

[@hardrocking34]

I haven’t tried it but it seems to me that correcting the pinching / seams in Photoshop would be fairly easy: Use the Offset filter horizontally, let’s say by 300 pixels, this will make the seam visible. Touch up the area with Stamp / Content Aware / Firefly. Then re-apply Offset by -300 pixel and you are good. If you are unsure how to do it, you can probably find some old Photoshop tutorials about how to create a seamless tiling texture that will detail these steps

[@StephenCoorlas]

For sure there are many ways to achieve that fix. Check out skybox.blockadelabs.com/ That platform creates AI generated panoramic that can be downloaded as equirectangular images

[@jobigoud]

I noticed in your prompts you used --ar 16:9 but an equirect image should be 2:1. Any reason for the 16:9 aspect ratio?

[@StephenCoorlas]

The only reason was to utilize the image for other media formats, otherwise it was an oversight on my part that equirectangular images should be 2:1 Thanks for bringing it to my attention. I will add a note in the video description and reference you.

[@PenttiSairanen]

Thanks for your interesting tutorial. How you managed to produce an image with other aspect ratio than 3:2 in MidJourney? I'm getting this note: Invalid parameter Custom aspect ratios other than 3:2 or 2:3 are not supported for --version 4. I tried ar 2:1 for equirectangulars.

[@StephenCoorlas]

Version 4 (--v 4) has restrictions on the aspect ratios as of now. They may expand capabilities for V4 in the future, but for now the images featured in this video were from V3 🤘

[@PenttiSairanen]

@@StephenCoorlas OK. Now I understand, ty!

[@comeforaride]

Did you ever get the substitution to work?

[@StephenCoorlas]

I haven't been able to make perfectly tiled 360 images yet, but I also heard the V5 updates are supposed to be pretty impressive

[@comeforaride]

@@StephenCoorlas i have figured out how to do seamless 3D in Leonardo. It only pinches in the ceiling and floor it you look directly up or down. My next step is to make them wider shot and more detailed and also use specific objects or furniture. I can generate them for the solid shapes and slight panning thing of 3d space you did on the other video. But have not figured how to sub out for the 360. Maybe something flat that can be made 3d or maybe seeding.

[@comeforaride]

I'm also trying to prompt a perfect 360 in Playground AI or Dalle.

[@comeforaride]

And Leonardo let's you do 2:1 ratios, don't upscale them in Leonardo because they lose their 360 effect, use a different platform

[@artemedutech]

@@comeforaride good to know. хорошо

[@sceltadelcamper]

You should use ar 2:1

[@StephenCoorlas]

Yes, someone pointed that out to me that equirectangular images are always produced in 2:1 Thanks for the heads up also

[@FilmFactry]

Dreambooth?

[@StephenCoorlas]

Dreambooth would be a good program to run the panoramic through. Especially with their property modifications capabilities, which maintain the image but substitute certain materials. It looks like it works well with simple requests, "Blue Car vs Red Car" but I wonder how well it would do with distorted images such as these equirectangular panoramic view and substituting design finishes. Thanks for the question. 🤘

[@FilmFactry]

@@StephenCoorlas Since MJ had tiling. Someone asked on OFFICE HOURS if they could specify tiling in one direction like Horizontal. That could get you SEAMLESS at least. I would be fun to explore a weird Cyberpunk VR.

[@StephenCoorlas]

@@FilmFactry That's awesome to hear it was brought up at office hours. I had that same thought as I was exploring this topic. Would love to see everyone's explorations with this 360 genre. Also thought, what a great approach for storyboarding, with VR 360 Views.

[@FilmFactry]

@@StephenCoorlas I believe it was a game developer who wanted the background to scroll Vertically or Horizontally only, and just repeat.