description: <p>This is a LoRA for FLUX.1 Dev which aims to improve the quality of equirectangular 360 degree panoramas, which can be viewed as immersive environments in VR or used as skyboxes.</p><p></p><h3 id="information-v8eirwqhp">Information</h3><p>The trigger phrase is "equirectangular 360 degree panorama". I would avoid saying "spherical projection" since that tends to result in non-equirectangular spherical images. Image resolution should always be a 2:1 aspect ratio. 1024 x 512 or 1408 x 704 work quite well and were used in the training data. 2048 x 1024 also works. I suggest using a weight of 0.5 - 1.5. If you are having issues with the image generating too flat instead of having the necessary spherical distortion, try increasing the weight above 1, though this could negatively impact small details of the image. For Flux guidance, I recommend a value of about 2.5 for realistic scenes.<br /><br />This is a tool which can be used to view spherical images in a browser: <a target="_blank" rel="ugc" href="https://renderstuff.com/tools/360-panorama-web-viewer/">https://renderstuff.com/tools/360-panorama-web-viewer/</a><br />To have the image be viewable with an interactive mode like this on websites that support it, you can add the equirectangular projection metadata using exiftool (on Windows) by using a command like this:<br />path\to\exiftool.exe -XMP:ProjectionType="equirectangular" image.png</p><p><br />If you have a VR system, you can view equirectangular images as immersive environments in many different VR media players like SteamVR Media Player, Deo VR, etc.</p><p>You can also use a Stereo Image Node with a depth map to create a stereo panorama image (with a 4:1 aspect ratio) which can be viewed in VR to have the objects actually appear with the distance determined by the depthmap. I've gotten good results using a standard MiDaS depthmap and the polylines_sharp setting for the fill technique on the Stereo Image Node. Other depthmap methods might provide better results; I'm not sure whether there is a depth model designed for equirectangular panoramas.</p><p></p><p>Compatibility with other LoRAs seems pretty good, though I haven't tested very many. It works quite well with the dev-to-schnell LoRA if you want faster generation times (about 8-10 steps instead of 20-30), at the cost of making the textures a bit less realistic and a bit more cartoony.</p><p><br />This model has rank 32 and was trained for 24 epochs on 128 training images (3072 steps). This was the point at which it seemed to converge on understanding the equirectangular format, and further training did not seem to help. For captions, I used detailed captions generated by JoyCaption with a bit of manual editing along with some basic information about the structure of the equirectangular projection. Trained using AI Toolkit. <br /></p><h3 id="limitations-xiebazgat">Limitations</h3><p>This model doesn't fully fix the seam issue. Since Flux is a transformer model, we can't just use asymmetric tiled sampling with clever padding tricks like we could with convolutional models. On the other hand, since Flux is a transformer model, it's able to naturally have long-range attention that causes it correlate the opposite sides of the image, and this attention can be trained.</p><p></p><p>However, this model does greatly improve the seams in most cases, enough that inpainting the seam after applying a circular shift to the image is usually enough to fix it, in the cases where the objects on either side of the seam aren't completely incompatible. I will provide an example workflow for fixing this seam issue.</p><p></p><p>Since the majority of the training data consisted of panoramas of landscapes, the model is very good at these (and base Flux isn't as bad at them either). However, indoor scenes had very little representation in the training data. As a result, proportions are often far off for indoor scenes, making objects appear far larger than they should, rooms might not have the correct number of walls, faces may be distorted, etc. I'd like to retrain with a better balance of scenes at some point.</p><p></p><h3 id="attribution-tv0q5yrcu">Attribution</h3><p>This LoRA was trained on equirectangular images freely available online, primarily from the Flickr group for equirectangular panoramas, since it has high quality photos without watermarks. I used the following users' images: j.nagel, Kevin Jennings, Uwe Dörnbrack, Cristian Marchi, Patricia Müller, Tiger Lin Panowork, and Faillace. I'd like to thank them for their excellent photography that makes this work possible. It's highly unlikely that any images substantially similar to the ones used in the training set will show up in outputs of this model, though, and really they were just examples demonstrating how the spherical lens distortion affects images.<br /><br />Since this model was built on FLUX.1 Dev, images generated with this model still must follow FLUX.1 Dev Non-Commercial License.</p>
modelVersions.availability: Public
modelVersions.baseModel: Flux.1 D
modelVersions.description: <p>Rank 32, should preserve fine details better</p>
modelVersions.downloadUrl: https://civitai.com/api/download/models/823024
modelVersions.downloaded: true
modelVersions.downloadUrl: https://civitai.com/api/download/models/823024
modelVersions.AutoV1: 0A617AFE
modelVersions.AutoV2: 791B5D871D
modelVersions.AutoV3: 1792B314F620
modelVersions.BLAKE3: 4AE01E77A8EA3E2CD406BE3F28BC388159232E8555DC6F5F3726E7F1A95E5DFF
modelVersions.CRC32: 10D276B9
modelVersions.SHA256: 791B5D871DF076AFE8CB17861BB276672ACF31C6FA79169E38547442785776C4
modelVersions.format: SafeTensor
modelVersions.name: equirectangular_flux_lora_v3_000003072.safetensors
modelVersions.pickleScanMessage: No Pickle imports
modelVersions.pickleScanResult: Success
modelVersions.scannedAt: 2024-09-09T10:25:56.650Z
modelVersions.type: Model
modelVersions.virusScanResult: Success
modelVersions.hash: UbCQiiafM|j]TOj]M|WBD%ofs:oeMvWBxsfQ
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/ee52c053-ecbf-4ef8-b90a-c00097f1810c/width=450/28533559.jpeg
modelVersions.hash: U27c]zOl4Q%2~EkAXnt700nnzBNG00R-McRP
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b936cafd-2d07-4d57-9242-43379c1d35bc/width=450/28533561.jpeg
modelVersions.hash: UG8;Z5M|xbWCyGRlj]oftVt7WAt7byt7Rijs
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/0e934d77-7141-46d1-8256-fe037939d0c7/width=450/28533567.jpeg
modelVersions.hash: U27_Z|J;D4=Z3tv}14pe8wR3u6o$$;tn~XHq
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/97df731b-5ac5-4eb8-8a3f-5796b7e68244/width=450/28533550.jpeg
modelVersions.hash: UAFy[Co19v$$2sS39^oK0OoKxsEh0ioL}qe:
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/3a954047-a385-47d0-9c80-823911d40789/width=450/28533549.jpeg
modelVersions.hash: U6JF{E-Y010%pxN@0esE0NWB?btS0L,@~Dbw
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/63a065a2-b7d8-4fea-a941-29872f5dc36d/width=450/28533547.jpeg
modelVersions.hash: UEFY*}%M9EI:2NX9DgaJtojK$wf#-;o#D%My
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/93fb848e-aee1-4caa-acbe-e9158bc56cd3/width=450/28533552.jpeg
modelVersions.hash: UbH_Ponh%NR+GdIpkqs:%$NHkCa}k?oJe-fR
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/f3a342fe-7f9e-434f-9b9c-9db748146774/width=450/28533551.jpeg
modelVersions.hash: U4ATlj-mD6x[y;R.EdWF4;bItloI,Dxa,wbE
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/cae48f17-2e0a-4aa3-8a87-89fba1790bcf/width=450/28533548.jpeg
modelVersions.hash: U3EnqmBV8_^h#7=^b^Or00,;?bD*DQ0gEM-U
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/c6826b1f-9aa9-44eb-b44b-f9df91dc581a/width=450/28533546.jpeg
modelVersions.hash: U49%obnV5MkrUbozXiaK0JRh;Bs;3^f#-@RO
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/6ee2d774-4a08-483e-a67e-97bf634b703b/width=450/28533556.jpeg
modelVersions.hash: U35=OyW=xDS%yZe.niT000awRmo~DNbvXUwv
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/5cc96a2e-3f6a-4e06-bd16-dd9dca13ed0e/width=450/28533557.jpeg
modelVersions.hash: UCJH?,-4=o%M03of?GozKUNg-pWC4@Ip0LRP
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/230ed556-c127-400f-a305-fdd386fa26ec/width=450/28533554.jpeg
modelVersions.hash: U00,VJo|jGpJpfa#bIkYHYWYbcV[t1ozj[kC
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/4dd9262a-d76e-4656-99e7-13dd502417bd/width=450/28533563.jpeg
modelVersions.hash: UUIz^,jYt7xuGdWBt7tR9vozt7oJv{xtt6Rj
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/f1184950-2d1d-4aa3-8fa0-6ccc14bb7314/width=450/28533562.jpeg
modelVersions.hash: UjC@dda~r.t6TORkaIt6S,WCkXkAXBj[tSWC
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/d26afa84-495b-43c9-bc8f-803e2c476e38/width=450/28533564.jpeg
modelVersions.hash: UBB32o-TxfIS^n%3xdWF00XVj.t80cD~R~oc
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/da87db9b-1332-4aab-9c67-d2c20dbd078e/width=450/28533565.jpeg
modelVersions.hash: UF8N^PjZs.S6%%oeogWrOvoekDogNNoIbIof
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/086576f1-f1ab-4f03-9824-f7a10c2281df/width=450/28533568.jpeg
modelVersions.hash: UHBDE0jX_4xuS%oJ%Mof4TkEDhR*DhWYDiRi
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/df392a1d-b7ee-4e32-a817-39b93fbe2d8f/width=450/28533569.jpeg
modelVersions.hash: UEDl=zozxZx]*0xvtRtSo~x^o~tS%MtSxuxu
modelVersions.type: image
modelVersions.url: https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/a6888596-fec6-4fa3-a69e-8090a4eeb9aa/width=450/28533570.jpeg
modelVersions.name: v3
modelVersions.publishedAt: 2024-09-09T10:59:55.655Z
modelVersions.trainedWords: equirectangular 360 degree panorama
name: Flux Equirectangular 360° Panorama
tags: concept panorama landscape 360 pano 360° equirectangular flux1.d