u/BicycleSad5173

This is a video guide on how to train full volumetric scenes from the insta360 X5 Camera to a full GS Scene. In this case, I am using ERP to create 4 Synthetic FS Images.

-----------------------------------------------------
VIEW LEVEL HERE
-----------------------------------------------------
https://playcanv.as/b/e376e1ad

-----------------------------------------------------
TUTORIAL
-----------------------------------------------------

1. Export the video out of Insta360 Studio
2. Cut the video into frames using FFMPEG
3. Convert the frames into Fisheye Images using Batch Process Script Here
4. https://drive.google.com/file/d/1mz8jvsniE85lpqzcRjm53z1SCUJDBV30/view?usp=drive_link
5. Align in Metashape Using Fisheye as Camera Calibration. Very important that you align them in that RIG fashion. Front images align first, then back images then left and then right
6. Align the Chunks together
7. Merge the Chunks
8. Export Cameras and DO NOT CLICK TRANSFORM TO PINHOLE. Leave that blank or it will break export
9. COMAP Undistort: Undistort the dataset so you can train in and view it in regular GS players
10. Train in Brush

-----------------------------------------------------
SAMPLE DATASET
-----------------------------------------------------

FISHEYE: Fisheye dataset here
-------------------------------------------------------------------------
If you want to align it using raw fisheye: Here is the dataset

Left:
https://drive.google.com/file/d/1lmxidnfD84ZoKYEcgUiRKnzfryWAZ3CF/view?usp=sharing

Right
https://drive.google.com/file/d/1_W_lq9Cf-gQaIscusJi8n55XH-gxZPdb/view?usp=sharing

ERP: Equirectangular Dataset Here
-------------------------------------------------------------------------
This is already stitched. Ready to convert to synthetic FS for alignment https://drive.google.com/file/d/1Y_u9C3X0jXaon14rnn90IGC2hsUEQagh/view?usp=sharing

-----------------------------------------------------
IMPROVEMENTS
-----------------------------------------------------
This workflow is gamechanging. So many things to improve. Please comment here with all the improvements and how it helped you.

-----------------------------------------------------
VIEW TERMS AND CONDITIONS
-----------------------------------------------------

TERMS: https://drive.google.com/file/d/1tyEpK_4n53HK4VS9FlWm_2e09bmv6JWQ/view?usp=sharing

README:
https://drive.google.com/file/d/1bSbGcWX9ZswNA_tIEer96qhPcOLPtjch/view?usp=sharing

LICENSE:
https://drive.google.com/file/d/10hLGbOCWyPLoVxgcf-o_r-T21oM9jg_b/view?usp=sharing

-----------------------------------------------------
REQUIREMENTS
-----------------------------------------------------

-Strong PC to train splats
-Anaconda & Python Environment, Numpy, OpenCV
-FFMPEG
-Sharp Frames: https://github.com/cansik/sharp-frame-extractor
-MetaShape Pro
-COLMAP