At arfected, we never stop exploring new tech! Our latest experiment is Gaussian Splatting… on the web! Our colleague Dominique shares how he approached this experiment.
These weeks I have been spending my R&D time on exploring the possibilities with Gaussian Splatting (a volume rendering technique that deals with the direct rendering of volume data without converting the data into surface or line primitives —> source: Wikipedia). Starting with the essentials: finding a working .PLY file to run an experiment with. It was a bit of a hassle to get one and to find out how to get it working. Eventually, I used Adobe Substance 3D Viewer to generate one. If you do, then don’t forget to convert it to a float 32 type file! In order to create your own file, you will need a heavy system with a decent Nvidia RTX card and then add a lot of patience! A two minute video took like 48 hours to convert to a .PLY file… After this step, it is time to create the magic: a webpage with three.js and mkkellogg/GaussianSplats3D libraries. Just read the github page of mkkellogg very closely and you will easily set up your own webpage! Now you are ready to host your first experiment! Training your own model from video content is the next step. I share here just one showcase of how beautiful Gaussian Splatting can be integrated into projects.