WebAR.rocks

🌠 Use your real face captured from your camera video stream in real-time in a #ReadyPlayerMe full-body avatar in our latest demo! Check it out here: https://lnkd.in/e-CTXXAb 📱💻 It works on both mobile and desktop. You don't need to install anything. You can use your mouse or your touchscreen to rotate the 3D model and see how your face is rendered in 3D. 😎 Facial expressions are transmitted without any loss of information using this technology, unlike technologies replacing the face with a 3D model reproducing the facial expressions of the user. 💾 The code is released on Github here: https://lnkd.in/gBz2nc5R The default software license is GPLv3, and we also provide commercial software licenses. 🛠️ Technically, the demo uses:  * WebAR.rocks.faceDepth to detect and track the face from your camera video stream using a first neural network model. Then a second neural network model infers the face depth map  * Three.js for 3D rendering  * ReadyPlayerMe for the avatar GLB 3D model  * Mixamo for the dance animation 🚀 WebAR.rocks.faceDepth has been improved since its initial release 4 months ago, and new improvements are coming in the next months. Stay tuned by following WebAR.Rocks Linkedin page: https://lnkd.in/gATjJdHu #ThreeJS #3D #WebAR #metaverse #Camera #JavaScript #3D #Mixamo #ReadyPlayerMe #Avatar

💥 New tiny lib for Three.js: T-Vertices Killer  📐 "T-Vertices" are points coinciding with an edge, but not belonging to that edge. It is a major #tessellation issue on 3D meshes: - They make the contour of the geometry hard to compute, - They can create normals computation issues (so lighting issues), - They make the geometry non-manifold, - Dynamic displacement of vertices, through methods like skinning and height mapping, can create artifacts, such as holes, - Remeshing algorithm (Delaunay tessellation, decimation) will likely fail. 🔍 T-Vertices can come from: - Output of the "three-bvh-csg" CSG library can have T-vertices, - Meshes generated with some CAD software, - Your code if you split a face without caring for the surrounding linked faces. 🔧 We found no #ThreeJS library to clean meshes with T-Vertices, so we created one. Three T-Vertices Killer is open source and released on Github under MIT software license: https://lnkd.in/eG8aQ3Ms There is also a NPM package. #ThreeJS #JavaScript #Tessellation #TVertices #3D #Remeshing

🏅 We're happy to announce that WebAR.rocks has been accepted into the NVIDIA Inception Program. It's great to see our work in the AR field recognized by such a respected entity in the tech world. 💡 This collaboration with NVIDIA Inception is a wonderful opportunity for us to enhance our expertise in deep learning. While this isn't a significant step change for our company, it's an acknowledgment of our efforts and potential in the AR space. 🚀 Excitingly, this means new neural network models are on the horizon! This advancement will aid us in our mission to make the web more immersive, pushing the limits of WebAR technology. Stay tuned for more updates as we continue to innovate and expand the possibilities of WebAR. #NVIDIAInception #AI #DeepLearning #WebAR