{"id":2671,"date":"2022-07-22T14:22:37","date_gmt":"2022-07-22T14:22:37","guid":{"rendered":"https:\/\/commons.princeton.edu\/epics\/?page_id=2671"},"modified":"2022-07-22T14:22:37","modified_gmt":"2022-07-22T14:22:37","slug":"3d-scanning-photogrammetry-and-the-metaverse","status":"publish","type":"page","link":"https:\/\/commons.princeton.edu\/epics\/3d-scanning-photogrammetry-and-the-metaverse\/","title":{"rendered":"3D Scanning, Photogrammetry, and the Metaverse"},"content":{"rendered":"

Research and Experimentation for a Museum in Virtual Reality<\/strong><\/span><\/p>\n

Students:<\/p>\n

Carl Zielinski ’24<\/p>\n

\"\"<\/p>\n

 <\/p>\n

Background:<\/strong><\/p>\n

One of the biggest buzzwords in the past year or so has been \u201cthe Metaverse\u201d: a theoretical vision for the future of the internet involving immersive, virtual worlds focused on social interaction. While Zuckerberg brought the concept mainstream rather recently, I\u2019ve been interested in the topic for a good bit now due to its overlap with virtual and augmented reality.<\/p>\n

\"\"<\/p>\n

I actually gave a small talk on the Metaverse before it was cool. I guess that makes me a hipster now?<\/p>\n

(Screenshot taken from the INTERFACE website)<\/p>\n

 <\/p>\n

One overlapping topic of great interest to me is the idea of making photorealistic worlds for
\nvirtual reality. Photorealistic worlds have many use cases, such as letting users visit places that they\u2019re physically unable to travel to, and helping to preserve and spread cultural heritage. I\u2019ve done a fair share of exploring in VR proto-Metaverses, and I\u2019ve stumbled on a few very convincing photorealistic worlds made using 3D scans of real-world locations. After experiencing this and the recent trend of VR art exhibits, I decided that I wanted to work toward creating a VR exhibit featuring 3D scanning. Since we had a few 3D scanners available, I\u2019ve aimed to make a museum of sorts showcasing the evolution of consumer-grade scanning technology – ending with the current LIDAR sensors in modern Apple devices.<\/p>\n

\"\" \"\"<\/p>\n

Left: A photo I took in VR in Tokoyoshi\u2019s \u201cTokogrammetry Gallery\u201d VRChat world
\nRight: A photo taken in VR of CAVE OKINAWA, another world by Tokoyoshi<\/p>\n

 <\/p>\n

The first – and the most problematic – scanner I experimented with was the NextEngine scanner towards the front of the room. While the hardware ended up being in a perfectly usable state, the software ended up being extremely problematic. The company that produced the scanner went out of business years ago, and accessing the tutorials and such was only possible by using Adobe Flash Player…which was killed off years ago. After a lot of troubleshooting and reading through Reddit threads to find a solution, I eventually got the machine and the tutorials working properly and ready to scan.<\/p>\n

\"\"<\/p>\n

 <\/p>\n

\"\"<\/p>\n

 <\/p>\n

 <\/p>\n

However, as this was older technology, the challenges were just beginning. I spent weeks working on alignment and experimenting with the different features of the software, such as cleaning up scans and simplifying them – but most of the results ended up looking like abstract art pieces no matter what I did. A few of my favorites are below:<\/p>\n

 <\/p>\n

\"\"<\/p>\n

\"\"<\/p>\n

Top Left: A scanned marker without any alignment done. It did not fuse well.<\/p>\n

Top Right: A marker with markings that I used to align the scans<\/p>\n

Bottom: The resulting marker – it wasn\u2019t perfect but it was better than the Stonehenge-looking one<\/p>\n

 <\/p>\n

 <\/p>\n

As I wasn\u2019t getting great results out of the NextEngine scanner, I also worked with an Xbox 360 Kinect and my iPad\u2019s LIDAR sensor. I spent some time troubleshooting the Kinect, as I couldn\u2019t get it to be recognized by any device I connected it to. I finally figured out that the power supply was faulty, and after ordering a new one, I got it to work on my PC with a piece of scanning software called Skanect and did some testing with that.<\/p>\n

 <\/p>\n

\"\"<\/p>\n

 <\/p>\n

Some of the better results I got were by using my iPad, however. I tried a few apps but ended up using one simply called \u201c3D Scanner App\u201d a significant amount. Here was one early scan I did of one of the rooms at WPRB-FM. Although it\u2019s not perfect, it definitely looks like the room!<\/p>\n

 <\/p>\n

\"\"<\/p>\n

 <\/p>\n

In addition to these pieces of hardware and software, I also got experience with Blender (for cleaning up 3D scans), MakerBot software, and printers (to see if I could print any of my scans – I ended up not having anything good enough to print, but I printed off some parts for my VR headset), Unity, and the VRChat SDK (I will likely be using VRChat as the host for the 3D scanning museum, so I wanted to familiarize myself with the game engine and the software development kit early on).<\/p>\n

This concludes this semester\u2019s research and early experimentation phase. I believe I\u2019ll try working on getting decent scans with the equipment I have over the summer, and next semester I\u2019ll start working on parts of the museum (and hopefully get some good scans out of the NextEngine scanner!)<\/p>\n","protected":false},"excerpt":{"rendered":"

Research and Experimentation for a Museum in Virtual Reality Students: Carl Zielinski ’24   Background: One of the biggest buzzwords in the past year or so has been \u201cthe Metaverse\u201d:… <\/i><\/a><\/p>\n","protected":false},"author":4319,"featured_media":2673,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"categories":[30],"tags":[],"class_list":["post-2671","page","type-page","status-publish","has-post-thumbnail","hentry","category-fall-2021"],"_links":{"self":[{"href":"https:\/\/commons.princeton.edu\/epics\/wp-json\/wp\/v2\/pages\/2671","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/commons.princeton.edu\/epics\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/commons.princeton.edu\/epics\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/commons.princeton.edu\/epics\/wp-json\/wp\/v2\/users\/4319"}],"replies":[{"embeddable":true,"href":"https:\/\/commons.princeton.edu\/epics\/wp-json\/wp\/v2\/comments?post=2671"}],"version-history":[{"count":1,"href":"https:\/\/commons.princeton.edu\/epics\/wp-json\/wp\/v2\/pages\/2671\/revisions"}],"predecessor-version":[{"id":2682,"href":"https:\/\/commons.princeton.edu\/epics\/wp-json\/wp\/v2\/pages\/2671\/revisions\/2682"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/commons.princeton.edu\/epics\/wp-json\/wp\/v2\/media\/2673"}],"wp:attachment":[{"href":"https:\/\/commons.princeton.edu\/epics\/wp-json\/wp\/v2\/media?parent=2671"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/commons.princeton.edu\/epics\/wp-json\/wp\/v2\/categories?post=2671"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/commons.princeton.edu\/epics\/wp-json\/wp\/v2\/tags?post=2671"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}