About the Digital Life Project
The Digital Life Project was started in November 2016 as a non-profit initiative within the University of Massachusetts at Amherst for one simple goal: to create accurate, high-resolution 3D models of life on earth. Prior to its inception, the art and science of creating 3D animals was largely the domain of 3D animators. While this practice will remain a vital practice, the possibility of scanning real animals remained largely untapped.
A digital “ark” of living organisms would provide an invaluable resource for educators, scientists and conservationists interested in recreating and studying life in all of its manifestations. Imagine a website or VR experience that could provide millions of living animals at the fingertips of students. Or consider how scientists could use digital animals as a 3D museum of sorts, an exciting possibility in an era when traditional museums are financially challenged and are often unable to meet their basic mission of documenting life on earth.
This idea’s fruition can be traced to recent developments in 3D scanning the last few years that have made it viable to capture living animals through the process of photogrammetry, which until recently was impossible with living animals. One of the main pillars of this is the Beastcam™ technology developed at the University of Massachusetts at Amherst which represents a series of custom multiple-camera devices designed for capturing a variety of living animals, from small insects to large sharks and sea turtles.
3D sea turtle campaign
Photograph by Christine Shepard
One of the focal points of our efforts has been creating 3D models of sea turtles, which play a vital role in the world’s oceans and coral reefs through maintaining the productivity of coral reef ecosystems, as well as cycling nutrients around the ocean and shoreline.
We chose sea turtles as a key group to focus on for several reasons. First, all sea turtle species are highly threatened, and populations in key parts of their range have gone, or could go extinct within our lifetimes. In other words, the long-term future of sea turtles remains in doubt, and this fact gave our mission some urgency. A second reason is that high-quality specimens of different sea turtles are rarely available in natural history museums, especially for adult specimens that are challenging to preserve. Thus, our hope was that accurate 3D models of sea turtles would serve as a valuable tool for scientists and educators to study, learn, and teach about sea turtle morphology. For example, scientists can use our 3D models to study swimming of sea turtles in a virtual environment, thus potentially unlocking mysteries of sea turtle migration patterns. In this vein, all of our models are free to download for non-profit purposes.
The story of Scallywag and Shelly
Scallywag (ID=CM1648) is a green sea turtle (Chelonia mydas) who survived a shark attack off the coast of Southern Florida. Scallywag was most likely attacked by a Tiger Shark (Galeocerdo cuvier), which occur in coastal waters of Florida and are known to attack and consume sea turtles. The attack left Scallywag with a significant scar on the shell and a missing right front flipper. Scallywag was found floating and clinging to life in the surf at Blowing Rocks Preserve on December 23, 2016. Scallywag was captured, and then transported to the Loggerhead Marinelife Center (LMC). Despite suffering from these scars, Scallywag underwent successful rehabilitation and is able to effectively swim. In January 2019, Scallywag was released. Shelly (ID=982.000406129037) is a near-adult loggerhead sea turtle (Caretta caretta) rescued at the St. Lucie Power Plant by the Inwater Research Group on June 22, 2017. Unlike Scallywag, this turtle was in good health, and after some basic measurements and photos, the animal was released unharmed. Loggerhead sea turtles commonly forage on the bottom of coral reefs for crustaceans and other animals and often obtain barnacle passengers, which this female had in abundance.
"Scallywag" A green sea turtle photographed at the Loggerhead MarineLife Center - Reconstruction and animation created by Jer Bot. Click and drag the 3D model to rotate the view
Photogrammetry process
Photographer Christine Shepard used the Beastcam technology to photograph the sea turtles. She used several tripod-like devices with a total of 20 cameras that allowed her to simultaneously capture a set of images of the same turtle from different perspectives. As the turtles were being prepared for release or for other purposes, we were able to quickly capture such sets of images of the animals. This process was simple and quick and allowed the teams we worked with to do their work with the sea turtles without a hitch.
The Beastcam technology arranged around a green sea turtle. Photograph by Christine Shepard.
The next step in our process was pooling photos of each sea turtle into the photogrammetry software Capturing Reality. This software takes individual photographs and integrates them into a 3D mesh, it is then overlaid with a UV map, which results in a highly realistic 3D model, but also one that needed a great deal of work. Indeed, as the image below of the initial scan of Scallywag attests, the “Raw” scans had significant areas of occlusion (lack of resolution, where the software could not accurately reconstruct the scene). This would be a challenge for the 3D artists.
3D rendering
The 3D artists (Jer Bot and Johnson Martin) all had a daunting challenge in front of them. Each had to take the raw photogrammetry scans, which were large (>5 million faces), and had areas with occlusion, and convert them into low-poly (<20,000 faces) and “complete” 3D models. Working with Scallywag was a refreshing experience for Jer Bot. Unlike most animal models that are perfect prototypical animals, the shark’s attack had left Scallywag scarred and unsymmetrical. Jer used his background in character building to inform how to accurately reconstruct Scallywag, and he quickly found out that every step of the process represented new challenges that he had not experienced before.
Meshes of the Loggerhead sea turtle reconstruction
Animator Johnson Martin also found the experience both rewarding and challenging. Although Shelly did not have the same kinds of dramatic scars as Scallywag, the challenge of capturing all the variation such as barnacles and various other individual features, also required significant consideration. One of the most substantial challenges for each turtle was the joining of the dorsal and ventral halves. In this vein, Blender, which was the primary software tool for all three animators, proved highly useful. Blender's default skinning values gave the animators a great starting point, and enabled them to quickly adjust the posing of both halves until they aligned. Further, Blender’s built-in sculpting and Krita’s texture painting tools helped with the merging and cleanup of the high frequency geometry and 4k textures. For Jer Bot, the most rewarding part was reconstructing the swim cycle of Scallywag, which shows how the locomotion has altered with the loss of a flipper.
"Shelly" A loggerhead sea turtle photographed with the Inwater Research Group - Reconstruction and animation created by Johnson Martin. Click and drag the 3D model to rotate the view
Why these 3D models are valuable
The obvious question to ask is: Why did we invest so much time to create these 3D models of these three species of sea turtles? One possible answer is that we felt that these 3D models represent a valuable tool for scientists. For example, scientists can use these models to perform computational fluid dynamics to understand the process of swimming and migration in sea turtles. Or they can use these models to more exactly test how nets entangle sea turtles, and how to design them to enable them to escape. We view these models as playing a vital role in educating the public about the general shape and taxonomy of sea turtles. With these models, any educator with a computer or VR headset can easily show students how sea turtles swim, and how they differ from one another. Further, the 3D models can be immediately downloaded and used in VR applications, and our team is currently working on immersive and biologically informative immersive VR “animal encounters”.
Finally, the value of these 3D models in our minds is more subtle – as a group of biologists, photographers and artists who care deeply about the biodiversity of life on earth, we also feel a need to help document this incredible richness before it disappears. The honest truth is that just as others have scanned rare and endangered buildings because they are concerned that the building will degrade, we are also deeply concerned about the future of sea turtles. With the threats of climate change, human population growth and wildlife trafficking, their future remains in doubt. In this regard, we hope that our models, so lovingly created by our talented 3D artists play perhaps the most important role of all – we hope that they stop and make you think “What would a world without sea turtles look like?” We hope that in whatever small way possible that by viewing these models you agree with us that such a future is not one that you want to be part of.
How you can access the models
These 3D models are available free of charge for creative and educational non-profit work. For those groups interested in the low-resolution models, these can be downloaded at our Sketchfab site (https://sketchfab.com/DigitalLife3D/models). To access the high-resolution models, or to inquire about licensing opportunities, please contact Duncan Irschick at duncan@umass.edu.
How to support sea turtles and our work
Many partners participated in this work, and are working tirelessly to conserve and study sea turtles. If you are excited by our work, and want to either help sea turtle conservation directly, perhaps consider directly donating to the Loggerhead Marinelife Center (https://www.marinelife.org/), or to Jeanette Wyneken, who performs outstanding research and conservation work with sea turtles (http://biology.fau.edu/directory/wyneken/index.php).
Special thanks to
We would like to say ‘thank you’ to several partners without whom this work would not have been possible. A number of donors to the UMASS Minutefund and also private donors were instrumental in enabling this work. We thank the Loggerhead Marinelife Center for allowing us to photograph some of their sea turtles. We also thank the Inwater Research Group, which allowed us to photograph their sea turtles during processing. Annabelle Brooks assisted with the work and provided valuable guidance throughout. Photographer Christine Shepard was remarkable in taking many amazing photos that allowed the Digital Life team to create photogrammetry models. Mackay Eyster and Brooke Ackerman wrote much of this blog and also played a vital role in organizing the photos and creating the 3D models before sending to the 3D artists. Finally, animators Jer Bot, Johnson Martin, and David Maas were invaluable in devoting numerous hours creating the final models from the raw photogrammetry scans.
Lean about the Artists
Jer Bot https://vimeo.com/verbal007
Johnson Martin https://johnson-martin.artstation.com/projects/rmvJ2
About Loggerhead Marinelife Center
Loggerhead Marinelife Center is a nonprofit sea turtle hospital that promotes conservation of ocean ecosystems with a focus on threatened and endangered sea turtles. The Center features an on-site campus hospital, research laboratory, educational exhibits and aquariums, and also operates the Juno Beach Pier, which hosts world-class angling and sightseeing. Situated on one of the world’s most important sea turtle nesting beaches, Loggerhead Marinelife Center is open daily and hosts over 350,000 guests free-of-charge each year. In late 2017, the Center launched their Waves of Progress capital expansion campaign, designed to accelerate and amplify LMC’s conservation and education impact. When complete, the facility will offer one of the world’s most advanced and unique experiences for guests and scientific partners. For more information, visit marinelife.org or call (561) 627-8280.
About Inwater Research Group
The Inwater Research Group, a non-profit corporation with a mission to provide the scientific community and general public with information to promote conservation of coastal and marine species and their habitats.
