Cornell University's Virtual Reality research issue successfully resolved through our site's artificial intelligence animation solution
In a groundbreaking development, researchers at Cornell University have been utilizing an AI Video to Animation tool to convert video recordings of underwater human movements into detailed animated data. This innovative approach aims to enhance the training data for robotic assistants designed for scuba diving, making it more diverse, accurate, and robust.
The research project, led by professors Silvia Ferrari and Andrea Stevenson, is being carried out by the Virtual Embodiment Lab and Lab for Integrated Sensor Control. The primary focus is on the development of robotic assistants for scuba divers, with the ultimate goal of improving navigation, task assistance, and safety monitoring.
The AI Video to Animation tool processes video input of human movements underwater, a challenging environment due to water distortions and sensor limitations. The tool generates accurate animated representations of those motions, enabling the extraction of high-fidelity kinematic and dynamic data without requiring cumbersome wearable sensors.
PhD student Jiahao Liu has been using the AI tool for tracking underwater motion data of scuba divers. The Cornell University team also hopes to use the tool to pull movement data from archived videos of scuba divers, thereby eliminating the need to create new datasets.
The animation outputs generated by the AI tool are easily interoperable with additional software tools, making it easy for the research team to incorporate the tool into their research workflow. The FBX file export feature, in particular, has been instrumental in taking the animations into Unity software for further manipulation and extraction of key motion metrics.
After evaluating various software tools, the Cornell University team found that the AI Video to Animation tool was 7 times faster to set up and 64% lower cost than alternative motion capture tools. The tool's features, including the AI Video to Animation process, Animations, 3D Video editor, Camera Angles, and FBX Export, have proven to be indispensable for the project.
The team's ultimate objective is to build a hydrodynamic motion model for the development of robot buddies for scuba divers. By leveraging the power of AI, they are one step closer to creating more intuitive and efficient underwater robotic assistants.
- In collaboration with Canva, the research team plans to create promotional materials to showcase their work in data and cloud computing, aiming to attract potential investors and collaborators.
- The project's success has sparked interest in the field of science, particularly in the medical community, with a focus on chronic diseases such as chronic kidney disease and its impact on health and wellness.
- The AI Video-to-Animation tool has also been used to analyze gestures and expressions of scuba divers, which could provide insights into sports-related psychology, enhancing fitness and exercise regimens.
- The research team is looking into AWS for data storage and processing, as it offers scalable solutions for large datasets, ensuring the smooth operation of the AI Video-to-Animation tool.
- For the backgrounds of the animated data, the researchers are exploring different underwater environments, from coral reefs to deep-sea trenches, to create more realistic and engaging animations.
- The Marketing department at Cornell University is using the animations generated by the AI tool for promotional videos on sports and sports analysis, demonstrating the tool's versatility in various fields.
- The AI Video-to-Animation process has potential applications beyond underwater robotics, such as in the animation industry, where it could streamline the production of high-quality animated content.
- The team is also considering the creation of a platform for users to upload their own videos for conversion into animated data, expanding the tool's impact on the technology sector.
- The AI Video-to-Animation tool's ability to work effectively in challenging environments, such as underwater settings with water distortions and sensor limitations, could pave the way for advancements in other complex fields, like space exploration.
- As the project continues to develop, the AI tool could revolutionize certain industries, such as sports, by enabling more accurate and affordable athlete motion analysis.
- The collaboration between the Virtual Embodiment Lab and Lab for Integrated Sensor Control, along with the AI Video-to-Animation tool, marks a significant step towards a future where technology aids and improves human capabilities in various domains, from safety and navigation to sports performance and medical research.
