Diversity app

Diversity in an application that use artificial intelligence to understand human expressions to generate shapes. Unity was used as the main VR platform and HTC vive to interact and visualize. Everyone understand Virtual Reality will enhance some human activities and this is also applicable to the field of Artificial Intelligence. Latest efforts consist in combine these technologies, among others, to extend our human capabilities.

The interaction in VR is complex because implies the whole body and capture completely our sight and hearing sense, which affect our balance and orientation. Playing VR games, I have had vertigo experiences, nausea or the feeling that I have to vomit. The VR experiences have been fixed in my memory, like the ones in lived in the real* world. VR is fun and interesting and a powerful tool to learn and discover: Do scuba diving, Dance, Jump, Bend the knees to draw a 3D Volcano or a feint to a killer zombie. etc.

According to the World Health Organization about 15% of the world's population lives with some form of disability, of whom 2-4% experience significant difficulties in functioning. How VR and AI working in combination, could help persons with reduced mobility to experience virtual worlds as creative platforms?. The idea behind Diversity is to bring sculpting and art creation to people with reduced mobility.


The App captures the voice of the user and sends the audio to Microsoft cognitive services, which converts the audio to text. Then the text is processed and analyzed through an early Natural Language Processing that instructs Unity what shape generates and modify.

Diversity app was developed in 24 hours during the VR-AI hackathon in central realities in March 2017 by: Jevgenij Gamper, Amal Ketata, Thongchai Wirojsakseree, Taka and Carlos de la Barrera. The following video explain the process and show some examples of the outcome produced that days. If you are interested in this project or know more about it, please contact us for further information.

The project is open source: https://github.com/cidelab/VRGenerativeArt.
*real: what is real? VR technology remind me this book: The Teachings of Don Juan, Carlos Castaneda.


Add a comment