Create Your First Project
Start adding your projects to your portfolio. Click on "Manage Projects" to get started
Linviva (An Innovative Language Learning Application)
VR/MR AI Application
AI Language Learning Application
Date
August 2023 - June 2024
AI Developer
The project uses an open-source implementation of Whisper called whisper.cpp , a binding that allows the Unity game engine to use whisper.cpp called whisper.unity
It is used in addition with the ggml-tiny.bin model weights.
The official benchmarks of the whisper.cpp was used as a reference and to perform the speech recognition task as real-time as possible.
LinViva is a 3D Virtual Reality/Mixed reality language learning application that aims to help people practice new languages.
Users will be able to speak with the virtual characters and correct their grammar and pronunciation mistakes. It is expected that these speaking practices will increase the language learning motivation of the learners.
The virtual characters in the application will be supported by a speech-to-text algorithm. The algorithm will later process the input and detect the grammar and pronunciation errors, generate a response for the user and use a text-to-speech algorithm to vocalize the response.
