B5 Bachelor Spellweaver- Words of Power

If you’ve ever used a VR Headset, you might’ve run into the tedious task of inputting text. This experience is quite similar to navigating a keyboard with the remote of your smart-TV. A viable alternative offered by more and more web services is speech-to-text input. And that was our calling.

We then asked ourselves which STT (speech-to-text) options are there, and how do we implement them into Unity? After all, what better way is there to introduce a feature than by gamifying it. And so we set the following goals:

The game should make it easy for the user to test the performance of each API while seeing exactly what went wrong. It should also make it relatively easy for other developer to implement new API’s from other providers.

Our main goal would be to add more animations and extended game mechanics to have a more immersive game experience. For example, it would be ideal to make it a tower defense game or to add more types of enemies and spells. A more detailed analytics board with more statistical values like response time would be cool.

Ideally, we’d like to add a second factor onto our analysis board that describes the general understanding of the transcription from a human POV. That however would require a lot of detailed planning, as it’s quite difficult to pinpoint intuition in order to create a viable method.