I'm a noob trying to build a game with LLM bots.

Who I am?
My name is Steven Song and I’m a WFH developer that is looking to build a language learning game with LLM bots.

Why am I building something?
I’m interested in language learning technology like Duolingo. I had a revelation while under the influence of some substances that Immersion is the key to learning a new language. An aspect of language learning, I felt was missing from Duolingo was Immersion. I feel like a game that forces people to speak in a foreign language to accomplish a goal will be a better way to learn a language. Through this journey hopefully I can test this hypothesis. Also, I’m going on a trip to Japan in 5 months and I like to procrastinate as much as possible in learning anything new. My way of procrastination is by overcomplicating and overengineering a solution for my needs which is to learn basic Japanese. :P

The game I want to build.

• react + nodejs because I’m already familiar with the stack. I’m not experienced in the realm of unity/unreal/godot but maybe in the future.

• First iteration of the game will have something along the lines of ordering from a restaurant. I might add more flair to it like “Being on a date” later.

• You can talk to different people in your real voice.

• The bots will respond with a real voice from LLM api. The bot will respond with dialog created by the LLM.

• Live captions are available for you if you need it.

• You can ask the agents to repeat what they said.

• If the LLM doesn’t understand what you said the bots will act confused till you say it correctly.

• There can be helpful flashcards available to help you.

• Game will be 2D to start.

The reason I’m blogging about it

I’ve never blogged before, but I enjoy documenting my journey for my own benefit to see my progress. I’m curious of what I’m able to build and maybe the support I can gather. I will use this blog to document the problems I come across and any issues I have.