.svg){kind=small}
Since instruments such as the Tabla and Mridangam have their own language, it was necessary for us to create a custom keyboard so that the music instructor could create lessons and lesson plans as quickly as possible. This was a challenge from a UX perspective and required a lot of iteration to mimic and improve upon the experience the instructor had used in Google Docs previously.
Since immersive instruction was critical, instructors could add a video recording and/or audio recording in the lesson so that students can follow along at home at their own pace. The video recordings were integrated with a metronome so that students could also learn to keep the beat. This required a solid understanding of handling streaming video and compressing it to minimize streaming costs.
At the conclusion of the class, instructors could send a lesson recap to the student with specified homework. The student could follow along the instructions and record a video response directly in the app. Since the students could listen and watch the instructor's video as they played, they were more likely to keep the beat and learn the lesson correctly. The Nimi team built a solid understanding of how to control hardware components such as the camera and microphone to ensure the recording would only capture the student's information and not the instructor's audio.
