How a major robotics company builds emotionally intelligent language learning toys with Hume’s API

Key impact metrics

• Provided parents with emotional diaries tracking children’s states over time
• Enabled bilingual (Japanese/English) emotional intelligence in conversational AI
• Enhanced children’s language learning through interactive engagement
• Supported children’s socio-emotional development

A voice AI character for interactive learning

A leading Japanese robotics company sought to develop a conversational stuffed animal to enhance English language learning for Japanese children. The toy integrates with smart devices, offering interactive learning games based on visual stimuli and conversation. These games include tongue twisters, guessing games, word associations, collaborative storytelling, and word definition quizzes. Beyond structured activities, the toy engages in casual conversation, allowing children to practice speaking English naturally.

Recognizing the need for emotional intelligence in effective and responsible conversational robots for children, the company aimed to create a toy capable of heartfelt interactions. To achieve this, they turned to Hume AI’s expression measurement models. The toy was designed to converse in both English and Japanese, prompting Hume AI to fine-tune their Expression Measurement API with additional Japanese conversational data. This ensured equivalent emotional intelligence in both languages, enhancing the animal’s ability to connect with children emotionally.

Speaking with AI for education

By integrating Hume’s Expression Measurement API into their robot, the company expanded its potential for supporting child development. The toy interprets and logs a child’s emotional state by asking questions about their daily life and mood. For instance, it might inquire how the child feels about pancakes, their relationship with their grandmother, or about their favorite memories. The toy follows up on these topics over time, creating a sense of continuity and care. Additionally, the toy supports socio-emotional learning by helping the child understand and manage challenging emotions, such as frustration after losing a game, and by fostering empathy towards others’ feelings.

The impact of emotionally intelligent AI

• Parents can access emotional diaries, providing insights into their child's emotional states over time. These diaries include analyses of the child's interests, tracking how they feel in various situations and identifying patterns in their responses. These additive insights aid in empowering parents to support their child's emotional well-being and cognitive growth more effectively. For example, if the toy measures that a child is excited about dinosaurs, it will encourage parents to read a book about dinosaurs with their child. Moreover, these insights can help parents identify any emotional challenges their child may be facing, such as anxiety or sadness, and provide early intervention if needed. 

• Japanese children gain access to a consistent method for learning and practicing English that is both educational and engaging. Through the use of interactive learning games and conversational practice, the toy provides a dynamic and immersive language-learning experience. This approach not only reinforces vocabulary, grammar, and listening but also encourages spontaneous language use.

The collaboration between the Japanese robotics company and Hume AI demonstrates how empathic AI can revolutionize educational tools. By integrating Hume’s Expression Measurement API, the company developed a conversational stuffed animal that enhances English language learning while supporting socio-emotional development in children. This innovative approach ensures that learning is both effective and emotionally enriching, providing children with a unique, empathetic, and engaging educational experience. Parents gain valuable insights into their child's emotional and personal growth, empowering them to better support their development. This application of Hume’s empathic AI underscores the potential of combining emotional intelligence with educational technology to create impactful learning solutions.

Learn More: Start measuring vocal and facial expressions with unmatched precision using Hume’s Expression Measurement API. Instantly capture nuanced expressions in audio, video, and images, such as awkward laughter, sighs of relief, and nostalgic glances. Enhance your product decisions and user experience with models based on 10+ years of research. Start building today.