Duolingo Chat

Duolingo Chat

An AR and AI extended feature to turn community chats into immersive language experiences.
An AR and AI extended feature to turn community chats into immersive language experiences.

Industry

Education

What I did

User research, UI/UX Design

Timeline

Sep 2024 - Dec 2024

Team

3 Product Designers

Background
  1. People want to connect across cultures
    These days, more of us want to travel, meet new people, and understand different cultures, and learning a language is a big part of that.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

  1. Duolingo makes learning fun and easy
    With quick lessons, cute graphics, and game-like rewards, Duolingo helps beginners get started without feeling overwhelmed.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

  1. But real fluency needs real conversation
    Duolingo teaches the basics, but to actually speak and understand a language in real life, you need more practice talking with others.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

Problem Statement

Duolingo lacks effective tools for natural speaking and listening practice, forcing users to rely on outside platforms that can feel intimidating or disconnected from their learning journey.

Target Users

Intermediate Duolingo learners

People who’ve built a streak and learned the basics but feel stuck when it comes to actually speaking the language.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

Intermediate Duolingo learners

Tech-savvy learners and travelers

Users who enjoy interactive, playful learning experiences and aren’t afraid to try new features like AR or AI chats.

Curious, globally-minded users who want to use the language in real-life settings like trips, exchange programs, or casual conversations.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

Tech-savvy learners and travelers

Design Challenges
  • Make conversation practice feel natural and low-pressure
    Many learners feel nervous speaking out loud. The challenge is to create an environment where they can practice speaking without fear of making mistakes or being judged.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

  • Make conversation practice feel natural and low-pressure

  • Turn passive learning into active interaction
    Duolingo lessons are mostly solo and text-based. The challenge is to get users talking, engaging their voice, and reactions in real-time, just like real conversations.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

  • Turn passive learning into active interaction

  • Build social connection through shared language learning
    Language learning can feel lonely. The challenge is to make it more social by helping users connect with others who are learning the same language, and make it fun, not awkward.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

  • Build social connection through shared language learning

My Approach

My Approach
My Approach
Usability Test
Usability Test
Usability Test

To improve the learning experience and make it more flexible, I worked with users to audit the app, simplify the flow, and reorganize the layout so the new feature could fit naturally into Duolingo’s existing structure.

Existing Duolingo in Aug 2023

Existing Duolingo in Aug 2023

Too many confusing icons

Problem: The bottom menu feels cluttered and hard to understand.
Fix: Use fewer icons with clear labels or tooltips to make navigation easier.

Too many confusing icons

Problem: The bottom menu feels cluttered and hard to understand.
Fix: Use fewer icons with clear labels or tooltips to make navigation easier.

Too many confusing icons

Practice screens feel dull

Problem: Speaking and listening exercises look plain and repetitive.
Fix: Add animations, progress feedback, or characters to make it more engaging.

Practice screens feel dull

Problem: Speaking and listening exercises look plain and repetitive.
Fix: Add animations, progress feedback, or characters to make it more engaging.

Practice screens feel dull

Leaderboard, shop, and newsfeed rarely used

Problem: These features aren’t clearly useful or tied to learning goals.
Fix: Reframe them as motivational tools, like rewards for consistent speaking or social streaks.

Leaderboard, shop, and newsfeed rarely used

Problem: These features aren’t clearly useful or tied to learning goals.
Fix: Reframe them as motivational tools, like rewards for consistent speaking or social streaks.

Leaderboard, shop, and newsfeed rarely used

Friends feature is hard to find and use

Problem: Friend list is buried in the app and doesn’t feel connected to learning.
Fix: Move it to the main menu and add features like practice with friends or conversation challenges.

Friends feature is hard to find

Problem: Friend list is buried in the app and doesn’t feel connected to learning.
Fix: Move it to the main menu and add features like practice with friends or conversation challenges.

Friends feature is hard to find and use

Mistake feedback isn’t helpful enough

Problem: Users get corrected but they don’t always understand the reasoning behind it.
Fix: Give short, friendly explanations or tips after errors to support learning.

Mistake feedback isn’t helpful enough

Problem: Users get corrected but they don’t always understand the reasoning behind it.
Fix: Give short, friendly explanations or tips after errors to support learning.

Mistake feedback isn’t helpful enough

Voice recognition can be unreliable

Problem: Sometimes marks users wrong even when pronunciation is fine.
Fix: Improve sensitivity settings and let users replay and compare their pronunciation with a model.

Voice recognition can be unreliable

Problem: Sometimes marks users wrong even when pronunciation is fine.
Fix: Improve sensitivity settings and let users replay and compare their pronunciation with a model.

Voice recognition can be unreliable

User Interview
User Interview
User Interview

Before starting the project, I explored how the app works and how users interact with it. I looked into common challenges and gathered insights, which we grouped into 5 key points:

Findings

Findings

Great for review,
but a bit one-way
Great for review,
but a bit one-way

Duolingo is great for review,
but a bit one-way

Duolingo is great to get started or review what you already know, but the experience feels like a one-way street, there’s not much back-and-forth like in real conversations.

Duolingo is great to get started or review what you already know, but the experience feels like a one-way street, there’s not much back-and-forth like in real conversations.

People learn best by living the language

People learn best by living the language

Real language learning happens through social interaction and regular practice, not just by memorizing phrases and repeating them.

Real language learning happens through social interaction and regular practice, not just by memorizing phrases and repeating them.

Memorizing isn’t
good enough

Memorizing isn’t good enough

Just learning words doesn’t help users truly understand or use the language. Both beginners and fluent users want more guided conversations.

Just learning words doesn’t help users truly understand or use the language. Both beginners and fluent users want more guided conversations.

Good start, but not enough to grow
Good start, but not enough to grow

Good start, but not enough to grow

Duolingo is great for refreshing what you already know, but the experience feels like a one-way street, there’s not much back-and-forth like in real conversations.

Duolingo is great to get started, but the experience feels like a one-way street, there’s not much back-and-forth like in real conversations.

Different levels, different needs

Different levels, different needs

Beginners want to talk with fellow learners, while advanced users prefer chatting with fluent speakers to get real-world practice.

Beginners want to talk with fellow learners, while advanced users prefer chatting with fluent speakers to get real-world practice.

Speaking out loud can feel awkward

Speaking out loud can feel awkward

Many users feel shy or unsure when practicing speaking alone or with bots. They want a space that feels more natural, supportive, and less like a test.

Many users feel shy or unsure when practicing speaking alone or with bots. They want a space that feels more natural, supportive, and less like a test.

Comparative Analysis
Comparative Analysis
Comparative Analysis

To better understand the problem, I looked at other language learning apps and similar tools. I also read other user reviews to see what people liked, and where they were getting stuck.


To better understand the problem, I looked at other language learning apps and similar tools. I also read other user reviews to see what people liked, and where they were getting stuck.

To better understand the problem, I looked at other language learning apps and similar tools. I also read other user reviews to see what people liked, and where they were getting stuck.

What inspired me…
  • Snapchat filters let people play with identity and have fun being someone else. We liked the idea of using filters in our app too, so users can stay anonymous and feel more comfortable practicing conversations.

  • We also looked at Pokémon Go’s AR features. It inspired us to create a safe, interactive experience for younger users, where they can connect in real life through the app, but with age-appropriate filters and content moderation.

Product Feature Ideas
Product Feature Ideas
Product Feature Ideas

After research and team feedback, we explored ways to make learning more fun using AR, and AI, taking inspiration from games like Pokémon Go and Snapchat filters.


After research and team feedback, we explored ways to make learning more fun using AR, and AI, taking inspiration from games like Pokémon Go and Snapchat filters.

After research and team feedback, we explored ways to make learning more fun using AR, and AI, taking inspiration from games like Pokémon Go and Snapchat filters.

  1. Conversation Filters (Inspired by Snapchat)

    • Anonymous matching with other learners at a similar level

    • Users can choose different AR masks or avatars during live chats.

    • Helps reduce anxiety by keeping conversations light and anonymous

    • Encourages roleplay scenarios for language practice (e.g., ordering food, job interviews).

  1. Safe Mode for Younger Users

    • Age-based content moderation with limited access to open chats.

    • Interactions are pre-scripted or guided by prompts.

    • Visual feedback and rewards for completing real-life interaction missions.

    • Users can record and reflect on their experiences in-app.

  1. AR World Challenges (Inspired by Pokémon Go)

    • Learners walk around and "unlock" new vocabulary by scanning real-world objects.

    • Complete daily AR quests that involve practicing phrases in context.

    • Cards prompt real-life tasks like “Order a coffee in your target language” or “Ask for directions.”

    • Earn badges for visiting landmarks or completing location-based tasks.

User Flows
User Flows
User Flows

Then I conducted an user flow to have a more concrete idea of how user would engage in certain tasks.

Information Architecture
Information Architecture
Information Architecture

I started thinking about how to fit my new features into Duolingo’s existing layout without making it confusing.

Existing Information Architecture

The original app had six icons on the bottom menu, but they didn’t have labels, so new users often felt lost. During testing, this came up a lot, which led me to figure out which labels and sections are truly important for a smooth learning experience.

Proposed Information Architecture

I created a new site map to show what features should be included and where they should live in the app. This helped me find the right home for each new idea so everything feels easy to find and use.

Ideation
Ideation

I developed a set of sketches that outline the layout and fundamental structure of an interface before incorporating its content, navigation, and visual design elements.

Feature Propose

Feature Propose
Feature Propose
🏠 Home / Learn Tab
🏠 Home / Learn Tab
🏠 Home / Learn Tab
  • Quests and badges are now featured front and center to keep users motivated.

  • A friendly “Welcome” message and profile button at the top personalize the experience and clear up the clutter.

  • Navigation is simplified to just 4 tabs: Learn, Practice, Connect, and Shop—with only the active tab highlighted.

📜 Rules of Conduct
📜 Rules of Conduct
📜 Rules of Conduct
  • Before chatting, users agree to be kind and respectful.

  • These rules help create a safe and inclusive space for all learners.

🧠 Practice Tab
🧠 Practice Tab
🧠 Practice Tab
  • Review and strengthen skills with bite-sized exercises.

  • Choose speaking, listening, or writing topics based on your level or interest.

  • The more you practice, the more the app adapts to you, with harder challenges as you grow.

  • Review and strengthen skills with bite-sized exercises.

  • Choose speaking, listening, or writing topics based on your level or interest.

  • The more you practice, the more the app adapts to you—with harder challenges as you grow.

🎯 Topic Cards (within Learn)
🎯 Topic Cards (within Learn)
🎯 Topic Cards (within Learn)

ic Cards (within Practice)

  • Get guided speaking practice with helpful instructions and prompts.

  • Topics are everyday, relatable, and structured to build confidence—like “favorite food” or “describe a trip.”

  • You’ll get time to prepare before speaking, helping you organize your thoughts.

  • Get guided speaking practice with helpful instructions and prompts.

  • Topics are everyday, relatable, and structured to build confidence—like “favorite food” or “describe a trip.”

  • You’ll get time to prepare before speaking, helping you organize your thoughts.

🤝 Connect Tab
🤝 Connect Tab
🤝 Connect Tab
  • Match with learners or native speakers who want to practice the same topic.

  • Check out their profile, send a message or friend request, and start chatting once accepted.

💬 Live Chat Room
💬 Live Chat Room
💬 Live Chat Room
  • Use AR filters in video chat to ease nerves and keep it fun.

  • Prompts help break the ice and guide the conversation.

  • After chatting, leave feedback and review your recordings for self-reflection.

🤝 Connect Tab
🤝 Connect Tab
🤝 Connect Tab
  • Match with learners or native speakers who want to practice the same topic.

  • Check out their profile, send a message or friend request, and start chatting once accepted.

💬 Live Chat Room
💬 Live Chat Room
💬 Live Chat Room
  • Use AR filters in video chat to ease nerves and keep it fun.

  • Prompts help break the ice and guide the conversation.

  • After chatting, leave feedback and review your recordings for self-reflection.

🎁 Rewards
🎁 Rewards
🎁 Rewards
  • Finish a chat and open a reward chest to earn gems, spend them on fun filters or items.

  • Watch an ad to double your prize. It’s gamified learning at its best.

👤 Profile
👤 Profile
👤 Profile
  • Customize your profile and avatar to make it feel more personal.

  • Track your streak, progress bar, and digital gems to celebrate every win.

  • See past chats and feedback for ongoing self-improvement.

Testing & Iteration
Testing & Iteration
Findings

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

  1. Positive Feedback: Users were generally satisfied with the design.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

  1. Young Users: I overlooked that the youngest user group (aged 13-17) needs more supervision when interacting with strangers.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

  1. Safety Concerns: Users wanted safeguards to filter out those using the app for inappropriate purposes (like dating or selling).

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

  1. Young Users: I overlooked that the youngest user group (aged 13-17) needs more supervision when interacting with strangers.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

Potential Solutions

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

  1. For Young Users: Allow minors (13-17) to chat only with Duolingo characters, supported by AI and AR, with increased moderation.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

  1. Community Guidelines: Establish clear rules prohibiting selling, promoting social media, or dating. Enable users to report and block rule-breakers.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

  1. Automated Moderation: Implement filters and tools to detect and remove inappropriate content or behavior.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

  1. Integration: Incorporate Duolingo Chat directly into the main Duolingo app for better accessibility.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

Impact
Impact
  • Pushed Duolingo beyond gamified vocabulary drills into real conversational practice.
  • Created space for safe, low-pressure speaking practice, especially for shy learners.
  • Brought in playful elements (like AR filters and quests) to reduce fear and make speaking feel fun and approachable.
  • Explored how emerging tech like VR can turn everyday situations, like ordering coffee, into powerful language learning moments.
  • Helped envision new, immersive pathways for learning, blending fun and functionality with future-ready tech.

During the pandemic, small businesses in Vietnam struggled to transition online. Existing e-commerce platforms lacked a focus on handcrafted and customized products. Sellers faced issues with customer engagement, pricing, and logistics.

My Takeaways
My Takeaways

As a longtime Duolingo user, this project felt especially close to me. I’ve always loved the app’s playful approach, but I also know the frustration of hitting a plateau, not being able to read a phrase, and freezing up when it’s time to say it out loud.

Designing Duolingo Chat gave me a chance to reimagine what real conversation practice could look like, fun, low-pressure, and truly immersive. Exploring VR pushed me out of my comfort zone, but it also opened up a whole new world of possibilities for language learning.

This project reminded me that the best design doesn’t just teach—it builds confidence.

Wanna collaborate? Let's Chat!

I am currently looking for a team where I can take part, learn from,
and become a better designer (/human).

© 2024 Kim Au Le

Wanna collaborate? Let's Chat!

I am currently looking for a team where I can take part, learn from,
and become a better designer (/human).

© 2024 Kim Au Le

Wanna collaborate? Let's Chat!

I am currently looking for a team where I can take part, learn from,
and become a better designer (/human).

© 2024 Kim Au Le

Wanna collaborate?
Let's Chat!
I am currently looking for a team where I can take part, learn from,
and become a better designer (/human).

© 2024 Kim Au Le