Word to World

Word to World

Word to World is a voice-interactive storytelling app for preschool children. It turns recognised speech into branching picture-book experiences, where children shape the story, collect word cards, and unlock more worlds to explore.

Download on the App Store
Date

2021–2022

My Role

Lead Product Designer

Scope

Strategy & research / UX/UI design / Game & content systems / 3D collaboration

The Brief

Challenge

As the sole Product Designer, I took Word to World from concept to its 1.0 launch. The technology could only map recognised words to preset models and animation clips, rather than true text-to-animation, so the challenge was to turn that constraint into engaging storybook interactions through which preschool children could learn and revisit words.

Solution

Together, we brought the concept to 1.0 as a voice interactive storybook. An early language model processed children’s speech and matched supported keywords to preset visual actions. Speaking those words lets children choose story branches, collect and revisit vocabulary, and unlock new books.

Grounding the product in family life across cultures

I interviewed 10 families in the US, China, and Germany to understand how early-childhood education and entertainment fit into daily life. The differences in screen habits, safety expectations, and educational value reshaped our personas and content decisions; together with the founder and strategist, I used these findings alongside competitor and gaming research to define the product direction and business model.

Designing the 1.0 storybook gameplay

Together with the founder, I designed the 1.0 gameplay around a limited speech recognition and animation system. Each book contains 10 to 15 sentences and branching routes; children progress by saying supported keywords, then collect the words they used. Each card carries knowledge, sound, and action, while shells and badges reward completion and unlock more books. Based on this core loop, we defined business models for the early, middle, and later stages of the product.

Story-to-reward system diagram

Shaping a world of interactive voice books

Building on our research, we created 20 rich interactive voice books for the first phase, each with its own theme, learning context, and story world. I worked with the team on the content approach and writing, translating research findings into stories, supported words, and interactions that felt engaging for preschool children. We tested the early books with children and families, then used their feedback to refine the content and experience.

Little fox makes a friend interactive voice book cover
Interactive voice book cover two
Interactive voice book cover three
Interactive voice book cover four
Interactive voice book cover five
Interactive voice book cover six
Interactive voice book cover seven
Interactive voice book cover eight

Making progress tangible through collection

I designed the collection system to show what a child has actually said and discovered. Up to 20 word cards, badges, and shells can be earned in each story; together they turn vocabulary progress into a visible collection and make replaying a route, or opening the next book, feel worthwhile.

What the product achieved

Six months after launch, Word to World had reached 50k users. It was selected twice for App Store Editor’s Choice and received five awards, including Core77 and the German Innovation Award.

0

Registered users, 6 months after launch

0

Design rewards

iOS App Store Editor’s Choice

Credits

Xinyue Yang, Rapha Gao, Samfer Lan, Leon Zhou

Next Project