LIVE TRANSCRIBE DUAL SCREEN
Bringing new text-to-speech feature to foldable form factor devices
Deploying a text-to-speech solution on dual-screen devices to optimize the transcription experience and support more fluid conversations.
Solution
Highlighted in the Pixel Pro Fold Launch Aug ‘24
Users struggle with the cumbersome ergonomic design for transcription during conversations, including constant app switching and rotating the device for others to view.
Challenge
UX Methodologies
User Research
Information Architecture
User Journeys
Mockups
Feature Design
Tools
Figma
Timeline
Oct 2023 to May 2024
What is Live Transcribe
Live Transcribe captures speech and sound as text on screen for users who are d/Deaf and hard of hearing. It also the most used assistive tech at Google with 2.5 million daily users
Challenge
The ergonomic experience for transcriptions during conversation is awkward
Constantly switching between apps if you want to reply
Frequently turning device around for others to see your screen
Research
User research conducted with our partner team, Samsung, to know how to improve dissatisfaction. This research revealed that it’s difficult to use Live Transcribe with just one device
Research Insights
Users didn’t want to use multiple devices
Users don’t like handing their device to strangers
Users were using other apps for “voice” text-to-speech
User Journey
I collaborated closely with product managers and engineers to establish detailed user journeys and stories outlining how users would access and interact with the new features. Together, we mapped out scenarios to ensure a seamless and intuitive experience, leveraging our research findings from Samsung. This collaborative approach allowed us to align on key touchpoints and integration points, ensuring the new features met user needs and expectations while fitting seamlessly into the existing design.
Information Architecture
Since this was a new feature, I needed to perform information architecture to determine where this functionality would fit within the existing design. This involved analyzing the current structure and user flow to identify the most intuitive and accessible placement for the text-to-speech button. Additionally, I needed to establish a location where users could access the text-to-speech voice selection, allowing them to choose their preferred voices. By ensuring these features were seamlessly integrated, I aimed to enhance user experience without disrupting the existing design framework.
Ideations
Version 1
In the first design version, the following text to speech button group was implemented an entry point to enable 'foldable mode' functionality a voice read-aloud feature was integrated, enabling users to have the text read to them aloud.
A delete button was also added to allow users to remove text quickly and efficiently, modified version for the new Samsung Z-flip given smaller digital real estate
Inside Screen
Outside Screen
Samsung Z Flip
Outside Screen
Version 2
In the first design version, the following was iterated
Collaborated with UX Writer & Marketing team for naming consistency. Went from Foldable Mode to Dual Screen
Added visibility button for users to hide and show text for privacy reasons
Minimized icons and text to icons only for consistency across form factor devices
Pixel Fold
Samsung Z Flip
Final Design
Given the visual icons didn’t provide users with any context, I collaborated with UX Writing to have tooltips to provide information about the functionalities of each icon. This tooltip sequence appears on the users first experience.
Impact
Pixel Pro Fold Launch Aug'2024
Our new feature design was highlighed with the new Pixel Pro Fold device; a new take on accessibility with different form factors.
Lessons Learned
Being aware of different form factor constraint when implementing
Speaking the language of engineers assists with the development process
Holistic cross-functional collaboration helps to reach goals faster