In our diverse society, communication is the cornerstone of inclusion and understanding. Yet, for the deaf community, everyday interactions that many take for granted can be rife with challenges, leading to social stigma and barriers to full participation in both professional and personal spheres of life. Also, the ability to engage in effortless conversation is often hindered by the lack of common language and accessibility tools, isolating individuals and affecting their social and professional integration.

To bridge this gap, EY teams have developed an innovative solution, EY.ai Sign Language Translator — a real-time bi-directional sign language translation solution, supported by AI. This leading-edge solution is designed to dismantle the communication barriers by providing a seamless translation between sign language and spoken language. By doing so, it empowers the deaf individuals to interact with ease, fostering an environment of inclusivity and mutual respect.

The EY solution is more than just a technological breakthrough; it’s a beacon of hope for millions who have been marginalized due to their hearing impairments. It stands as a testament to our commitment to social equality, ensuring that every voice is heard, and every sign is understood. With this tool, EY teams are not just translating languages but translating aspirations into achievements and transforming the landscape of social interaction for the better.

The EY solution harnesses the leading-edge AI capabilities of EY.ai, the EY organization’s unifying platform that combines our vast experience in strategy, transformation, risk, assurance and tax, with EY technology platforms and leading-edge capabilities. Facilitated by an ecosystem spanning technology, business and academia, EY.ai builds confidence, creates value and augments potential.

Social opportunity

The World Health Organization (WHO) reports that over 5% of the world’s population — or 430 million people — have disabling hearing loss, a figure that is projected to rise to over 900 million by 2050. This staggering statistic underscores the critical need for inclusive communication solutions that can bridge the gap between the hearing and the deaf communities. The social opportunity presented by a real-time bi-directional sign language translation capability is immense and transformative.

The EY.ai Sign Language Translator solution developed by EY teams has the potential to revolutionize the way deaf community trained on sign language interacts with the world. By enabling instant and accurate translation between sign language and spoken language, it opens new avenues for education, employment, and social engagement for individuals with hearing disabilities. This solution addresses critical socio-economic problems associated with hearing disability, estimated to cost $980 billion annuallydue to productivity losses and social exclusion.

Moreover, the integration of such technology in public and private sectors promotes awareness and acceptance of sign language as a rich, complex, and fully-fledged means of communication. It encourages the hearing population to engage more deeply with the deaf community, fostering a more inclusive society where diversity in communication is not only accommodated but celebrated.

The real-time bi-directional sign language translation capability is not just a tool for individual empowerment; it is a catalyst for societal change. It embodies the spirit of the WHO’s call to action for ‘hearing care for all’, pushing us closer to a world where every person can connect, contribute, and thrive in a society that values and respects their unique mode of communication.

Objectives

EY.ai Sign Language Translator is a bi-directional solution supported by AI and designed to accomplish the following objectives:

• Enable deaf community within the EY organization (EY) to interact seamlessly with the hearing community and vice-versa for enhanced productivity and innovation.
• Foster an environment of social inclusion and belonging for the deaf or hard or hearing community in the firm.
• Enable the deaf community in EY have easy accessibility to employee welfare and skill building opportunities made available as part of the overall employee rewards structure.
• Help EY teams unlock untapped talent and growth potential by enabling the deaf community to create great value across the board.

Solution details

EY teams have developed a solution which aims to bridge the gap between spoken language and sign language by offering an innovative and comprehensive technology solution that supports both speech-to-sign language and sign language-to-speech/text translation, catering to different communication needs.

To begin with, this innovation is expected to be piloted for Product Increment (PI) planning meetings, Agile Scrum ceremonies, team meetings, townhalls, etc. EY teams expect this to enable the deaf colleagues within EY contribute better and feel more included in the overall setup of cross-functional Agile stable teams.

Beyond EY, globally this dual-purpose system is designed to facilitate seamless communication between individuals who use sign language and those who don’t, making it an essential tool for inclusive communication in various settings such as education, healthcare, customer service, and everyday interactions.

The innovative solution is powered by an integrated system which leverages leading-edge technology capabilities, patterns and processes in Natural Language Processing (NLP), computer vision, 3D-modeling, and audio processing to deliver a seamless communication experience.

It can be accessed via multiple modes — web/mobile/desktop app. Furthermore, the solution is powered by a combination of EY proprietary design principles, architecture and technology, complimented by various open-source components. The solution supports Indian Sign language to begin with. However, EY teams plan to onboard other globally popular sign languages like American Sign Language (ASL) and German Sign Language (GSL) in future.

Collaborative design for building an impactful AI solution: engaging NGOs for real-world understanding

To help promote the development of an effective and meaningful solution for the deaf community, EY teams proactively engaged with India-based NGOs specializing in support for individuals with hearing impairments. These collaborative discussions focused on understanding the current landscape, the specific challenges faced by the deaf community, and the critical considerations required for creating a beneficial tool. By involving professional sign language translators provided by the NGOs, EY teams were able to capture essential keywords, phrases, and expressions integral to accurate sign language communication.

This inclusive approach with direct participation of members of the global EY deaf community in development of this solution guaranteed that the solution was not developed in isolation but was instead crafted through active interaction and collaboration with subject-matter professionals. The goal was to construct a solution that offers long-term value to the deaf community by harnessing AI for social good, helping ensure that the technology developed is both culturally sensitive and contextually appropriate for its intended users.

Empowering deaf employees: the transformative impact of EY.ai Sign Language Translator

Improved in-person meeting participation: The introduction of the EY.ai Sign Language Translator solution has led to an increase in the active participation of deaf EY people in in-person meetings. This significant improvement has transformed the way meetings are conducted. Previously, the process was cumbersome and slow, as it required someone to transcribe the discussion in real-time for those with hearing impairments to read and then respond. This not only delayed the exchange of ideas but also placed the deaf individuals at a disadvantage, often leaving them a step behind in the conversation. With the new solution, this barrier has been removed, enabling real-time interaction. Deaf employees can now receive instant sign language translations of the spoken content, allowing them to engage promptly and effectively with their colleagues, share their insights, and contribute to the meeting without any delay.

Productivity gains: The deployment of the sign language translation solution has also had a positive impact on overall productivity, with an increase during calls and virtual meetings. This enhancement is attributed to the streamlined communication process, which has eliminated the previous delays and misunderstandings that often occurred when relying on text-based communication.

Improved satisfaction from Diversity, Equity and Inclusion (DE&I) community: With the introduction of technology and AI-enabled tools like the sign language translator solution, EY teams has seen higher DE&I satisfaction scores within the EY organization during the recent people pulse survey.

Advancing social inclusion

The social impact of EY.ai Sign Language Translator solution is substantial and multifaceted, focusing on promoting equality, diversity, respect, and empowerment. It is designed to champion human rights and foster an inclusive and accessible society for individuals with hearing or speaking disabilities, enabling them to participate fully in society and work.

The solution addresses the communication barrier that deaf individuals face, which has profound impacts across business, education, health, and social aspects of life. By making sign language translation accessible, it helps integrate these individuals into the workforce and improves their access to education, healthcare, and other necessary social benefits.

EY.ai Sign Language Translator also aims to change societal misperceptions and stigmatizing mindsets that limit efforts for preventing and addressing hearing loss. It is designed to be affordable and accessible to all, addressing the unmet ear and hearing care needs of over 80% of the global population.

About EY:

EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.

Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform and operate.

Working across assurance, consulting, law, strategy, tax and transactions, EY teams ask better questions to find new answers for the complex issues facing our world today.

EY refers to the global organization, and may refer to one or more, of the member firms of Ernst & Young Global Limited, each of which is a separate legal entity. Ernst & Young Global Limited, a UK company limited by guarantee, does not provide services to clients. Information about how EY collects and uses personal data and a description of the rights individuals have under data protection legislation are available via ey.com/privacy. EYG member firms do not practice law where prohibited by local laws. For more information about our organization, please visit ey.com.