NYU Abu Dhabi has made a significant breakthrough in the field of artificial intelligence, developing an AI-powered tool that can translate spoken language into sign language.
What the tool does
The innovative technology uses AI to recognize and interpret spoken language in real-time, allowing it to convey the same message in sign language. According to Dr. Mohamed Al-Moneer, a professor of computer science at NYU Abu Dhabi, the tool has been trained on a dataset of over 10,000 sign language videos, enabling it to accurately recognize and translate a wide range of spoken language inputs. The tool can be used in various settings, including classrooms, public events, and healthcare facilities, to improve communication between deaf and hard-of-hearing individuals and their hearing counterparts. In addition, the tool can also be used to provide real-time subtitles for videos and live streams, making them more accessible to a wider audience.
The tool has been tested in several pilot studies, with promising results. In one study, the tool was used to translate spoken language into sign language for a group of deaf students, resulting in a significant improvement in their understanding of the material. The study was conducted in collaboration with the UAE's Ministry of Education, which has expressed interest in integrating the tool into its educational programs.
Impact on the community
The tool has the potential to greatly improve communication for deaf and hard-of-hearing individuals in the UAE, enabling them to participate more fully in social and cultural activities. According to a report by the UAE's National Council for Disability Affairs, there are over 100,000 deaf and hard-of-hearing individuals living in the UAE, many of whom face significant barriers to communication and participation. The tool can help to address these barriers, enabling deaf and hard-of-hearing individuals to access education, employment, and other opportunities.
The tool can also have a positive impact on the broader community, by promoting greater understanding and inclusion of deaf and hard-of-hearing individuals. By providing a means of communication that is accessible to all, the tool can help to break down social and cultural barriers, and promote a more inclusive and equitable society. In addition, the tool can also be used to promote awareness and education about deaf culture and sign language, helping to reduce stigma and promote greater acceptance of deaf and hard-of-hearing individuals.
Future applications
The university plans to further develop and refine the tool, exploring its potential applications in various settings, including education, healthcare, and public services. In addition, the university is also working with industry partners to develop commercial versions of the tool, which can be used in a wide range of applications. The tool has the potential to be used in a variety of settings, including hospitals, schools, and government offices, to improve communication and accessibility for deaf and hard-of-hearing individuals.
The university is also exploring the use of the tool in emergency situations, such as natural disasters or medical emergencies, where communication can be critical. In these situations, the tool can be used to provide real-time communication between emergency responders and deaf and hard-of-hearing individuals, helping to save lives and reduce the risk of injury. The university is working with emergency responders and other stakeholders to develop protocols for the use of the tool in emergency situations.
Collaboration and funding
The development of the tool has been made possible through a collaboration between NYU Abu Dhabi and several industry partners, including the UAE's Ministry of Education and the Abu Dhabi Department of Education and Knowledge. The project has received funding from a number of sources, including the UAE's National Council for Disability Affairs and the Abu Dhabi Education Council. The funding has enabled the university to assemble a team of researchers and developers, who have worked together to design and develop the tool.
The university is also seeking additional funding to support the further development and refinement of the tool. The funding will be used to support the hiring of additional researchers and developers, as well as the purchase of new equipment and software. The university is working with a number of potential funders, including government agencies and private companies, to secure the necessary funding to support the project.
