Type:

Experiences

Products

Client:

American Society for Deaf Children

Deliverables:

UI, Development, UX, Concept, 3D Modeling, Animation, Copywriting, Design

Fingerspelling with Machine Learning

Every year 2 - 3 out of every 1,000 children born in the US are deaf or hard-of-hearing. 90% of these children are born to hearing parents, and in many cases, their child is the first deaf person these parents have ever encountered.

Without being introduced to sign language at an early stage, a deaf child may miss out on learning language. This can lead to language delay or deprivation, which has long-term negative impacts on a child’s life. That is why it is so important that parents of deaf children have the opportunity to learn American Sign Language (ASL) as soon as possible.

To address language deprivation and help bridge the communication barrier between the deaf and the hearing, we partnered with the American Society for Deaf Children to create Fingerspelling.xyz.

The concept

When you sign the word, the camera tracks your hand movements and gives you feedback so you can make corrections as needed. This helps you quickly develop your fingerspelling skills.

Concept

Fingerspelling.xyz is a browser-based app that uses a webcam and machine learning to analyze your hand shapes so you can learn to sign the ASL alphabet correctly.

Concept

The fingerspelling game is a great way to introduce the basics of ASL in a fun and playful way. It guides you step by step in how to master fingerspelling - hands on!

Project awarded:

Cannes Lion

Gold in Design
Silver in Design
Silver in Digital Craft


Webbys

Family, Kids & Education - People's choice winner
Social Impact - People's choice winner
Accessible Technology - People's choice winner


The One Show

Gold Pencil - Interactive & Mobile Craft - Innovation in Interactive & Mobile Craft
Gold Pencil - Interactive, Online & Mobile - Utility
Silver Pencil - Design - Innovation in Design
Silver Pencil - Experiential & Immersive - Craft - Use of Technology
Silver Pencil - Interactive & Mobile Craft - Use of Technology
Merit Award - Interactive, Online & Mobile - Gaming - Online


red.dot

Websites - Education
Apps - Education
Interface & User Experience Design - Virtual & Augmented Reality
Digital Solutions - Education & E-Learning


Creative Pool Annual

Advertising - Digital
Data
Social Good
Wave (innovation)
Web


FWA

Site of the Month
Site of the Day


Awwwards

Site of the Day


Spell: Innovative

Something something
We creates joyful digital ideas, products, brand identities and experiences that connect the hearts of brands to the hearts of their audiences.