Introducing the Nuvoic project!

The Karten Network is delighted to be a partner in the Nuvoic Project, which aims to support easier communication and improved independence for people who have speech difficulties.

The Voiceitt app helps people with impaired speech to communicate using their own voice, and control voice-driven smart speakers or other smart home devices. Users train their chosen phrases and commands and Voiceitt learns to recognize their pronunciation. When it hears a trained prompt, the app speaks the matching phrase and displays it onscreen, or activates the matching command on a smart speaker.

Screenshots from Voiceitt, the 1st says 'tap to speak', the 2nd says 'listening', the 3rd displays the text 'Nice to meet you'.

See Voiceitt in action

‘Voiceitt in action – communication’ video clip text description

This video shows a series of clips of people with unclear speech using the Voiceitt app, after they’ve trained it to recognise the way they pronounce certain phrases. The first user, a young man, says the word ‘cheeseburger’ but in a way that many people would find difficult to understand. The app on his phone recognises his speech and says ‘Can I have a cheeseburger’ using synthesised speech. His assistant claps him on the shoulder and says ‘You did it!’. The user claps his hands and smiles, saying ‘Yes!’. The words ‘Voiceitt moments’ appear across the screen.

The next clip shows an older man smiling at the camera. Someone off screen asks ‘Can I hear you say your name?’. The man says ‘Darryl’, in a way that some people would find difficult to understand, and smiles. He’s holding his phone up to the camera, the Voiceitt app recognises his speech and says ‘My name is Darryl’ using synthesised speech and shows the phrase in writing on the screen.

The third clip shows another young man, holding his phone. He says ‘Coke’ in a way which some people would find difficult to understand. The Voiceitt app on his phone says ‘Diet Coke’ using synthesised speech, the man smiles and looks at an older man, who gives a thumbs up sign. The user shows him the phone screen and the older man says ‘Fantastic! Is that good or what?’.

The fourth clip shows a slightly older man speaking into his phone, ‘I like chocolate’, in a way which some people may find hard to understand. The app on his phone speaks the phrase ‘I like chocolate’ using synthesised speech and the words appear on the screen.

We then see the first user again, doing a celebration dance. He then says ‘drink’ in a way that many people would find difficult to understand, the Voiceitt app says ‘Can I have a drink?’. His assistant says ‘There you go!’ and the user smiles at him. We then see a still photo of a young woman in a wheelchair using the Voiceitt app on an iPad mounted on a desk in front of her, she’s smiling at the camera. Next we see a still photo of the first user with an older woman, both are showing the Voiceitt app running on their phones and smiling at the camera. The words ‘independence through voice’ appear across the screen.

We then see the third user again. He says the phrase ‘thank you’ into his phone, in a way which some people would find hard to understand, and makes the sign for ‘thank you’ to the camera. The app speaks the phrase ‘Thank you’ using synthesised speech, the man smiles and claps his hands together, then gives a high five to the older man who’s with him.

‘Voiceitt in action -Smart home’ video clip text description

The clip starts by showing scenes of the Inglis supported living and residential care service in Philadelphia. Captions tell us that in July 2019, Voiceitt lauched its first smart home pilot there, enabling universal access (for people who have non-standard speech) to mainstream voice technology for the first time.

We see a photo of Inglis resident Jeanne, a middle-aged woman who uses a wheelchair, her high school diploma & other certificates, and then see her using the Voiceitt app integrated with a smart speaker to control a lamp and TV using her voice.

We then see Nat, a young man in a wheelchair, using a head pointer to set up the Voiceitt app on an iPad. A caption tells us that the next scene is 20 minutes later, where we see Nat using Voiceitt and a smart speaker to control his TV using his voice. He turns the TV off, then on again and changes the channel.

Finally, we see Brian, a middle aged man who uses a wheelchair, using Voiceitt to control his TV using his voice, he then tells us ‘I love technology!’.

Get involved!

Our role in the Nuvoic project is to lead on user involvement, find out how you can get involved!

Funding

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 950872. These pages reflect the views of the Karten Network and Voiceitt. The European Commission is not responsible for any use that may be made of the information contained here.