Introducing the Nuvoic project!

The Karten Network is delighted to be a partner in the Nuvoic Project, which aims to support easier communication and improved independence for people who have speech difficulties.

The Voiceitt app helps people with impaired speech to communicate using their own voice, and control voice-driven smart speakers or other smart home devices. Users train their chosen phrases and commands and Voiceitt learns to recognize their pronunciation. When it hears a trained prompt, the app speaks the matching phrase and displays it onscreen, or activates the matching command on a smart speaker.

Screenshots from Voiceitt, the 1st says 'tap to speak', the 2nd says 'listening', the 3rd displays the text 'Nice to meet you'.

See Voiceitt in action

In the first video, some of our participants demonstrate the different Smart Home controls they’ve been trying out with Voiceitt. In the second, some Voiceitt users in the US and UK demonstrate some of the phrases they’ve added to Voiceitt to help them to communicate.

‘Nuvoic Project Video’ text description

Some of our participants show how they’ve been using Voiceitt’s app to control smart home technology like lights, blinds and TVs, ask Alexa about the weather or play music or the radio, using their own voices.

The video starts with a series of photos of participants using the Voiceitt app in various different settings, including four young men, two young women and a middle-aged woman with her support worker. As the voiceover starts, the Karten Network logo and Voiceitt logos are displayed, and captions display what’s being said.

A young woman, Eleanor, uses the Voiceitt app on a tablet mounted on her wheelchair to turn her bedroom light blue. A young man, Karl, has the app running on a smartphone on the arm of his wheelchair, the screen reads ‘Movie time’, and you see his lights dim, his blinds go down and his TV turn on.

A young woman, Sarah, sitting on her sofa uses the app on an iPad on her coffee table to ask Alexa about the weather. She then says “I really enjoy taking part in the Voiceitt trial. I have never been able to use Alexa before because it didn’t recognise my voice”.

Another young woman, Ashley, sits on a sofa and uses the app on an iPad resting on her lap to play Magic Radio through her smart speaker.

A young woman, Lissa, sits in her office and describes how her team at Hill House Care Home have supported people to try out the Voiceitt app.

There are clips of lots of several different participants using the Voiceitt app or smiling at the camera as the voiceover finishes.

‘Voiceitt in action – communication’ video clip text description

This video shows a series of clips of people with unclear speech using the Voiceitt app, after they’ve trained it to recognise the way they pronounce certain phrases. The first user, a young man, says the word ‘cheeseburger’ but in a way that many people would find difficult to understand. The app on his phone recognises his speech and says ‘Can I have a cheeseburger’ using synthesised speech. His assistant claps him on the shoulder and says ‘You did it!’. The user claps his hands and smiles, saying ‘Yes!’. The words ‘Voiceitt moments’ appear across the screen.

The next clip shows an older man smiling at the camera. Someone off screen asks ‘Can I hear you say your name?’. The man says ‘Darryl’, in a way that some people would find difficult to understand, and smiles. He’s holding his phone up to the camera, the Voiceitt app recognises his speech and says ‘My name is Darryl’ using synthesised speech and shows the phrase in writing on the screen.

The third clip shows another young man, holding his phone. He says ‘Coke’ in a way which some people would find difficult to understand. The Voiceitt app on his phone says ‘Diet Coke’ using synthesised speech, the man smiles and looks at an older man, who gives a thumbs up sign. The user shows him the phone screen and the older man says ‘Fantastic! Is that good or what?’.

The fourth clip shows a slightly older man speaking into his phone, ‘I like chocolate’, in a way which some people may find hard to understand. The app on his phone speaks the phrase ‘I like chocolate’ using synthesised speech and the words appear on the screen.

We then see the first user again, doing a celebration dance. He then says ‘drink’ in a way that many people would find difficult to understand, the Voiceitt app says ‘Can I have a drink?’. His assistant says ‘There you go!’ and the user smiles at him. We then see a still photo of a young woman in a wheelchair using the Voiceitt app on an iPad mounted on a desk in front of her, she’s smiling at the camera. Next we see a still photo of the first user with an older woman, both are showing the Voiceitt app running on their phones and smiling at the camera. The words ‘independence through voice’ appear across the screen.

We then see the third user again. He says the phrase ‘thank you’ into his phone, in a way which some people would find hard to understand, and makes the sign for ‘thank you’ to the camera. The app speaks the phrase ‘Thank you’ using synthesised speech, the man smiles and claps his hands together, then gives a high five to the older man who’s with him.

Get involved!

Our role in the Nuvoic project is to lead on user involvement, through testing and feedback or by donating voice samples to support Voiceitt’s research and development work. Find out how you can get involved!

Funding

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 950872. These pages reflect the views of the Karten Network and Voiceitt. The European Commission is not responsible for any use that may be made of the information contained here.