Sony Pixel Power calrec Sony

Transcribing the future

11/10/2018

-- --

Facebook

Twitter

Google

Pinterest

SCREEN AFRICA EXCLUSIVE: A while back I was handed a bunch of very long audio files and was tasked with cutting about 60 hours of interviews, sound bites and voice over down to a 30-minute radio piece. Easy I thought, as long as I could get the material transcribed quickly and at reasonable cost and there my journey of discovery began.

Voice to text transcriptions have long been used in the media, medical and legal industries, traditionally done by human transcription teams. It's big business, but turn arounds can be slow and files often need a second error check to make sure the content is accurate. The cost of transcription actually wasn't a factor in my case - it was speed that I needed, I needed a machine to plough through my audio files and spit out a transcript so that I could search for key words and edit my story together.

-- --

Trolling the internet, I instantly found a few options and uploaded the same test file to all of them (as part of my free trials) but had really disappointing results ranging from 25 to about 59 per cent accuracy. Simple words and phrases were being interpreted as something completely different, more complex words like Fakarava Atoll came back as expletives! At first I thought that as the majority of interviews were heavy New Zealand accents that might be the problem but a snippet of the best British accented guest gave me similar results.

Through my work in the video world, I am aware that there is a lot of research and development in the transcription arena utilising Artificial Intelligence (AI). Machine learning works best when it is processing large analysable data sets like text. But most of the data being produced in the world right now is not text, it's the spoken word embedded in video and audio recording and thus the goal for AI developers to produce a reliable voice transcription process has intensified.

Tech companies like Apple, Google, Microsoft and Amazon are all actively involved in this space and have been researching voice recognition since the 90s and that research has only accelerated with the emergence of virtual assistants like Alexa, Cortana, and Google Voice and Siri. However, most people who use Siri or Alexa would agree that, while those tools do a reasonable job of understanding you, most of us wouldn't trust them with our lives. I asked Alexa where the Fakarava Atoll was and her response was, I would rather not answer that question. (Out of interest it is in Tahiti and is not a swear word!) A voice assistant like Alexa only needs to work out which, of a predetermined list of vocal commands is being asked, whereas a transcription programme needs to listen for and capture all spoken words and this wider variety of possible inputs and outputs makes it a more difficult task for AI.

Whilst stumbling around for my transcription answers I came across an article published by a team of Data Scientists and enthusiastic entrepreneurs, Ashutosh Trivedi and Anup Gosavi, who recently founded a company called Spext. Trivedi, based in Bangalore India, has deep interest and post graduate expertise in AI and has published his research in many IEEE journals. Gosavi is based in San Francisco and specialises in Design Thinking and Information Visualisation.

Spext describes their company name as a fusion of the words speech and text, and from the outset they looked like they could offer me exactly what I wanted and more. The service can best be described as a combined voice transcriber and media editor. You upload your audio files and the system automatically converts voice to text and displays the result in an edit window where it aligns the audio content with the text accurately and that means you can now do some amazing things with the resultant files. Not only do you get a full transcription of your work but you can edit the transcript, like you would on a word processor and then export the result as a new audio file. Obviously you can't create new sentences but the ability to edit and output the existing data as an audio file is a huge plus. It looks like a normal text editor and has familiar actions like copy-paste, cut-paste and I found editing by transcriptions on the fly extremely easy. When you are done you export your work as a word document, pdf and/or a new mp3 or wave file or even export your project to professional editing tools such as Adobe Audition, and Final Cut Pro for fine tuning.

The most important result is that the files I used to test other systems uploaded into the Spext system quickly and came back blazingly fast with a resultant accuracy of 96 per cent in my case. The system had even correctly punctuated the transcription, coped well with proper nouns like the names of fish species and fishing techniques but it too also battled with transcribing Fakarava (expletive) but at least recognised the word Atoll. It took no time at all to quickly manually edit any corrections. What could have taken weeks in production will easily get done in a matter of days now, artificial intelligence seems to have finally reached the point where transcription of audio by a machine works efficiently enough to make it viable and as researchers and companies improve and refine their algorithms, it seems evident that transcriptions will become even more accurate and the potential productivity savings of automated transcription will be hard to ignore. Someday soon, we might even be headed towards a world where audio files and text are thought of not as two distinct media types, but as two formats for the same content - as interchangeable - and as convertible as an .mp3 and a .wav file or a text file and a Word document.

The guys at Spext have used a unique combination of intuitive user experience design, to make it easy for the user, and advanced machine learning tha
LINK: http://www.screenafrica.com/2018/10/11/technology/ai-artificial-intell...
See more stories from screenafrica

Africa Stories

28/03/2024

Tonight on House of Zwide: Zanele informs Zola of her pregnancy

Tonight on House of Zwide: Zanele informs Zola of her pregnancyDon't miss Thursday, 28 March's riveting episode of South African soapie House of Zwide o...

28/03/2024

Tonight on Umkhokha: MaMzobe outsmarts Gabisile but Difa's suspicion rises

Tonight on Umkhokha: MaMzobe outsmarts Gabisile but Difa's suspicion risesDon't miss Thursday, 28 March's riveting episode of South African soapie U...

28/03/2024

Tonight on Uzalo: Mbatha wins Linda Sibiya over

Tonight on Uzalo: Mbatha wins Linda Sibiya overDon't miss Wednesday, 27 March's riveting episode of South African soapie Uzalo on SABC 1 on DStv channel...

28/03/2024

Generations: The Legacy - Wednesday's episode, 27 March 2024 [VIDEO]

Generations: The Legacy - Wednesday's episode, 27 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The S...

28/03/2024

Prison Journalism: Witness the Cycle from the Streets

Prison Journalism: Witness the Cycle from the StreetsWesley Leong was incarcerated at the age of 15 in 1996 at Pollsmoor Prison. He is currently part of Restore...

28/03/2024

Prison Journalism: Inmate pre-release and release processes

Prison Journalism: Inmate pre-release and release processesDean Mashimbwe, a Zimbabwean migrant residing in Cape Town, was incarcerated at Pollsmoor Correctiona...

28/03/2024

Streaming today: When You Finish Saving The World' on Netflix - 28 March 2024

Streaming today: When You Finish Saving The World' on Netflix - 28 March 20...

28/03/2024

Prison Journalism: The Story of Paulus

Prison Journalism: The Story of PaulusDavid van Nek was incarcerated in Pollsmoor Prison from 2013 until 2015 and participated in the restorative justice progra...

28/03/2024

Prison Journalism: Inside and Outside

Prison Journalism: Inside and OutsideFawaaz Adendorff was incarcerated in Pollsmoor Correctional Centre and participated in a Restorative Justice programme whil...

28/03/2024

Tonight on Muvhango: Imani escapes Khumo's hellhole

Tonight on Muvhango: Imani escapes Khumo's hellholeDon't miss Thursday, 28 March's riveting episode of South African soapie Muvhango on SABC 2 on DS...

28/03/2024

Tonight on Generations: Kea can sense her brother is hiding something

Tonight on Generations: Kea can sense her brother is hiding somethingDon't miss Thursday, 28 March's riveting episode of South African soapie Generation...

28/03/2024

Tonight on Smoke and Mirrors: Magolide and Tiny compete against each other

Tonight on Smoke and Mirrors: Magolide and Tiny compete against each otherDon't miss Thursday, 28 March's riveting episode of South African soapie Smoke...

28/03/2024

Tonight on Champions: Washington's struggle takes an unexpected turn

Tonight on Champions: Washington's struggle takes an unexpected turnDon't miss Thursday, 28 March's riveting episode of South African soapie Champio...

28/03/2024

Tonight on Scandal: Tibi's meltdown softens a teacher

Tonight on Scandal: Tibi's meltdown softens a teacherDon't miss Thursday, 28 March's riveting episode of South African soapie Scandal! on e.tv on DS...

28/03/2024

Tonight on Gqeberha: Lulama tells Thulani that she's pregnant with his child

Tonight on Gqeberha: Lulama tells Thulani that she's pregnant with his childDon't miss Thursday, 28 March's riveting episode of South African soapie...

28/03/2024

Tonight on My Brother's Keeper: Ndumiso has the wrong end of the stick

Tonight on My Brother's Keeper: Ndumiso has the wrong end of the stickDon't miss Thursday, 28 March's riveting episode of South African soapie My Br...

28/03/2024

Tonight on Skeem Saam: Lehasa doubles down on his ill-treatment of Pretty

Tonight on Skeem Saam: Lehasa doubles down on his ill-treatment of PrettyDon't miss Thursday, 28 March's riveting episode of South African soapie Skeem ...

28/03/2024

Smoke and Mirrors: Wednesday's episode, 27 March 2024 [VIDEO]

Smoke and Mirrors: Wednesday's episode, 27 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South Af...

28/03/2024

Muvhango: Wednesday's episode, 27 March 2024 [VIDEO]

Muvhango: Wednesday's episode, 27 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South African web...

28/03/2024

Gqeberha: The Empire - Wednesday's episode, 27 March 2024 [VIDEO]

Gqeberha: The Empire - Wednesday's episode, 27 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The Sout...

28/03/2024

Skeem Saam: Wednesday's episode, 27 March 2024 [VIDEO]

Skeem Saam: Wednesday's episode, 27 March 2024 [VIDEO]Missed an episode of Skeem Saam? No problem! Watch the latest episode of your favourite South African ...

28/03/2024

House of Zwide: Wednesday's episode, 27 March 2024 [VIDEO]

House of Zwide: Wednesday's episode, 27 March 2024 [VIDEO]Stay up to date with the latest episode of South African soapie House of Zwide on The South Africa...

28/03/2024

My Brother's Keeper: Wednesday's episode, 27 March 2024 [VIDEO]

My Brother's Keeper: Wednesday's episode, 27 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The So...

28/03/2024

Uzalo: Wednesday's episode, 27 March 2024 [video]

Uzalo: Wednesday's episode, 27 March 2024 [video]Stay up to date with the latest episodes of your favourite South African soapie on The South African websit...

28/03/2024

Scandal!: Wednesday's episode, 27 March 2024 [VIDEO]

Scandal!: Wednesday's episode, 27 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South African web...

28/03/2024

Umkhokha: The Curse - Wednesday's episode, 27 March 2024 [VIDEO]

Umkhokha: The Curse - Wednesday's episode, 27 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South...

27/03/2024

Tonight on Generations: Hlomla is shaken that he came face to face with the stalker

Tonight on Generations: Hlomla is shaken that he came face to face with the stal...

27/03/2024

Tonight on Smoke and Mirrors: Tiny and Magolide plot to get the Managerial position

Tonight on Smoke and Mirrors: Tiny and Magolide plot to get the Managerial posit...

27/03/2024

Tonight on Skeem Saam: Oritonda gets to shine and it all seems to be going well for him

Tonight on Skeem Saam: Oritonda gets to shine and it all seems to be going well ...

27/03/2024

Tonight on Muvhango: Khumo, who is out on bail, tortures Imani

Tonight on Muvhango: Khumo, who is out on bail, tortures ImaniDon't miss Wednesday, 27 March's riveting episode of South African soapie Muvhango on SABC...

27/03/2024

Scandal!: Tuesday's episode, 26 March 2024 [VIDEO]

Scandal!: Tuesday's episode, 26 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South African websi...

27/03/2024

House of Zwide: Tuesday's episode, 26 March 2024 [VIDEO]

House of Zwide: Tuesday's episode, 26 March 2024 [VIDEO]Stay up to date with the latest episode of South African soapie House of Zwide on The South African ...

27/03/2024

Generations: The Legacy - Tuesday's episode, 26 March 2024 [VIDEO]

Generations: The Legacy - Tuesday's episode, 26 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The Sou...

27/03/2024

Streaming today: The Believers' on Netflix - 27 March 2024

Streaming today: The Believers' on Netflix - 27 March 2024Looking for something to watch tonight? Check out all the new streaming releases from all your fa...

27/03/2024

Tonight on Uzalo: Mondli thinks he may have an idea who robbed the police station

Tonight on Uzalo: Mondli thinks he may have an idea who robbed the police statio...

27/03/2024

Tonight on House of Zwide: Faith leaves Funani due to unappreciated support, despite Funani's pleas

Tonight on House of Zwide: Faith leaves Funani due to unappreciated support, des...

27/03/2024

Tonight on Umkhokha: MaMzobe tries to threaten Gabisile to not tell

Tonight on Umkhokha: MaMzobe tries to threaten Gabisile to not tellDon't miss Wednesday, 27 March's riveting episode of South African soapie Umkhokha: T...

27/03/2024

Tonight on My Brother's Keeper: Ndumiso threatens to move out of home over his parent's disrespect of his wife

Tonight on My Brother's Keeper: Ndumiso threatens to move out of home over h...

27/03/2024

Tonight on Gqeberha: Stokkie makes a major move for his future

Tonight on Gqeberha: Stokkie makes a major move for his futureDon't miss Wednesday, 27 March's riveting episode of South African soapie Gqeberha: The Em...

27/03/2024

Tonight on Scandal: A young girl brings a dark cloud into her family's home

Tonight on Scandal: A young girl brings a dark cloud into her family's homeDon't miss Wednesday, 27 March's riveting episode of South African soapie...

27/03/2024

Tonight on Champions: Lebo gets career-changing news, but Ferrari looms large

Tonight on Champions: Lebo gets career-changing news, but Ferrari looms largeDon't miss Wednesday, 27 March's riveting episode of South African soapie C...

27/03/2024

Gqeberha: The Empire - Tuesday's episode, 26 March 2024 [VIDEO]

Gqeberha: The Empire - Tuesday's episode, 26 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South ...

27/03/2024

Muvhango: Tuesday's episode, 26 March 2024 [VIDEO]

Muvhango: Tuesday's episode, 26 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South African websi...

27/03/2024

Smoke and Mirrors: Tuesday's episode, 26 March 2024 [VIDEO]

Smoke and Mirrors: Tuesday's episode, 26 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The South Afri...

27/03/2024

Uzalo: Tuesday's episode, 26 March 2024 [video]

Uzalo: Tuesday's episode, 26 March 2024 [video]Stay up to date with the latest episodes of your favourite South African soapie on The South African website....

27/03/2024

My Brother's Keeper: Tuesday's episode, 26 March 2024 [VIDEO]

My Brother's Keeper: Tuesday's episode, 26 March 2024 [VIDEO]Stay up to date with the latest episodes of your favourite South African soapie on The Sout...

27/03/2024

Skeem Saam: Tuesday's episode, 26 March 2024 [VIDEO]

Skeem Saam: Tuesday's episode, 26 March 2024 [VIDEO]Missed an episode of Skeem Saam? No problem! Watch the latest episode of your favourite South African so...

26/03/2024

Tonight on Uzalo: The nightmare at the police station continues for the worst

Tonight on Uzalo: The nightmare at the police station continues for the worstDon't miss Tuesday, 26 March's riveting episode of South African soapie Uza...

26/03/2024

Tonight on Gqeberha: Gubevu cautions Sivuyile against becoming like his father

Tonight on Gqeberha: Gubevu cautions Sivuyile against becoming like his fatherDon't miss Tuesday, 26 March's riveting episode of South African soapie Gq...

26/03/2024

Tonight on My Brother's Keeper: Thoba tells Sbu that Didi likes him but begs his cousin

Tonight on My Brother's Keeper: Thoba tells Sbu that Didi likes him but begs...