{"id":2365,"date":"2008-09-23T21:52:47","date_gmt":"2008-09-23T21:52:47","guid":{"rendered":"http:\/\/dev.adambowie.com\/2008\/09\/audio_to_text\/"},"modified":"2008-09-23T21:52:47","modified_gmt":"2008-09-23T21:52:47","slug":"audio_to_text","status":"publish","type":"post","link":"https:\/\/dev.adambowie.com\/blog\/2008\/09\/audio_to_text\/","title":{"rendered":"Audio To Text"},"content":{"rendered":"<p>Over the last few years, I&#8217;ve tried to look at lots of different ways to turn audio into text &#8211; ideally cheaply or even freely.<br \/>\nWorking for a radio station, even one that largely plays out music, being able to search audio to find when a presenter said or mentioned something would be incredibly useful.<br \/>\nI&#8217;ve seen a very expensive product tested a couple of times which has been pretty fitful in working well &#8211; and even though one radio group did buy it one stage, it&#8217;s never been fully utilised. There are also services like Blinkx that seem to do a pretty good job in a controlled environment.<br \/>\nA regular example seems to be based around the BBC News channel. The transcription of what presenters are saying is remarkably accurate &#8211; even for far flung place names. But systems can be pointed towards the BBC News website for appropriate names and words to help those trickier phrases.<br \/>\nSo it was interesting to see two different takes on this problem in the last week or so. First of all Andy Baio has <a href=\"http:\/\/waxy.org\/2008\/09\/audio_transcription_with_mechanical_turk\/\">published details<\/a> of how he went about getting an interview he&#8217;d conducted transcribed so that he could place it on his website. Essentially he chopped the interview into small nuggets, and then used Amazon&#8217;s Mechanical Turk to get transcriptions of what was said. He&#8217;s very happy with the outcome.<br \/>\nA couple of years ago, Virgin Radio tried something very similar with our &#8220;Snoop Log.&#8221; Everytime a DJ opens a fader, we record what he or she is saying. That&#8217;s put into a database alongside details of track listings and adverts so that we have a record of what was played out. If we could also get hold of a transcription of what was said, we&#8217;d have a fully indexable database of our output.<br \/>\nDJ links tend to be pretty short &#8211; often well under a minute. So the individual &#8220;chunks&#8221; are ready made. It&#8217;s easy to transcode them to mp3 or whatever would be appropriate. The difficulty comes from the song titles and artists. If you live in India and English is perhaps a second language, then the exact spelling of &#8220;The Kings of Leon&#8221; might be tricky for you.<br \/>\nThe test wasn&#8217;t a success. Now it might be that we didn&#8217;t offer enough cash to get better quality translators, or perhaps if we&#8217;d embedded the audio in a Flash player, that might have helped. One way or another &#8211; we didn&#8217;t take it forward.<br \/>\nThere are other transcription services that ride on the back of the Amazon Mechanical Turk and cost more than the DIY option. But then they offer higher quality output. It&#8217;s a question of cost for a commercial radio station versus value of the output. It&#8217;s certainly something to revisit.<br \/>\nThe other fascinating development has come from Google and its &#8220;<a href=\"http:\/\/labs.google.com\/gaudi\">Gaudi<\/a>&#8221; service which has just launched. Initially concentrating on political speeches, the service allows you to search for words within those speeches and jump to the correct part of the video.<br \/>\nNow obviously from a radio perspective, this could be done just as easily with an audio only stream.<br \/>\nBut I&#8217;d still love to know to what extent the service is <I>only<\/I> using audio. It&#8217;s quite clear that pretty much every political speech is captured in text form in one place or another. That&#8217;s what allows talented souls to put together videos of politicians &#8220;singing along&#8221; to songs like &#8220;<a href=\"http:\/\/www.youtube.com\/watch?v=65I0HNvTDH4\">Never Gonna Give You Up<\/a>.&#8221; So is Google using text alongside video\/audio to pattern match?<br \/>\nAnyway, it&#8217;s promising, and surely in time, we&#8217;ll truly be able to search audio.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Over the last few years, I&#8217;ve tried to look at lots of different ways to turn audio into text &#8211; ideally cheaply or even freely. Working for a radio station, even one that largely plays out music, being able to search audio to find when a presenter said or mentioned something would be incredibly useful. [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/dev.adambowie.com\/blog\/wp-json\/wp\/v2\/posts\/2365"}],"collection":[{"href":"https:\/\/dev.adambowie.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dev.adambowie.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dev.adambowie.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/dev.adambowie.com\/blog\/wp-json\/wp\/v2\/comments?post=2365"}],"version-history":[{"count":0,"href":"https:\/\/dev.adambowie.com\/blog\/wp-json\/wp\/v2\/posts\/2365\/revisions"}],"wp:attachment":[{"href":"https:\/\/dev.adambowie.com\/blog\/wp-json\/wp\/v2\/media?parent=2365"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dev.adambowie.com\/blog\/wp-json\/wp\/v2\/categories?post=2365"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dev.adambowie.com\/blog\/wp-json\/wp\/v2\/tags?post=2365"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}