Podcast Pontifications logo
ABout
About the showPrivacy policyAccessibility statement
Episodes On...
Accessibility of Podcasts
Content Strategy
Continuing Education
Distribution Strategy
Embracing Change
Ethics In Podcasting
Future-Forward Thinking
Growing Your Podcast
Listener Experience
Metrics That Matter
Monetization Efforts
Perspective Shifts
Podcaster Stories
Quality Matters
SEO for Podcasters
Self-Care For Podcasters
EquipmentPFPs

The Future of Closed Captions May Look Like Podcast Karaoke

Legally-mandated closed captioning - not transcripts - may soon be coming to podcasting. The technology to enable this already exists. And it might usher in a re-imagining of what we used to call enhanced podcasts.

Listen to the episode
Read The article

Jones v Gimlet could be a landmark case and possibly a turning point for the disability community’s long-standing struggles for acceptance in podcasting. In short, the class action lawsuit claims that Gimlet Media is violating provisions of the American’s With Disability Act by not providing closed captioning services for content the podcasting company produces.

Yes, you read that right: This lawsuit is about closed captions. And closed captions are not transcripts. 

A transcript is often a single document that can be read on its own vs listening to the audio of a podcast episode. 

Closed captions are the little snippets of text that appear on your television screen, changing scene-by-scene, with rarely more than one or two lines of dialog or narration at a time.

A legal requirement (something-something enforcement, international, exceptions, etc.) for podcasts to include a closed caption option would be of great interest to the community that has hearing loss. I am among their number, in case you didn’t know. I’m fortunate that my hearing loss is correctable. Just like glasses can correct vision, hearing aids make some of our ears function at whatever the equivalent of 20/20 is for hearing. 

But the future triggered if this class action suit prevails is of interest to everyone who listens to podcasts. Not just the 10 - 13% of the population with hearing loss.

Closed Captions Provide A Different Experience

In our house, we always have closed captioning on when we’re watching anything on the television. Subtitles appear when we’re watching tv shows, movies, documentaries, the Hamilton musical, even live sports. Back when we used to watch live sports. 

But let's talk about the elephant in the room: Podcasting is audio, not video. So exactly where would these closed captions for podcasts appear?

In a podcast listening app, of course. Perhaps not Apple Podcasts, Spotify, Pandora, or Google Podcasts. Although they might quickly follow, I think it takes someone creating a podcast listening app that is designed for people with hearing loss -- even those who are completely deaf. That app would, by default, provide closed captions on screen and “to the beat” of the audio that’s playing at that moment.

Overcoming The Technical Hurdle Of Closed Captions For Podcasts

But how is that done on the fly? What about dynamically inserted audio? Isn’t this just one more burden to place on the shoulders of already overworked podcasters and podcast production teams?

All are good questions. But before you get too twisted up in them, I invite you to think back to when you used to go to a noisy bar that had a dozen TVs playing various content. It’s quite possible, assuming the bar owner was respectful of their client tell, that closed captions were playing on one or all of those TVs, since the audio from all the programs playing at-volume and at the same time would make for a rather unpleasant din not conducive to enjoying a plate of loaded nachos and a pitcher of beer.

Those captions that appear on the screen were added in real-time, or at least near-real-time.

And the same goes for your local news programs or a national broadcast from the Rose Garden: Broadcast television already has the technology and processes to handle real-time closed captioning. 

Is it perfect? Not at all, and there’s much room for improvement. But this process mostly works. And it should be a straightforward process to replicate those same processes and technologies to work in a dedicated podcast app on your phone. 

Maybe it has to have a connection to the cloud to do the processing. Maybe it means the media needs to be cached. Maybe it means a delay of a few seconds. Not to diminish the size of the ask, but none of those “maybes” are insurmountable issues. We can work around them.

Does a solution for closed captioning podcasts already exist?

Spoiler: It does. Descript has already implemented the technology to do this. I use their AI engine to make the transcripts of my episodes, but their software does a lot more than that. Descript already “times” the transcription to the audio file. So when you hit “play” in a Descript transcript, the words highlight along with the audio, as you can see in this video:

I didn’t have to do anything other than upload the .mp3 file of this episode to Descript. That’s rather the point!

So the technology exists to do real-time captioning of podcast audio files today. This technology could allow us to have on-screen, real-time captions as the audio is playing. Very much like a karaoke machine, oddly enough. Whatever words are said by the podcaster, their guests, the actors, the narrator... whomever. We can have their actual words display on the screens of our mobile devices in time with the audio as it is playing.

That's great for people like me who are often lazy about wearing our hearing aids. It’s even better for deaf people who today can’t experience the content of the show as it was actually delivered. Not just reading a big document of the words that were said, but a timed delivery of those words as-text as they are presented in the actual audio. 

Now that dramatic pause you put in for effect in your audio delivery is effective in text. And it doesn’t take a lot of imagination to figure out how text treatment, like bold, italics. or emoji 💩 could be used to better communicate emphasis, subtly, or tone. Though I recognize a lot of work would be needed on that front. Baby steps, Evo.

Not All Closed Captioning Is Created Equal

Not all podcasts require “on the fly” captioning. Some of the most popular podcasts have a months-long development cycle per episode. For those, it’s not terribly arduous to imagine the development of an “official” subtitle track as part of the post-production process.

For those shows, they can layer in the text treatments I mentioned to make sure they nail the tone they were looking for. But why stop there?

Since someone is already designing a visual interface layered on top of the audio for consumption in a dedicated app, why not add more than just rich text? Designers could still fulfill the intent -- close captioning for those with hearing loss -- by adding in images and other content that enhances the audio experience. And not just for those with hearing loss. (But that enhancement must primarily benefit the target audience -- those with hearing loss!)

If that reminds of you of enhanced podcasting, it should. And if you’re remembering all the times that enhanced podcasting has been re-invented and failed many, many times over, you are smart to do so.

But keep this in mind: One of the many reasons most of those attempts failed because the end-user -- the everyday podcast listener -- didn’t find the “enhanced” experience compelling enough to change their behavior. 

None of those failed efforts targeted a motivated and underserved audience: those with hearing loss. Instead, the targeted everyone. Or an imagined minority of everyone who wanted to watch their screens while a podcast plays. This new effort is aimed at an actual, real audience who is terribly underserved with today’s listening apps, big and small.

Yes, People With Hearing Loss Consume Podcasts

Even though the pieces exist, I know that building a podcast app that seamlessly handles closed captions -- either generated on-the-fly or baked into the metadata of an episode -- takes work.

But unlike every other podcast app, this podcast app is designed for a specific user base. And 10 - 13% of the population sure sounds like an addressable market to me.

Plus, I think an app like this would have appeal broader than its target base. I put “karaoke” in the title of this episode on purpose. Call me crazy, but an on-screen “follow the text’ experience could be kinda fun for hard-core fans who like memorizing dialog and delivery. Ask me to quote you anything from Snatch. You’ll be amazed. Or horrified at my terrible British accents.

Again, much of the inventing necessary to enable this has been done. Though I’m not the guy who's not going to do any of the work, it seems a straightforward process to assembling those prior inventions in a way to make closed captions for podcasts a very real thing.

Regardless of the outcome of the current lawsuit, it’s good to have this conversation. Anything we can do to make podcasts more accessible is a Very Good Thing, every rational person would agree. You don’t have to be an activist in the disability community to think so.


But maybe you know an activist already? Chances are, they know about the Gimlet v. Jones lawsuit and are rooting for the plaintiff. But they might not have considered the app-based solution. I’d really appreciate it if you sent them a link to this episode. Do it via email, a direct message, or even a text. One-to-one outreach really helps the show grow.

If you like what I'm doing and wish to support my efforts, please go to BuyMeACoffee.com/EvoTerra and buy me a virtual coffee. You can even set up a monthly donation to keep the party going.

I shall be back tomorrow with yet another Podcast Pontifications. 

Cheers!


Published On:
July 15, 2020
Download The Audio FilE
Download icon
Display/Hide Transcript

PPS3E7 The Future of Closed Captions May Look Like Podcast Karaoke - Transcript

Evo Terra: [00:00:00] Legally mandated closed captioning, not transcripts may be coming to podcasting soon. The technology to enable this already exists and it might usher in a re-imagining of what we used to call enhanced podcasts. No, wait, don't skip.

[00:00:21] Hello and welcome to another podcast. Pontifications with me, Evo, Tara. Man, the news has been crazy this week with Jones V Gimlet could be a landmark case and possibly a turning point for the disability community and podcasting together. In short, the class action lawsuit claims that Gimlet media, you know, Gimlet media is not providing closed captioning for the content they produce.

[00:00:53] And that is against, according to the class action lawsuit claims the American disabilities act. Okay. That's the basic general gist of things. Remember not transcripts, not something you can download or a click to and read along with, but closed captioning closed captioning is a little text that appears on the screen of your television.

[00:01:18] As you're watching a scene, not the entire script, just a line or two of text. That's what this is about. Enforcing legally, legally mandating podcasters. Hey, let's at least big podcasters like Hamlet to provide clothes captioning for the community that has hearing loss of which, by the way, have I not mentioned I'm a member?

[00:01:42] Mine is correctable. Just like you can put glasses on to correct your vision. Some of us are lucky enough that we can wear AIDS to make our hearing just the same as it was if we were not, but not everyone. And. It's varying degrees of effectiveness, much like classes are depending on how tough it is. So I don't want to talk about the lawsuit itself.

[00:02:03] I want to talk about the implications and what it might mean if in fact this lawsuit goes through and I don't mean just for the 10% of the population that has hearing loss or is deaf. I'm talking about everybody, how this might benefit everyone. Now in my household, we always have closed captioning on we're watching television.

[00:02:27] The subtitles are always there. If we're watching movies and back when we used to watch live sports, it was always there, but kind of annoying because it didn't really matter to me then. So that's what closed captioning is. We're all, we've all been exposed to it as well. But what I'm thinking about specifically is what closed captioning does for podcasting is, well, first before I do that, let's talk about the, the elephant in the room.

[00:02:50] Hey look, podcasting is an audio medium. Exactly. Where would these closed captions appear you might ask? Well, the answer to that question is in an app. Does that mean Apple podcasts or Spotify or Pandora or Google podcasts? Not necessarily, although they might, but I do think the best opportunity, the first way this could happen is someone could create an app.

[00:03:17] That is designed for people with hearing loss or are completely deaf so that they could get the podcast episodes with closed captioning on them. Now, how you might ask, would that be achieved? Well, Thinking about it this way. If remember, when we used to watch live hockey sports, or any sports or sport hockey, college football, anything on a television at a bar, maybe at a sports bar.

[00:03:41] When we used to go to sports bars, closed captioning works on live events like that. Watch the news and turn on closed captioning. Watch the live news from your local broadcast and turn on closed captioning, you will see in real time words appearing. Are they perfect? Oh, not even a little bit, much like the AI generated transcripts we have in podcasting, but the mechanism exists to do that.

[00:04:08] So it's not all that complicated to take that same technology, whatever that technology is. And make it work in a podcast player that works on your phone. Sure. Maybe it's got a connection up to the cloud. Totally doable. Now, if you say, well, hang on Eva. That's just not practical. There's not enough processing power or it takes an army of people behind the scenes to do this.

[00:04:32] Listen, I remind you that we already have this technology. D script is one of the many companies out there that are doing AI generated transcriptions and lots of other Otter. AI is another with D script. The tool that I use, they already have the words timed to the beat of the podcast. They up here in order you can hit play.

[00:04:59] And the words will right across this big, long text document already built in. Didn't have to do anything other than give the MP3 file to descript

[00:05:09] and let it do it's magic. So the technology exists to do this today. We could have onscreen in real time, much like a karaoke machine. The words. The podcast says the podcaster or the guests, the actors, the whomever. We can have the actual words display on the tiny little screen of our mobile devices as the audio is playing.

[00:05:35] That's great for people like me, who sometimes like to see the words, if we're not wearing our hearing AIDS and it's even better for the deaf people who can't hear at all to see the actual delivery. Not just the words that are being said, but somehow how it's being delivered. Just think for a minute about how much inflection you can get out of something by reading pauses, when the pauses show up.

[00:05:59] How it changes the overall tone. Again, we have this technology today. Thanks. Is it perfect? No, it's not now for the gimlets of the world or the other companies that spend a lot of time, energy and effort producing podcast episodes ahead of time. They're not doing like what I'm doing. Releasing an episode a few hours after it's written those that are putting serious production time into it.

[00:06:23] You'd build in closed captioning. And if that same app we're talking about that displays closed captions with audio, not a big modification to make that also display other rich content. Along with the words that are being spoken in audio, along with those same words being in text, he could also change the pictures and stuff in the background.

[00:06:47] Yes. We're talking about enhanced podcasting. Yes. It has been tried and failed many, many, many times. But not like this, not as a closed captioning tool. That is very helpful for the people with hearing loss. Yes, I get it. But also helpful for people that want to do things like a karaoke style. Why not listen along with your best podcast, buddy, whoever that happens to be behind the microphone and hear the words, but also see them written out as its head that's being said by them.

[00:07:19] I mean, why would you do karaoke? It's kind of weird. I get it. But it thinking about the opportunity to do more with that. Cause sometimes you're in a situation where you can't listen the whole time. Hitting pause is hard. Maybe, maybe reading it. It's a good idea. I don't know. But thinking about this new idea, this new nuance device.

[00:07:39] It's pretty cool. I think it would be a great way for people to enjoy guesting. Who knows maybe. And again, we don't have to do a lot of work to get this done right now says the guy who's not going to do any of that work, but the technology exists. It's a matter of assembling it. In such a way to where it makes sense.

[00:07:58] Now we'll get Gimlet out of this lawsuit. Don't know don't care, but I'm glad we're having the conversation because anything we can do to make podcasts more accessible to the entire. Disabled community. I think it's a very good thing. Two more good things. I also think it's a good thing. Share this episode with someone, maybe they are an activist already in the podcasters with disability space.

[00:08:22] Share this episode, send them an email or a text individually, reach out and tell them to listen to this episode. I would appreciate that in a big way. And if you really like what I'm doing and you want to support the efforts what's going on here, go to buy me a coffee.com/evo Terra, and sign up. You can even put a monthly donation in there which helps keep the show running.

[00:08:44] That's it. Thank you very much. I shall be back tomorrow with yet another podcast. Pontifications cheers.

‍

Watch The video
More Episodes about: 
Accessibility of Podcasts
Comments
Subscribe for free
Listen on SpotifyListen on all Apple DevicesListen on Google PodcastsListen on Amazon MusicListen on PandoraListen on iHeartRadio
Listen In Your Inbox
Podcast Pontifications logo
Podcast Pontifications is produced by Evo Terra. Follow him on Twitter for more podcasting insight as it happens.
© 2020 and beyond. All rights reserved.