Is AI really ready to generate your training materials? In this episode, Sarah O’Keefe and Alan Pringle tackle the trends around AI in learning content. They explore where generative AI adds value—like creating assessments and streamlining translation—and where it falls short. If you’re exploring how AI can fit into your learning content strategy, this episode is for you.

Sarah O’Keefe: But what’s actually being said is AI will generate your presentation for you. If your presentation is so not new, if the information in it is so basic that generative AI can successfully generate your presentation for you, that implies to me that you don’t have anything interesting to say. So then, we get to this question of how do we use AI in learning content to make good choices, to make better learning content? How do we advance the cause?

Related links:

• Synthetic audio example: Strategies for AI in technical documentation (podcast, English version)
• LearningDITA: DITA-based structured learning content in action (podcast)
• How CompTIA rebuilt its content ecosystem for greater agility and efficiency (webinar)
• Transform L&D experiences at scale with structured learning content (podcast)
• Overview of structured learning content
• Get monthly insights on structured content, futureproof content operations, and more with our Illuminations newsletter

LinkedIn:

• Sarah O’Keefe
• Alan Pringle

Transcript:

Introduction with ambient background music

Christine Cuellar: From Scriptorium, this is Content Operations, a show that delivers industry-leading insights for global organizations.

Bill Swallow: In the end, you have a unified experience so that people aren’t relearning how to engage with your content in every context you produce it.

Sarah O’Keefe: Change is perceived as being risky, you have to convince me that making the change is less risky than not making the change.

Alan Pringle: And at some point, you are going to have tools, technology, and process that no longer support your needs, so if you think about that ahead of time, you’re going to be much better off.

End of introduction

Alan Pringle: Hey everybody, I am Alan Pringle, and today I’m talking to Sarah O’Keefe.

Sarah O’Keefe: Hey everybody, how’s it going?

AP: And today, Sarah and I want to discuss artificial intelligence and learning content. How can you apply artificial intelligence to learning content? We’ve talked a whole lot, Sarah, about AI and technical communication and product content, let’s talk more about learning and development and how AI can help or maybe not help putting together learning content. So how is it being used right now? Let’s start with that. Do you know of cases? I know of one or two, and I’m sure you do too.

SO: Yeah. So the big news, the big push, is AI in presentations. So how can I use AI to generate my presentation? How can it help me put together my slides? Now, the problem with that from our point of view, for those of you that have been listening to what we’re saying about AI, this will be no surprise whatsoever, I think this is all wrong. It’s the wrong strategy, it’s the wrong approach. If you want to take AI and generate an outline of your presentation and then fill in that outline with your knowledge, that’s great, I think that’s a great idea. Also, if you have existing really good content and you want to take that content and generate slides from it, I don’t have a problem with that. But what’s actually being said is AI will generate your presentation for you. If your presentation is so not new, if the information in it is so basic that generative AI can successfully generate your presentation for you, that implies to me that you don’t have anything interesting to say.

AP: And you’re going to say it with very pretty generated images and a level of authority that makes it sound like there’s something that’s actually there when it’s not.

SO: Oh, yeah. It’ll look very plausible and authoritative and it will be wrong, because that’s how this generative stuff-

AP: Or not even wrong, surface-skimmy, just nothing of any real value there.

SO: Yeah. So then, we go into this question of, how do we use AI in learning content to make good choices, to make better learning content, how do we advance the cause?

AP: Well, there’s that one case where we have done it, because we have our own learning site, LearningDITA.com, and we were trying to think about ways to apply AI to our efforts to create courses, to tell people how to use the DITA standard for content. And I think you and I both agree, one of the strengths of artificial intelligence is its ability to summarize and synthesize things, I don’t think that’s controversial. So if you think about writing assessments from existing content in a way that’s summarizing, so one of us suggested to our team, why don’t y’all try that and see what these AI engines can do to generate questions from our existing lesson content. And then, of course, we suggested that they—the people who were creating the courses—review them. So our folks reviewed them, and I think some of the questions were actually quite usable, decent.

SO: And some of them were not.

AP: True, this is true.

SO: But the net of it was they saved a bunch of time, because they said, “Generate a bunch of assessment questions,” they went through them, they fixed the ones that were wrong, they improved the ones that were maybe not the greatest, they got a couple that were actually pretty usable. And so, it took less time to write the assessments than it would’ve taken to do that process by hand, to slowly go through the entire corpus to say, “Okay, what are the key objectives and how do I map that to the assessments?” So that’s a pretty good example, I think, of using generative AI, as you said, to summarize down, to synthesize existing content. On the LMS side, so when we start looking at learning management systems and how the learning content goes into the LMS and then is given or delivered to the learner, there are some big opportunities there, because if you think about what it means for me as a learner, as a person taking the course, to work my way through course material, maybe the assumptions that the course developer made about my expertise were too optimistic. I’m really struggling with this content, it’s trying to teach me how to use Photoshop and I am just not good at Photoshop. There’s this idea of adaptive learning, this is not an AI concept, the idea behind adaptive learning is that if you’re doing really well, it goes faster. If you’re struggling, it goes deeper, or maybe you do better with videos than you do with text, or vice versa. It’s that adapt to the learner and to the learner’s needs in order to make the learning more effective. Now, if you think about that, that is a matter of uncovering patterns in how the learner learns and then delivering a better fit for those patterns. Well, that’s AI. AI and machine learning do a great job of saying, “Oh, you seem to be preferring video, so I’m going to feed you more video.” Now, we can do this by hand or we can build it in with personalization logic, but you can also do this at scale with AI and machine learning. So there are definitely some opportunities to improve adaptive learning with an AI backbone.

AP: I think it’s worth noting at this point, when you’re talking about gathering the data to make, I hate to, I’m going to personalize AI, so it can make these decisions or do the synthesis, there’s got to be intelligence that’s built into your content, and that goes all the way back to the content creation, going back from the presentation layer, back to how you’re creating your content. And again, this loops back, in my mind, to the idea of building in that intelligence with structured content, that is your baseline.

SO: Yeah. I know we’re just relentless on this drum of you need structured content for learning content, but it’s because of all these use cases, because as you try to scale this stuff, this is what you’re going to run into. I also see a huge opportunity for translation workflows specifically for learning content. So if you look at translation and multilingual delivery, there’s a lot of AI and machine learning going on in machine translation. So now, we think a little bit about what that means for learning content, and of course, all of the benefits that you get just in general from machine translation still apply, but the one that I’m looking at that I think would be really, really interesting to apply to learning is learning has a lot of audio in it, audio and video, but specifically audio, and audio typically is going to be bound to a language. You’re going to have a voiceover, you’re going to have a person saying, “Here’s what you need to know, and I’m going to show you this screenshot,” or, “I’m going to show you how to operate this machine.” And so, you’ve got audio and potentially captions that are giving you the text or the audio that goes with that video. Okay, well, we can translate the captions, that’s relatively easy, but what about the voiceover? And the answer could be that you do synthetic voiceovers. So you take your original, let’s say, English audio and you turn it into French, Italian, German, Spanish or whatever else you need, but you synthesize the voice instead of re-recording. Now, is it going to be as good as a human, an actual human person who has expression and emotion in their delivery? No. Is it better than the alternative where you don’t provide it in the target language at all? Probably, yes. And when we start talking about machines, “Here is how to safely operate this machine,” the pretty good synthetic voice in target language is probably better than, “Here it is in English, deal with it,” or, “Here it is in English with a translated caption in German, but no audio.” I think that’s what we’re looking at is, is the synthetic audio good enough that it will improve the learner experience, and I think the answer is yes.

AP: I’m turning this over in my mind, and there’s part of me that’s very resistant to the idea of these synthesized voices. For example, and this is bias on my part, when I am downloading audiobooks from the library, they now, in the app that I use that’s connected to the local library, a lot of the narration, it will say, “This is an AI-generated voice.” I tend to avoid those, I do, because sometimes the inflection’s a little odd, there’s no personality there. However, I can buy that having that slightly robotic-esque voice in another language is better than not having it at all, I can buy that.

SO: Right. And I think the audiobooks that we listen to for fun are different than I need to figure out how to use this machine without hurting myself, those are different, and I don’t need a… It wouldn’t hurt. I don’t need a personable obviously human voice to voiceover the video that helps me figure out how to use this thing on the factory floor. I wouldn’t object, but I would prefer to get something in my language. That’s really the key, because when we start asking the question, the question is less, would you prefer a really good artistic performance voiceover versus a robotic voice… That’s what you’re getting from the library, you’re saying, I am not going to consume entertainment content that is like this, and I think a lot of people are onboard with that. But what about technical product and learning content that you need? You’re not making a choice that this is something I want to do in my downtime, but rather, if I can’t figure out how to do this, bad things will happen.

AP: Yeah. There is a legitimate use case there, and they’re two different things, and I do think, based on some of the synthetic voices I’ve heard, they are getting better, quite better, and sounding a little more realistic as well.

SO: Right. We’ve already experimented with this. We have a podcast where we actually generated, it was a synthetic voice, but it was based on a person’s voice print. So it wasn’t fake AI, it was fake AI voice, but it was fake AI voice generated off of a specific person. The audio is quite good. Every once in a while between paragraphs, it shifts weirdly as you’re listening, as a new thought is introduced, and it shifts in ways that a human would not, but all in all, I thought it was pretty acceptable. So I think that what I’m trying to say in an extremely long-winded way is that when you have scalability issues in your content production, learning content or otherwise, AI has the potential to help you with productivity across multichannel workflows with repurposing content from it’s the learning content versus it’s the assessments, it’s in language A versus language B, it’s audio, it’s video. There are things that we can do there to use the AI tools for productivity to support these workflows and scale them, and to your point, and therefore, we need underlying structured content. We can’t do this with slapped-together one-off formatted mess.

AP: Yeah. The intelligence has to be built in at the very foundation, and that is when you are creating the content. That intelligence really can’t be a layer that’s put on when you transform things or you connect to an LMS, it’s not a presentation layer thing. The presentation layer needs to pull that intelligence from your source content. Again, this is why you need structured content, the metadata built in, to help drive the way you transform and distribute your learning content.

SO: Yeah. I’m, again, very skeptical of GenAI in the process of generating net-new content, new information, nobody’s ever written it before, it’s a new product, it needs to be explained, taught, whatever. Maybe an outline, this is what a typical intro course looks like, now go fill in the details, okay, maybe even a first draft, especially if product A is based on product B, or I guess the other way around. But our world is structured content, obviously, but also our world is content where it matters that the content is accurate, because when the content is wrong, bad, bad things happen, people get hurt, people die, companies get shut down for compliance reasons, that type of thing. So the content has to be accurate, and at the end of the day, it’s actually quite difficult to get GenAI to gen accurate content. That’s not what it does; that’s not its function. So I’m very interested in applying AI to various product and content roadmaps to enable productivity, to enable new deliverables, to enable new synthesis summaries, et cetera, but I’m very, very worried about what happens if you apply it on top of bad content or you apply it to the wrong use case in an effort to just get your stuff for free, essentially.

AP: So what I’m hearing in summary is that content creation for learning, AI is probably not a good fit now. To support you and help you possibly develop on the edges of that content or give you outlines and ideas, and also to augment and support delivery channels, it could be helpful. So it’s a support mechanism for the development of the content, distribution of the content, but not necessarily for the direct creation of that content.

SO: Yeah, I think that’s fair, and I think that’s where we land. I’d be quite curious to hear from our listeners, what they’re doing with this and where they’re going with it.

AP: And I’m sure people are having the same struggles right now over the best way to apply it. But I think right now, as of the moment that we’re recording this, AI is in no way ready for prime time to basically take the place of a learning content person. It should be there to support them, not to replace them.

SO: Yeah, for meaningful content.

AP: Exactly.

SO: And if it’s not meaningful, what are you even doing?

AP: Right.

SO: Well, that’s cheery, okay.

AP: And on that very cheerful note, we’re going to wrap up. So thank you, Sarah. And folks, do get in contact with us to let us know how you’re using AI, because that is of great interest to us. So thank you. Thanks, Sarah.

SO: Thank you. And maybe let us know how you’re being made to use AI.

AP: That too. Thanks, everyone.

Conclusion with ambient background music

CC: Thank you for listening to Content Operations by Scriptorium. For more information, visit Scriptorium.com or check the show notes for relevant links.

Questions about this podcast? Let’s talk! /* "function"==typeof InitializeEditor,callIfLoaded:function(o){return!(!gform.domLoaded||!gform.scriptsLoaded||!gform.themeScriptsLoaded&&!gform.isFormEditor()||(gform.isFormEditor()&&console.warn("The use of gform.initializeOnLoaded() is deprecated in the form editor context and will be removed in Gravity Forms 3.1."),o(),0))},initializeOnLoaded:function(o){gform.callIfLoaded(o)||(document.addEventListener("gform_main_scripts_loaded",()=>{gform.scriptsLoaded=!0,gform.callIfLoaded(o)}),document.addEventListener("gform/theme/scripts_loaded",()=>{gform.themeScriptsLoaded=!0,gform.callIfLoaded(o)}),window.addEventListener("DOMContentLoaded",()=>{gform.domLoaded=!0,gform.callIfLoaded(o)}))},hooks:{action:{},filter:{}},addAction:function(o,r,e,t){gform.addHook("action",o,r,e,t)},addFilter:function(o,r,e,t){gform.addHook("filter",o,r,e,t)},doAction:function(o){gform.doHook("action",o,arguments)},applyFilters:function(o){return gform.doHook("filter",o,arguments)},removeAction:function(o,r){gform.removeHook("action",o,r)},removeFilter:function(o,r,e){gform.removeHook("filter",o,r,e)},addHook:function(o,r,e,t,n){null==gform.hooks[o][r]&&(gform.hooks[o][r]=[]);var d=gform.hooks[o][r];null==n&&(n=r+"_"+d.length),gform.hooks[o][r].push({tag:n,callable:e,priority:t=null==t?10:t})},doHook:function(r,o,e){var t;if(e=Array.prototype.slice.call(e,1),null!=gform.hooks[r][o]&&((o=gform.hooks[r][o]).sort(function(o,r){return o.priority-r.priority}),o.forEach(function(o){"function"!=typeof(t=o.callable)&&(t=window[t]),"action"==r?t.apply(null,e):e[0]=t.apply(null,e)})),"filter"==r)return e[0]},removeHook:function(o,r,t,n){var e;null!=gform.hooks[o][r]&&(e=(e=gform.hooks[o][r]).filter(function(o,r,e){return!!(null!=n&&n!=o.tag||null!=t&&t!=o.priority)}),gform.hooks[o][r]=e)}}); /* ]]> */

"*" indicates required fields

Your name (required)*Your email (required)* Your companySubject (required)*Consulting requestSchedule a meetingLearningDITA.comStoreTrainingOtherYour message*Data collection (required)* I consent to my submitted data being collected and stored. PhoneThis field is for validation purposes and should be left unchanged. /* = 0;if(!is_postback){return;}var form_content = jQuery(this).contents().find('#gform_wrapper_14');var is_confirmation = jQuery(this).contents().find('#gform_confirmation_wrapper_14').length > 0;var is_redirect = contents.indexOf('gformRedirect(){') >= 0;var is_form = form_content.length > 0 && ! is_redirect && ! is_confirmation;var mt = parseInt(jQuery('html').css('margin-top'), 10) + parseInt(jQuery('body').css('margin-top'), 10) + 100;if(is_form){jQuery('#gform_wrapper_14').html(form_content.html());if(form_content.hasClass('gform_validation_error')){jQuery('#gform_wrapper_14').addClass('gform_validation_error');} else {jQuery('#gform_wrapper_14').removeClass('gform_validation_error');}setTimeout( function() { /* delay the scroll by 50 milliseconds to fix a bug in chrome */ }, 50 );if(window['gformInitDatepicker']) {gformInitDatepicker();}if(window['gformInitPriceFields']) {gformInitPriceFields();}var current_page = jQuery('#gform_source_page_number_14').val();gformInitSpinner( 14, 'https://www.scriptorium.com/wp-content/plugins/gravityforms/images/spinner.svg', true );jQuery(document).trigger('gform_page_loaded', [14, current_page]);window['gf_submitting_14'] = false;}else if(!is_redirect){var confirmation_content = jQuery(this).contents().find('.GF_AJAX_POSTBACK').html();if(!confirmation_content){confirmation_content = contents;}jQuery('#gform_wrapper_14').replaceWith(confirmation_content);jQuery(document).trigger('gform_confirmation_loaded', [14]);window['gf_submitting_14'] = false;wp.a11y.speak(jQuery('#gform_confirmation_message_14').text());}else{jQuery('#gform_14').append(contents);if(window['gformRedirect']) {gformRedirect();}}jQuery(document).trigger("gform_pre_post_render", [{ formId: "14", currentPage: "current_page", abort: function() { this.preventDefault(); } }]); if (event && event.defaultPrevented) { return; } const gformWrapperDiv = document.getElementById( "gform_wrapper_14" ); if ( gformWrapperDiv ) { const visibilitySpan = document.createElement( "span" ); visibilitySpan.id = "gform_visibility_test_14"; gformWrapperDiv.insertAdjacentElement( "afterend", visibilitySpan ); } const visibilityTestDiv = document.getElementById( "gform_visibility_test_14" ); let postRenderFired = false; function triggerPostRender() { if ( postRenderFired ) { return; } postRenderFired = true; gform.core.triggerPostRenderEvents( 14, current_page ); if ( visibilityTestDiv ) { visibilityTestDiv.parentNode.removeChild( visibilityTestDiv ); } } function debounce( func, wait, immediate ) { var timeout; return function() { var context = this, args = arguments; var later = function() { timeout = null; if ( !immediate ) func.apply( context, args ); }; var callNow = immediate && !timeout; clearTimeout( timeout ); timeout = setTimeout( later, wait ); if ( callNow ) func.apply( context, args ); }; } const debouncedTriggerPostRender = debounce( function() { triggerPostRender(); }, 200 ); if ( visibilityTestDiv && visibilityTestDiv.offsetParent === null ) { const observer = new MutationObserver( ( mutations ) => { mutations.forEach( ( mutation ) => { if ( mutation.type === 'attributes' && visibilityTestDiv.offsetParent !== null ) { debouncedTriggerPostRender(); observer.disconnect(); } }); }); observer.observe( document.body, { attributes: true, childList: false, subtree: true, attributeFilter: [ 'style', 'class' ], }); } else { triggerPostRender(); } } );} ); /* ]]> */

The post Help or hype? AI in learning content appeared first on Scriptorium.