Wednesday, April 18

Training as Tic Tacs or Warm Tea

How often have you been in a situation where the training was absolutely wrong for the participant?

I don't mean wrong as in, person will never use these skills, or wrong as in, person should be out selling instead of being in a formal learning program, or wrong as in, this is a very basic program for a very senior person, but wrong as in if a person applies the skills, they will do much worse at their job?

This might be because the program was not fully tested, or the wrong skills for the person.

If the answer is no, that training has never been harmful, then is the corollary true: that training can't do much good? Is training just warm tea and tic tacs to make participants a little better?

I look for evidence that training is getting stronger. Paradoxically, the thing that will be most convincing is a story of a training program actually being disasterously harmful.

Tuesday, April 17

Get to know Lucinda Roy

How many of you knew Lucinda Roy? (I didn’t). How many of you know her now? Probably a lot more.

Our educational institutions were already in a deep crisis and didn’t need a mass killing to help sort things out. But in the midst of a senseless, heart-breaking and deeply troubling tragedy, Lucinda Roy, black, British and a successful writer is the “professor” who out of concern volunteered to handle Cho Seung-Hui face to face in an attempt to penetrate his shell.

Her heroism, which unfortunately took her only as far as the system would allow (raising major questions and boding ill for the future) is matched by her wisdom concerning the use of technology. I refer all of you to this delightful interview about technology in education:

Here are just a few of the key points:

One thing I've learned from this online interaction is that the ways in which we speak to each other [online] are very different from the way we would speak if we were face to face. Students working online are often much more informal early in the semester. Most teachers who love tutorials really love online interaction if it's designed well. You can have the kinds of dialogue you would not normally have in a public space.

We can all draw our own conclusions (and probably already have) about the value of informality!

You cannot learn to write unless you write. When the only channel of communication you have is the online channel, it is amazing how much people will write.

Expression and output are the principal means of learning, not listening and taking notes.

If you have a class of 300 to 400, you cannot teach well using all this interactive technology unless you are also going to build in some personal support behind it. You cannot imagine that you can answer all those queries well and improve the quality of education if you're the only person doing it. It's very frustrating. We do need to think about how anyone experimenting with this new environment has the kind of personnel support that they need. I don't think we do very well at it.

It’s all about organization and responsibility in encouraging and orientating dialogue.

I throw in the next point because I thought it culturally significant and worth reflecting on. Why doesn’t education help us to see what we ingest?

One of the things I see is people selecting from this menu in the cafeteria and making a plate that's so ugly, you really wouldn't want to eat it.

The last one I think no one has any trouble recognizing.

It's confusing also because there are a lot of people suddenly involved in the education process who have their own agendas. Some are from the corporate world and really want to push a particular kind of software as the answer to everything.

Read the interview. And be like me: try to find out more about this amazing woman!

P.S. The interview dates from 1998. She was a pioneer.

Monday, April 16

A lecture format that a sim-person could love

I travel all over the world presenting research and ideas on simulations (typically to a larger group, before working more closely with a smaller group). But I am constantly stuck with the same conundrum - how do you capture the spirit of simulations while presenting material?

(And just to say, I am no Thiagi. I cannot engage and delight anywhere near his level, if at all).

I was at the Army War College on Friday, and tried something for the first time that was really great. I loaded up a copy of my wiki-like blog on each of the student computers. I gave them free permission to unabashedly explore the material while I was talking.

I told them they could go straight to the sim Examples (everything in [brackets] took them to real, outside examples), if they wanted. Or they could explore theory and concepts. They could even drift off to tangential areas like Social Networking.

When I was talking, probably a third didn't hear a word I said - they were off exploring THE SAME MATERIAL, but in a self-directed and more open-ended way. Probably a third did what I would have done - drifted back and forth. And a third actually listened to me.

Clearly, this is a work in progress. But it felt like a major step, at least in my own view of what formal learning can and should be.

Thursday, April 12

Are "inspirational stories" the crack cocaine of our industry?

I have an unpopular suggestion for rebooting the formal learning industries. Let's put a one-year ban on "inspirational stories."

You know what I am talking about: these are the pithy, well rehearsed, well honed, fiction-presented-as-truth stories by "experts/gurus." In these stories, a variation of the hero's journey, an unlikely person is given a daunting task. They are first overcome by the weight of the responsibility, but then rise to the occasion, apply cleverness and fortitude, and end up with a surprising result. They are as accurate to reality as Frank Miller's Spartan story of "300."

Conferences and executive programs are chock full of "inspirational stories." And don't get me wrong - I love them. They are intellectually delightful concoctions, the equivalent of a buttery croissant with fresh preserves - so unbelievably tasty going down, and yet so useless to the system craving nourishment. They make us feel good and full of hope for just long enough to fill out the speaker survey.

I noted in 1999 that corporations were making e-learning content decisions based on bulk (the more courses, with a lower cost-per-course, the better). Then, in 2002, the same corporations complained that e-learning was vacuous. D'oh!

Likewise, we are currently demanding, through buying their books and praising their speeches, some of the smartest people in business to constantly take real-world anecdotes, fluff them up with some best practices, toss in some faux humility, hone their structure and humor in their delivery, and create a steady stream of "inspirational stories." Then we complain when organizations, after digesting a diet of this white bread from both conferences and management training programs, don't do anything different. Double d'oh!

There seems to a group of "story-fanatics" that fit mostly the same, general description.

  • About 45 to 60
  • Love story-telling, and may have studied it, or theater, as a major.
  • Fascinated by the "hero-journey."
  • Don't play computer games or engage in social networking, or have minimally so they can say they have.
  • Adore the medium of video, the constructs of cinema, and, if pushed, will reluctantly agree to the effectiveness of a branching story type of simulation.
  • View the story as the most effective form of learning.
  • Have reams of studies at their fingertips to "validate" their passion.

I am more excited and intrigued by the double aspect of user participation and non-linear content as the cornerstones of effective content. Perhaps the most pithy research for the first, user participation and activity, not just exposure, is cognitively necessary for learning, comes from an old study:

In a famous experiment, Held and Hein (1963) exposed two kittens to nearly identical visual information. This was done by placing one of the kittens (the passive kitten) in a little gondola, and linking it up to a harness worn by the other (active) kitten so that as the active kitten moved about and explored its environment, the passive kitten was moved in exactly the same manner. The result was that only the active kitten developed normal depth perception. The passive kitten, even though its sensory input was nearly identical, did not. (http://mind.ucsd.edu/papers/pisml/pismlhtml/pisml-text.html)

Stories are always a good start. They are critical for building caring. We are as genetically predispositioned to listening to good stories as seeking fire and shelter. But they are just a first, tiny step, the appetizers to real learning's main course.

So, let's go a year without any inspirational stories. Let's push ourselves as the formal learning industries to give up our golden crutch. Let's carefully study the works of people like Thiagi.

There are some people who just can't imagine a learning program without a steady stream of inspirational stories. To these, this very post will get their blood pumping with righteous anger. I have, in their view of the world, slapped my white glove across their face. It is these addicts that most of all need to go without, if only for 12 months.

Monday, April 9

Does LCB need a Code of Conduct?

In light of the stunning news of Kathy Sierra's terrifying experience with death threats and other horrid comments made on her blog, Creating Passionate Users, I'd like to raise the question of whether we need to draft and post a code of conduct.

Some time ago, I posted some basic guidelines for commentors in the FAQ under the question "What can or can't be posted to a comment?". I'd love feedback from any and everyone.
Is this statement strong enough?
Does it include everything it should?
Is is alright to leave it in the FAQ?
Should I put a link to it from the sidebar?
Are there codes of conduct for other blogs we should consider? (I've seen and like Blogher's and the O'Reilly proposed blogging code of conduct)
Should I just wait for the O'Reilly code of conduct to be finalized and use it?
Is this a tempest in a teapot and I should just forget about it?


To date, because we have had an invitation-only author team, posts have not been a problem regarding inappropriate language or threats to others. I have pulled down two posts written by authors for content that was misaligned with LCB's purpose (but unoffensive) and another for being more "novel" in length than "blog post". The only comments I have removed from LCB have been obvious spam or inadvertent duplicate comments.

But as we move toward a more open contribution model, (i.e., The Big Question) the chance of conduct offenses will rise. As blogmeister, it's helpful to have a previously published policy to point to when informing a contributor that they are in violation of that policy and I'm taking down their contribution.

I look forward to reading your thoughts. (I promise, none will be pulled down!)

Saturday, April 7

Genre: Mini game

I think we are going to be using these more for formal learning programs, so I thought I would share a quick overview and, better, some examples:

Mini games: small, easy-to-access games built to be simple and addictive. Mini games are "one-note" in terms of gameplay, often focusing on mastering an action, sometimes with a desired message as a backdrop.

Mini-games are typically for:

Mini games can sometimes provide an awareness of some more complicated issue, such as fit.

Mini games are often created in Adobe Flash, sometimes in less than three weeks.

A simple, elegant sample of pedagogy

Simple Example (click to enlarge the two pictures)

Here is a great, simple example of
Pedagogical Elements. Take two, almost identical pictures of Earth. The first is made up just of accurate simulation elements (if you ignore the corners). Click on it and see if you can make out the details. The second picture adds just a bit of pedagogy. Now click on it, and see how much richness a little pedagogy adds.

Sunday, April 1

April Big Question - ILT and Off-the-Shelf Vendors – What Should They Do?


Like many industries today, there are significant changes going on for Instructor-Led Training (ILT) and Off-the-Shelf Content Vendors today. In recent conversations with different vendors, they cited a variety of pressures that are making their situations increasingly difficult:

On Demand: Customers want to have both up-front training and on-demand materials. However, on-demand materials are perceived to be similar in form to what’s freely available through search.

Smaller Increments: Customers want to purchase training in smaller increments to minimize time away for learning. This causes several problems for ILT and Content Vendors. Scheduling courses in smaller sessions distributed over days or weeks often interferes with a vendors' ability to delivery ILT on-site because the trainer is booked for consecutive days in class. It’s also not clear what pricing models work for these kinds of approaches.

Rates: Rates for people continue to go up, while price points do not. Vendor prices are not likely to increase as additional training options continue to increase ways in which people can learn.

Courseware Quality: Higher quality courseware (simulations, interactive, referenceable, etc.) is more expensive to produce and it is hard to get that expense back from customers unless there’s significant volume. Further, it is often more out of sync with customer demand because of time-to-market issues. This environment makes it easier to justify PowerPoint plus audio type courseware, but customers are never satisfied with the quality.

New Competitors
: If you're in IT - Microsoft and other vendors like to give away training, or bundle it with their software sales. If you are in productivity training, there are excellent resources available for free online around systems like “Getting Things Done” (GTD).

The bottom line is that many vendors are struggling to determine their direction moving forward. And likely, this is not that far away from some of the same struggles faced by services groups inside organizations.

So, this month, The Big Question is...

ILT and Off-the-Shelf Vendors – What Should They Do?


Please answer this question by posting to your own blog or commenting on this post.
(For further help in how to participate via blog posts, see the side bar.)

Points to Consider:
  • What do you believe will be blends that will be succsseful both for learners and from a business model standpoint? In other words, what’s the mix of offerings that can command a high enough price and produced at a cost where the vendor can be profitable?

  • How can ILT providers integrate alternative delivery methods for live training when their trainer resources are often on the road or "in-class" during business hours?

  • Are there other business opportunities to leverage the core competencies and assets of these providers?

  • In today’s world when many referenceable resources are available online to the learner, what is the right model?

  • Is this all hopeless in a Do-It-Yourself world? Should they all get out of the business now?

Participating Blogs:

The Big Question for April has been closed. If you'd still like to submit your post to the April Big Question, please contact the Blogmeister by using the Dear Blogmeister form found at the link at the top of the sidebar or by clicking here.



Jacob McNulty

Revolutions

The Future of Vendors - New Strategies Needed

Dave Lee

eelearning

Buggy Whip Makers

Adele Lim

learning & development

Apr Big Q: ILT & Off-the-shelf vendors - What should they do?

Ray Sims

Sims Learning Connections

ILT and Off-the-Shelf Vendors – What To Do?

Frank Girolami

The FPG Notepad

April's Big Question

Claudia Escribano

LifeLongLearningLab

Thinking about BIG Questions

Guy W Wallace

The Pursuing Performance Blog

The Big Question - ILT and Off-the-Shelf Vendors – What Should They Do?

Karl Kapp

Kapp Notes

Learning Circuits April Big Question: Are We There Yet

Tom Crawford

thcrawford

Learning Circuits Big Question April 2007

Valerie Bock

Collaborative Learning

Formal Content: It's not dead yet!

Clive Shepherd

Clive on Learning

April's big question - backed up at the crossroads

Wendy Wickham

In the Middle of the Curve

What I Need NOW

Tom Haskins

growing changing learning creating

Preparing for changing opportunities

Quintus Joubert

eLearning Blog

PowerPoint vs. interactive learning

Harold Jarche

Harold Jarche

LCB Big Question for April

Tom Haskins

growing changing learning creating

LCB April Question - Leave a clean corpse

Tony Karrer

eLearning Technology

April Big Question - Content Vendor Value

Clark Quinn

Learnlets

Partner & customize




Wednesday, March 21

I'm a little verklempt!

Well in the spirit of community building and the voice of Jay Cross in my head ("just post it to the blog") I'm asking the community what happened this month with The Big Question. For the first five months of The Big Question we've averaged 24 post per month. Currently, March stands at 7 posts.

Help Tony and I examine the situation so we can make The Big Question as vibrant as possible. Did everyone just get busy with other things at the same time? Did you forget about TBQ this month? Did we forget to remind you? Was the question just not of interest to you? Did the Blogger "spam blog" snafu and resulting delay at the beginning of the month throw you off? Are those of you in northern climes suffering from seasonal duldrums (he asks from Palm Springs)?

I'd love to get feedback from as many of you as possible - whether you've contributed to TBQ in the past or not. TBQ has been a great feature to this point and this March sag may just be a blip. But why not discuss it. Process is a part of community building after all.

So in the words of Linda Richmond, "Alright, I'll will give you a topic. The March Big Question: Came in like a Lion and out like a Lamb. What's up with that? Talk amongst yourselves."

Monday, March 5

March Big Question: Supporting New Managers?


Ok, so it looks like Learning Circuits Blog is not a spam blog after all. And that means that we can ask this month's big question - a few days late.

This month's big question actually was a question asked by an attendee at Jay Cross' presentation on informal learning at ASTD TechKnowledge. She was in charge of designing training and support systems to help people transition into management roles throughout the organization (customer service, sales, operations, etc.). She told us that her organization was used to doing this with instructor-led training, but that she wanted to explore a combination of instructor-led, online and informal learning. She wanted suggestions on things she could do, what she needed to consider, and how to balance what approaches were taken.

So, this month, The Big Question is...



What Would You Do to Support New Managers?



Please answer this question by posting to your own blog or commenting on this post.
(For further help in how to participate via blog posts, see the side bar.)

Points to Consider:


  • As much as possible please provide specific suggestions to this person.
  • Since dialog with her is possible at this point, if there are key forks in the road - you just have to tell us about them and the options that exist.

Monday, February 19

It’s a matter of culture

I’d like to follow up on my last post and also weigh in on the question of investment in formal training and informal learning. I tend to see the world through my own professional lens, which is that of culture. Although usually taken to be about the behavioral differences between people of different national, geographical, ethnic, religious origins, culture is everywhere and constitutes a property of all groups. This idea isn’t new to the industrial world, since for the past 20 years or so we have talked about “corporate culture”, which for many more decades has been pro-actively practiced by companies such as IBM (with its now abandoned dress code and "IBMer" identity) or HP, with the “HP Way”. Jack Welch used a much softer and holistic approach at GE, where, as we now know, there was a strong emphasis on informal communication and bottom-up creativity, aiming at creating a learning culture.

Defining or imposing a culture and disseminating its principles aren’t enough to make it effective. The key reason for this is organizational inertia. And consistent with it is the relatively short tenure of CEOs, whose promotion of culture is essential if we wish to maintain any hope for cultural change. Alas, though essential, it isn’t enough, partly because the permanent management -- from divisional directors to line managers, the ones who have to deal with human performance -- see the CEOs as living in a stratosphere that has nothing to do with their lives and their professional objectives (i.e., in most cases, maintaining their jobs). Have any of you tried inviting a group of people in a “teaching situation” to be creative? Even though – depending on the group -- a few voices will inevitably speak up, it generally isn’t creativity that’s expressed but rather “competitive personality”. And its effect is usually to silence the others (the same thing happens in discussion groups, by the way). Department heads live essentially in a world of competitive personality.

I began working on the subject of professional culture when it became a mission critical issue in the 1980s as companies here in Europe began the revolutionary step of introducing the PC into their workspace. This was a major paradigm shift, especially concerning the distribution of power and the status of staff autonomy. It wasn’t an easy ride, but it certainly was an interesting one, and possibly more important in terms of world culture and even geo-politics than the collapse of the Soviet Union. I did a lot of work with one company in the Thomson group where the CEO was on a mission of mondernization. Nobody knew at the time, but he was asked by Thomson’s CEO to prepare this subsidiary of a state-owned company, which possessed a largely military culture and thrived on defense contracts, to be sold to a privately-owned Canadian competitor and to be more active in the civil sphere. My small training/consulting company was asked to prepare the entire staff on two fronts: intercultural (dealing commercially with other countries, including speaking the same language) and adoption of PCs (the machine, the keyboard, DOS, spreadsheets, databases, word processing, etc.). To my surprise, the biggest challenge was getting French males to use a keyboard!

This was an exciting mission and, knowing the CEO had clearly stated his goals, I began by interviewing the department heads whose staff was concerned by the “new culture”. Imagine my disappointment to discover their attitude was unanimously blasé and even dubitative. In the following months, we had some fun and achieved some significant but limited success, until the CEO resigned 18 months later and the great experiment was abandoned (and they never managed to sell off the company). In the meantime I had been co-opted to create a new department of engineering services around training technology (basically, interactive video) to be proposed to the company's clients, so I was no longer involved in the internal training challenge.

We all know now that the teething problems of introducing the PC lasted as long as teething problems tend to last and that, among other things, within three years French males started massively accepting the use of a keyboard. There is little doubt that this happened not because of a massive increase in training (which actually did take place), but because there was a deep cultural shift leading to a much more massive amount of informal exchange. Training helped, but it remained blissfully ignorant of the cultural reality around it. The question we can now ask is, "could it have happened more quickly, more efficiently and at less cost had training departments taken into account the informal?". The answer should be resoundingly “yes”, but as Don Clark points out, there are no “objective statistics” to cite, so that a classic resource management approach is incapable of taking the issue on board.

How could informal learning have been encouraged? First of all, by concentrating the formal training less on the technical skills of the staff and more on the human skills of department heads. It could have included things like group dynamics and communication training, to say nothing of corporate culture itself (which I still don’t see as a significant item in training course catalogues). Although this type of action is formal, it represents a direct investment in informal learning and could be added to the column of strategic investment rather than "just in time" fixes. They could have encouraged rather than neglected the potential of the expensive and hard to deploy groupware (Lotus Notes) they began investing in during the 90s. They could have looked at questions of corporate architecture (some did, by the way, but not necessarily with the conscious idea of stimulating informal professional exchange). They could have adopted an attitude of “visionary evolution” focused on the long term, taking into account human behavior; but of course the obsession with quarterly results still makes that difficult. Executives with long-term vision write books rather than struggling to impose their vision in the real corporate environment they work in.

As this is turning into an essay, I’ll stop here, for reasons of inappropriate length. But I’m sure others will have many things to say to keep the discussion going and tease out the meaning of these issues, including the "how to invest in informal learning". If we could situate the "how to", we might be able to clarify the "how much?".

Sunday, February 18

102 Questions

UPDATE 2/19/07: After an error then a typo, the link below goes to the correct page. Just to be sure, it's http://learningcircuitblog.pbwiki.com/bigquestions and the list is now 112 questions long.

Since I'm not tracking comments this month for The Big Question, I thought I'd do something that I hope will be valuable. I've aggregated all of the questions that have been proposed in the participating blogs. You can find the list, which at the moment stands at 102 questions, on the LCB Discussion Wiki on the Big Questions page.

On the wiki page I describe a few things that I needed to make educated guesses at. If you don't care for how I've presented your question(s), please feel free to edit the table.

Dave Lee
your humble blogmeister

The Numbers Behind Informal & Formal Learning

I recently posted an article on this blog, Investing in Informal Learning. Seeing more in it that what I originally posted, I used it as part of a larger posting on trdev, State of the Learning Industry. Tony Karrer urged me to post it to Learning Circuits as trdev is semi-public in that you have to join the group to view any of the postings (it is free however). For those of you who are not members of trdev, I urge you to join as it is one of the more dynamic and critical T&D discussion groups on the web. However, simply cross-posting the same material holds no real interest to me, so I delved into the subject and thought about it some more. . .

I'm sure most readers of this blog have seen charts similar to this posted throughout the web:



Which of course makes informal learning look like a better investment than formal learning. However, in Training in America, the cost of formal and informal that they give ($30 billion for formal learning and $180 billion for informal learning) means that the true investment for learning should look more like this:



The second chart suggests that "formalizing" the informal learning would now be the better investment in order to make it more efficient. However, in the trdev discussion, Tony suggested that the second chart is not counting the payroll expenditures (soft costs) of the students in the formal learning classes. Thus the formal learning expenditures should be higher. We could argue back and forth about what costs should be included in each one, but we would only be second guessing what the authors actually counted under each form of learning.

Then it dawned on me what the numbers really mean; we are using the government's term of informal and formal learning -- if the money invested in learning falls under a training department's budget, it is counted as formal learning; if it falls only under payroll, then it is being counted as informal learning.

We are using monetary terms to define informal and formal learning. However, I think that most of us would define it more or less as Stephen Downes views it -- if it is managed by the learner it is informal, if it is managed by someone else it is formal.

The government defines OJT and apprenticeship programs as "informal" simply because they normally fall directly under payroll's budget, rather than training's. Yet for the most part, learners are not walking into the workplace and deciding what and how they will learn their job. Rather they are being directed or managed by supervisors and coworkers. The OJT programs are often under the guidance of the training department.

Thus the numbers thrown at us that 80% of the learning in the workplace is informal and 20% is formal is totally misleading, unless of course you want to define formal and informal learning in dollar terms. So what is the real percentage? I doubt if anyone really knows. Besides, I think it would totally depend on the type of workplace itself.

Tuesday, February 13

The wisdom of Jack Welch

I’m not a great believer in leadership training, even though it’s very much the trend. But the fact that such training exists means that there is a problem to be solved. I notice that some of the manuals like to quote the 10 leadership principles of Jack Welch. I’ve copied below the first five:

1. There is only one way - the straight way. It sets the tone of the organisation.

2. Be open to the best of what everyone, everywhere, has to offer; transfer learning across your organisation.

3. Get the right people in the right jobs - it is more important than developing a strategy.

4. An informal atmosphere is a competitive advantage.

5. Make sure everybody counts and everybody knows they count.

Three of them I find vitally interesting for the rethinking of learning. Forget the first, which is there as a kind of shocker, asserting the authority of the leader (what better way to say “I’m Jack Welch, shut up and listen”?). If I wanted to quibble, I’d say that just as there’s no such thing as a free lunch, there’s no such thing as a straight way. All viable ways follow the relief of the land and are therefore not straight, but rather as straight as possible or as straight as management can make them… which means that professional life doesn’t end up looking like a series of right angles.

It starts getting interesting with number 2. Learning is as close to the top as you can get (once you get the phantom straight line out of the way). And notice what it says: learning is everywhere. It doesn’t come from trainers and SMEs. Everyone’s involved. And the need is to transfer, not to teach.

Skip to point 4. What do we find? A celebration of informality, not as a method of learning (who in the organization really cares about learning besides Jack Welch?*) but as a factor of competitive advantage! Put 2 and 4 together and we begin to see how learning organizations may develop.

Point 5 is equally important. How do people show they count and know they count for others? I don’t think Welch is talking about pay packages and brownie points. It’s rather that their voice is heard because they have something to contribute and a forum for making it heard. That forum is the ongoing informal dialogue of an organization where “everyone, everywhere” has something “to offer”. Maybe we should be concentrating on giving shape to that forum by encouraging communities where the dialogue is real and authentic, not polluted by too many "learning points".

Anyway, it's a great honor to welcome Jack Welch to the exclusive club of promoters of informal learning. He deserves to be one of us!

* To answer my own question, I’d say “nobody except the CEO” because everyone else, including the CLO, has a job to do and they all know the criteria on which they will be judged. And it ain’t learning – which is oriented towards the future -- but keeping the machinery going with as few hiccups as possible – which means having one's eye fixed on the present and quarterly results. Having worked closely with a direct disciple of Jack Welch, I know how focused those objectives are.

Sunday, February 11

Pay No Attention to that Man Behind the Curtain

Hi everyone. Some of you may have caught glimpses of some work I'm doing behind the scenes of LCB. If you had a chance to see Peter Isackson's post on improvisational learning from May of 2002 that accidentally was at the top of this page for the last 24 hours or so, you got a glimpse of the future by seeing the past.

I've begun the process of consolidating all of the posts of LCB from 2002 to the present into one environment. This effort is in anticipation of a migration to a new environment sometime in the near future.

If your the type to volunteer to do some grunt work, keep your eyes on this space. As I get a bit more organized and have a feel for the tasks that will need to be completed to achieve the transformation of LCB, I'll be looking for some help. If you can't wait to volunteer, please let me know by commenting on this post and I'll be sure to find something for you to do!

Now, back to the Big Question for now Dorothy, the balloon's not ready to depart for Kansas quite yet!

Friday, February 9

Is it possible to have a universal argument, "Simulations work better than traditional formal learning programs"?

I am often asked to prove that simulations work better than traditional formal learning programs. As a tiny bit of background, I wrote this a few years ago in my column in Online Learning magazine:

"People often ask me what the return on investment (ROI) of e-learning is. I tell them it's 43 percent. How did I come up with that figure? Truth be told, I made it up. That's because knowing the ROI of e-learning is sort of like knowing that the average depth of the ocean is 2.5 miles. Interesting, but not very helpful to a ship's captain."

Given that, I have done some studies for both my own simulations (Virtual Leader), and others (Ngrain). I have interviewed countless practitioners, users, and sponsors. I have been involved in surveys and studies. I have argued that simulations come in genres (such as branching stories), and that analysis should be done at the genre level.

And I still have no idea how to approach that question. I don't even know who is qualified to measure effectiveness, or even define what effectiveness is. Even within a neutral body, there are advocates who do the study.

So what do people think? I am not asking, are simulations more effective? I am asking, what is the simplest argument that you would find compelling?

Friday, February 2

February Big Question: What Questions?


The February Big Question goes to the root of what The Big Question is all about. It is a topic that has bothered Tony for a while. In a session on Informal Learning by Jay Cross, Harold Jarche and Judy Brown at ASTD TechKnowledge, you could easily see great questions getting raised by both the presenters and the audience. "How can I help my organization improve the quality and quantity of conversations?" and “How can I create informal learning experiences for new managers in my organization?" These questions offered a fantastic opportunity for discussion and understanding of the subject.

Tony’s revelation was that one of/if not THE biggest questions facing us is that we don't know the right questions to ask in a given situation. Sometimes we’re asking a question when we should be asking a different one.

So, this month, The Big Question is...

What Questions Should We Be Asking?


Please answer this question by posting to your own blog or commenting on this post.
(For further help in how to participate via blog posts, see the side bar.)

Point to Consider:

  • Feel free to list questions from lots of different perspectives and at lots of different levels.
One last note. Don’t worry about answering the questions you suggest. Perhaps we’ll do that in future.

Participating Blogs:
The form for February's Big Question has been closed. If you have a post in response to the February Big Question, please contact the Blogmeister by using the Dear Blogmeister form which can be linked to from the top of the sidebar.

Clive Shepherd
Clive on Learning
The big question for February: what questions should we be asking?
Tony Karrer
eLearning Technology
Clive Sheppard What Questions
Adele Lim
learning & development
Feb Big Question: What Qs should we be asking?
Karyn Romeis
Karyn's blog
February's big question
Matthew Nehrling
mLearning World
The February Big Question- What Question?
Tom Haskins
growing changing learning creating
Asking the right questions
Clark Quinn
Learnlets
Asking Good Questions
Wendy
in-the-middle-of-the-curve
What Should We Be Asking
Karl Kapp
Kapp Notes
Questions, Questions and More Questions
Ray Sims
Sims Learning Connections
What Questions Should We Be Asking?
Mark Oehlert
e-Clippings
The Big Question about Questions
Dave Lee
eelearning
asking questions
Brent Schlenker
Corporate eLearning Development
The February Big Question
Anil Mammen
Discursive Learning
A Question of Questions
TATA INTERACTIVE SYSTEMS
TIS Corporate Blog
What Questions Should We Be Asking?
Valerie Bock
Collaborative Learning
What Questions Should We Be Asking?
Terrence Seamon
Here We Are. Now What?
The Power in Asking Questions
Jay Cross
Internet Time Blog
Big questions about big questions
Geetha Krishnan
Simply Speaking
Questions, questions
Tony Karrer
eLearning Technology
Is the Big Question Half-Full or Half-Empty?
Jacob McNulty
Revolutions
What's in a Question? Our Future
Tony Karrer
eLearning Technology
Action on Informal Learning - Leads to Great Questions
Tony Karrer
eLearning Technology
Continuing Thoughts on Questions


Wednesday, January 24

If we could ask the schools in the U.S. to do just one thing different, what would it be?

Let me ask you all this one question, which I was asked recently by a well-known governor. If we could change just one thing in the U.S. school system, what would it be?

Is there any chance that we can break the Bryan Chapman critique that we as a community of education and training professionals:
  • all agree on our dislike on the current system and
  • disagree on what to do better.

Could we work together with our various degrees of clout and make things better in the school system? Stage one is brainstorming, so let's air all of the ideas.

Friday, January 19

A Tale of Two Program Pilots

I just got results back from two pilots with the goal of evaluating the same, 15 hour training program.

In one pilot, the program sponsor cajoled a bunch of colleagues into doing the program. He oversold the fun aspects of it, and undersold the real work and time requirement required. Literally less than 20% into the program, the coach had to (appropriately) push on the participants for not doing any of the self-paced work, the participants revolted, the pilot failed, and the program sponsor lost credibility with peers.

In another pilot done during the same period, the program sponsor found real people who would really benefit from the program, and most matched the profiles of future students. The sponsor did a pre 360 on all of the participants, did the 15 hour program, and then did a post 360's to evaluate the program. What they found was incredible. The participants who went through the program went from a pre-test of a "3" to a post-test of "4". That was an entire standard deviation increase, and relatively unheard of for such a program. The participants ranked it as one of their most important growth experience in their professional life. The sponsor gained incredible credibility with his managers, and the program is roaring ahead.

I would say that all of our competencies, learning how to pilot may be the most important, and most lacking.

Friday, January 12

Don't hire me! Evaluate your own training budget in three simple steps

I love doing a good training audit as much as anyone. But you can do a lot yourself. When I review training budgets for clients, one tool I use is to break spending into three categories:

1. The money spent to to fulfill obligations.

These are the funds that are spent doing what the training group had committed to doing in the past. These might include ethics and sexual harassment training, new employee training, HIPPA compliance, and so on.

2. The money spent to reduce the cost of fulfilling the current obligation in the future

These are the funds used to automate processes wherever possible, consolidate vendors, or renegotiate, or find cheaper sources.

3. The money spend to deliver new (hopefully strategic) value.

This is the money spent to do something new. These are the new programs, the new infrastructure, and the new tools. Funnily enough, if companies are doing (1) well, these (3) activities are the only things that get noticed.

So many groups are trapped in (1). The best groups are constantly engaged in (2) and then (3). One "aha," and I think I will get plenty of grief here as well for bringing this up, is that often putting resources in making incremental improvements in increasing the end-user satisfaction of (1) training (way different from customer satisfaction in corporate environments), comes out of category (3).