Ai: The Last Stand of the Ed-Tech™ Grifters

Sal Khan is going to revolutionize Higher Ed. Again. I’m not really going to write about what the idea is here – some are referring to him as “Serial Failure Sal Khan,” so I doubt it will catch on.

People are (rightly so) connecting this “new” idea to past ideas that were supposedly going to revolutionize education: blogs, MOOCs, virtual worlds, learning analytics, Ai, and so on. Ed-Tech™ (as an industry) is littered with tools and designs that failed to revolutionize education.

And yes, I know that some will balk at the idea of constraining Ed-Tech™ to just the companies that sell specific technology to institutions. I get it. There is more to the field than companies. Ed-Tech™ companies don’t care that they are selling education tools anymore than the companies selling parking management technology or food service technology care about parking or food. When I go to visit friends that still work at universities, the systems and technology I use to park there, to eat a meal on campus, to check into their building, etc are occasionally or constantly changing. That technology is sold by companies that don’t really care to be called parking-tech or what ever. Some feel it is a stretch to put the “ed” in Ed-Tech™ – I get it. They are selling surveillance, or grade management, or tracking systems, or other things.

Most of my courses for over a decade were taught through open-source tools. I know there is open education, indie ed-tech, open-source tools, etc. One of my degrees is technically in “Educational Technology,” so I get that there is a lot more to educational technology that just Ed-Tech™ companies.

But those companies are so dominant that you can’t ignore their effect. Plus, you really don’t have “parking-tech thought leaders” out there telling everyone the newest phone app payment method is going to revolutionize the “parking by phone app” world. So that is why I use Ed-Tech™ – I’m not trying to include that local professor hacking and extending open source tools to deliver their course outside of the system. There are powerful, dominant companies out there trying to mold education into their version of “learning” through technology – which is more than a parking technology company trying to get institutions to upgrade to the latest version of their tech.

However, I also disagree with people referring to MOOCs, blogs, virtual worlds as “failed trends.” Those tools still exist to some degree today. Not to mention that they were created well before they became a trend, often by people that usually (although not always) scoffed at the later hype.

Technically speaking, these tools were not the failure. The thought leaders that hyped them were the failures.

For example, MOOCs are credited to George Siemens and Stephen Downes, neither of whom proclaimed these ideas were going to revolutionize education. It was (surprise surprise) Sal Khan that claimed there would be something like 10 universities serving MOOCs to millions of students each. The disconnect between original MOOCs and hype-trend MOOCs was so stark that people came up with terms for each. Remember xMOOCs and cMOOCS? Oh, and MOOCs are still around believe it or not. The actual failure was that of thought leaders that repeated Khans outrageous claims with a straight faces.

While it still might be too early to call Ai a “failed” trend – the numbers are still not good. Just from this week alone, the research is not promising. Workplace surveys are showing that only 13% of the work staff use Ai daily and only 28% use it weekly while at work. Those numbers are only up 1% and 2% from last year, respectively. While 2 in 3 say they are more productive with Ai, deeper dives show that on average employees waste nearly 8 hours (an entire work day) per week fixing Ai outputs (what some cheerfully refer to as “prompt engineering” as if it is a good thing). Just like other research has shown, Ai makes employees feel more productive when they actually are not.

The effectiveness of Ai in education is still not looking good, either. Research is starting to show that there is a “growing body of research suggesting that extensive AI use can distort and dampen users’ thinking and independence.” It also turns out that while there are hundreds of published articles that discuss Ai, very few are about good quality research. This review of K-12 literature, for example, found that “as of October 2025 the Ai Hub for Education Research Repository contained over 800 academic papers relevant to Ai in K-12 education” but “only a small subset (20 papers) produce strong causal evidence.” Those papers generally found that “Ai improves performance with access but when assessed independently without Ai support, effects are mixed” and that “Ai tools can alleviate students’ cognitive burden and foster positive experiences in learning, but can be at the expense of deeper thinking.”

So with the numbers not looking good, you have to wonder why so many are continuing to push the narrative that “Ai is inevitably going to revolution education”?

(And yes, it is a bit head scratching that some who were frustrated at their trend being declared the “future of education” have now jumped on the “Ai is the future of education” train.)

When you look at past hyped trends, there was always something else on the horizon (there was even a report about said horizon). When blogs were being touted as the future of education, there were things like Web3.0 (remember that?) and virtual worlds being developed. When virtual worlds were hot for a half minute, there were MOOCs coming up. After MOOCs, there was learning analytics. I think there was a blip of virtual reality? I probably blinked and missed it. After that was Ai. In fact, Ai was always in the background as something coming at some point.

But what is there after Ai?

I would contend that there really isn’t anything, and that is why the thought leaders and Ed-Tech™ companies are digging in so fiercely on something that is ‘meh’ at best, damaging at worst. Sure, some would say agentic Ai or autonomous robots or things like that are next – but all of those are technically just extensions of Ai.  Without Ai becoming a major thing, those ideas don’t happen either. Ai is (in my best guess, at least) the last stand of the Ed-Tech™ grift, so they have to make it work.

Sure, there will be trends after this. And there will be “innovations” in the surveillance market as well. But what “new” technology – especially one that will “revolutionize” education – will they be able to pivot to after Ai fades? Ai has kind of been considered the pinnacle of computer technology for decades. So that is (to me at least) why you see the thought leaders and companies trying so hard to make it work. Even though it isn’t. We can only hope that the trend will truly die before we run out of water and resources to keep humans running in the aftermath.

Or maybe this is why we see Khan now coming up with an idea that apparently rolls together past trends like MOOCs, Google, and alternative certifications: the future trends in education will just be remixed past trends. Is Sal Khan the first in a line of people trying to be the bubble and squeak of education since he knows there is nothing after Ai? In some ways, that sounds worse than just getting another new hot trend to change the face of education. (With apologies to those that can make really amazing bubble and squeak.)

Statistics, Analytics, Program Evaluation, and the Great Sell-Out

A few years ago, people were signalling the death of the University because new statistics proved the jig was up. Of course, when you hear things like “Thirty-six percent of the students saw no statistically significant gains in their CLA (Collegiate Learning Assessment) scores between their freshman and senior years”, it does sound pretty bad. The CLA is a “widely-used essay test that measures reasoning and writing skills.” So, in other words, college students are not learning to read or write.

But what if we are looking at the numbers in the wrong way?

Take this real life scenario into consideration: a certain college near where I work increased the student body population from 10,000 students to 25,000 students in less than two decades. A 250% increase. Now consider this: has the quality of the average high school graduate really increased by 250% over the past two decades? Has the quality of the average high school graduate really increased at all? Or have colleges lowered their entrance standards? You will find similar statistics in many of your “growing” colleges and universities today. If you do the math, 60% of those students may have not been ready at all for college when they entered.

I’m not trying to say that they shouldn’t be there – I want to see people educated. But in light of the consideration that maybe up to (at least) 60% of the students in any given college may not have even been prepared to be there, a statistic that says that 36% of them didn’t show statistically significant gains might be a small miracle.

Or maybe not – but if we aren’t looking at bigger picture factors in all this data we are gathering… how do we really know what we are looking at?

I know this is old news to people that are really into research and data… but some of this still seems to be shocking people out there. Today we read that “Students Might Not Be ‘Academically Adrift’ After All, Study Finds.” One of the many interesting points in this article is that the authors’ of Academically Adrift might have been incorrectly “translated by some people in politics to say, ‘College doesn’t matter.'”

Some people? Try a lot of people in key positions. People that are now rushing into certain crazes without having a bit of evidence that they work. Which is not a bad idea at an experimental level, but when entire degrees and millions of dollars are thrown at untested ideas just because people didn’t take a more nuanced look at the numbers? That is very dangerous territory for a field that is already teetering on the edge of obscurity, unable to afford another big blow to credibility.

The time of “chilling out” and just “being happy that there is attention to new ideas” is long past. The whole idea of “don’t look behind the curtain, don’t think critically, just ignore the negative because we all need to be shiny happy people that hold hands and sing kumbaya” never really worked for, well, anyone. It sounds cool to say “don’t bash the movement, just move it in the right direction using positive energy” before the sell-out happens… but it is impossible to accomplish that (and it sounds down-right Great Wizard of Oz-ish to say it) once the sell-out has already happened. And I just don’t see how anyone can look at education now and not see that the Great Sell-Out has already started to happen en masse.

I get that people don’t like that the haters are now tossing out the baby with the bathwater.. but is the only other option to keep the bathwater because we like the baby?

Debunking the Industrial Age School Myth

Something about the argument that our “current school system was created in an industrial era and hasn’t changed since” has always not set right with me. A lot of this has to do with the fact that my high school looked nothing like these videos of students on an assembly line with graduation dates stamped on our foreheads. A decade later, the school that I taught at in a  different city didn’t look like that, either. And even schools that I worked with recently in a different part of the state did not look like that.

But maybe that was just my experience. Maybe I was just hitting the same outlier school every time?

Or maybe it really was that the argument itself was invalid and I just didn’t know enough about history to know why.

Mike Caufield posted today about the problems he has with the current ideas of Sugata Mitra, and in doing so he also shed some light on the real problems with the “schools are industrial-age relic” arguments.

Caufield’s summary of his disagreement really tells the whole picture, but it is worth reading the whole article to look at specific historical reasons why he comes to his conclusions:

The history Mitra narrates is this. There once was a race of Victorians. They built a can opener called education, and nobody has changed that can opener since, even though we no longer eat from cans. But we no longer eat from cans! Give me a million dollars, please.

This is what we hear from so many educational reformers today.  No one would deny that our systems are not working and need to be fixed, changed, or re-built from the ground up. But how can we really know what needs to be changed if we are so ignorant of where we have come from and where we currently stand right now? To extend Caufield’s summary into the world of educational reformers, what we are basically getting is this:

But we no longer eat from cans! We eat from plastic containers. So we are going to change the can opener to a plastic container opener thingee (whatever that is – don’t ask us to explain ourselves okay?). Don’t listen to these people saying they don’t need can openers or plastic containers.  Ignore the man behind the curtain and give me a million dollars, please.

More Useless 2012 Predictions

  • Everything from email to libraries to blogs to universities will be declared dead. Again. For the 10th year in a row.
  • People will continue to call for educational reform. Ignoring, of course, the fact that education is constantly reforming and changing and that there are people out there exploring new ideas and concepts.
  • “Experts” will continue to claim that the lecture model is still dominant at universities, even if they can’t quote any evidence to back this claim up. I counted up all of the courses I took in college in the early 1990s that were lecture based it came out to be less than half. I have heard from current students that, at least at this college, that number has gone way down even since then.
  • Several new LMS options will be labeled “Blackboard killers.” But none will make a dent because labeling any tech a “killer” usually dooms its existence.
  • Even more “experts” will claim that colleges are now irrelevant, despite the numerous studies showing that everyone from employers to future students still think they are highly relevant and necessary. Who needs facts and figures when you just want to grind an ax with a society that won’t pay English majors a seven figure salary right after graduation?
  • Despite overwhelming evidence of the educational value of hybrid or fully online courses, many organizations will develop a case of amnesia and claim there isn’t any evidence. I’m looking at you, Idaho.
  • All of us will suddenly remember that we haven’t logged in to Second Life in over a year and then collectedly feel guilty for letting such a great tool slip away.
  • The American people will get so tired of hearing about new technology lawsuits every day that they will write really extra terse Tweets about the big companies. But of course not do anything to stop the insanity of this whole patent lawsuit mess. Really Google, Apple, Motorolla, and others… its getting old.