Every once and a while, you see a new “shocking” video that shows some Ai tool passing a test, a module, a course, etc. This is the latest one on TikTok, where they talk about how ChatGPT was enrolled in a Master’s level Health Administration course:

https://www.tiktok.com/@chatedupodcast/video/7473271959862824238

Of course, the way they did this experiment sounds like it could have been fraud, and we should be concerned that people have to break the law to prove these points. And yes, this is also another anecdote that shows that AI detection is not really a thing. But to those saying “if your course can be passed by a bot” or even “this proves how advanced Ai has become”… not so fast.

This video should make one concerned for how society views a “course.” Is it just a thing to tick off a list and get a grade for? Is it the be-all end-all of learning? Is it maybe just one piece in the overall educational journey?

For those that are programming Ai systems, of course it is a big deal that they are getting to the point that the bots can take an entire course. That took a lot of work to get to that point. For the rest of society that has to wrestle with what to do with all this Ai that is being forced on us? Its totally irrelevant that an Ai system can ace a course.

The point of any course is to teach a certain concept to a human, who will then make that learning one part of their overall knowledge of their degree or program. Many courses (maybe even most) are already teaching things that are out there online. Before the Internet, most of the knowledge in courses could be found in books at a decent-sized library. For centuries now, students didn’t just need access to knowledge to learn something. They didn’t even need an external organizing and sensemaking system like a book or bot to help them do something with that information. They needed an expert to guide them in how to engage with the knowledge in a way that will help them use that knowledge to do something in the future (usually work a job in a specific field).

Is it really surprising that an Ai system that has the entire internet stored in its memory can pull up that information when needed? Is it really that impressive that a digital system that can index and search all of that knowledge in the blink of an eye and make the right matches to pass a course? Again, to those that designed said system – of course it is impressive. To the rest of us, if we want to recognize that courses are something more than just a grade… that the reason we structure them the way we do has meaning for something beyond the course… then, no, it doesn’t matter.

The important part about any one single course is not necessarily the passing grade, but the organization of content and activities that are already out there into a structure that teaches the learner a specific way of knowing those random facts and activities in meaningful way for their future use. It was never a system designed to pattern match a bunch of “if/then” statements with instant access to all of the knowledge online.

Again, from a programming perspective – of course that is impressive. From a learning perspective? This is all very unimpressive. Are you smarter than a bot? Of course you are. The bot just has to do a search and match through all the data it has been trained on. You, as a human, had to learn that information and it is mostly not “stored” in your memory very well. In fact, we know that our brains don’t work like computers, so its a bad comparison to even ask if we are “smarter” than a computer. Are “smarts” only based on information we can recall and pattern match? I would argue that once computing power reached the point that it could enable GenAI, it became irrelevant to think of it as “smart.” Well, it never really was a great idea to anthropomorphize Ai. But something like ChatGPT coming with an answer to anything is equivalent to someone that is asked a question about a chart in big letters in front of them and they say the answer by reading the answer straight from the chart. The speed of computing has reached the point that Ai can do that with everything online. Would people think you were that smart if you basically answered everything by using an advanced pattern-recognition based search engine website? Not really. That is what Ai basically is.

But that is probably what we get for calling it “intelligence” in the first place – we evaluate Ai based on how close it gets to mimicking human intelligence, instead of looking at how Ai would be classified if humans did the same thing. In the case of passing a course, even at the Master’s level, its the equivalent of being impressed that a student passed a course when someone was holding up flash cards in front of them with the answers for everything. We need to be concerned with how people are lionizing Ai and undervaluing what learning really is.

Leave a Reply

Your email address will not be published. Required fields are marked *

Your post must include a link to this post.

How does this work?
Write a response on your own website and include a link to this post. Then submit your response’s URL here. Your response may appear here after moderation. To update or remove it, edit or delete your original post and submit the same URL again. Learn more about Webmentions.