Educational Technology: Crash Course Computer Science #39

Educational Technology: Crash Course Computer Science #39


Hi, I’m Carrie Anne, and welcome to Crash
Course Computer Science! One of the most dramatic changes enabled by
computing technology has been the creation and widespread availability of information. There are currently 1.3 billion websites on
the internet. Wikipedia alone has five million English language
articles, spanning everything from the Dancing Plague of 1518 to proper toilet paper roll
orientation. Every day, Google serves up four billion searches
to access this information. And every minute, 3.5 million videos are viewed
on Youtube, and 400 hours of NEW video get uploaded by users. Lots of these views are people watching Gangnam
Style and Despacito. But another large percentage could be considered educational, like what you’re doing right now. This amazing treasure trove of information
can be accessed with just a few taps on your smartphone. Anywhere, anytime. But, having information available isn’t
the same as learning from it. To be clear, we here at Crash Course we are
big fans of interactive in-class learning, directed conversations, and hands-on experiences
as powerful tools for learning. But we also believe in the additive power
of educational technology both inside and outside the classroom. So today we’re going to go a little meta,
and talk specifically about how computer science can support learning with educational technology. Intro Technology, from paper and pencil to recent
machine-learning-based intelligent systems, has been supporting education for millennia
– even as early as humans drawing cave paintings to record hunting scenes for posterity. Teaching people at a distance has long been
a driver of educational technology. For example, around 50 CE, St. Paul was sending
epistles that offered lessons on religious teachings for new churches being set up in
Asia. Since then, several major waves of technological
advances have each promised to revolutionize education, from radio and television, to DVDs
and laserdiscs. In fact, as far back as 1913, Thomas Edison
predicted, “Books will soon be obsolete in the schools… It is possible to teach every branch of human
knowledge with the motion picture. Our school system will be completely changed
in the next ten years.” Of course, you know that didn’t happen. But distributing educational materials in
formats like video has become more and more popular. Before we discuss what educational technology
research can do for you, there are some simple things research has shown you can do, while
watching an educational video like this one, to significantly increase what you learn and
retain. First, video is naturally adjustable, so make
sure the pacing is right for you, by using the video speed controls. On YouTube, you can do that in the right hand
corner of the screen. You should be able to understand the video
and have enough time to reflect on the content. Second, pause! You learn more if you stop the video at the
difficult parts. When you do, ask yourself questions about
what you’ve watched, and see if you can answer. Or ask yourself questions about what might
be coming up next, and then play the video to see if you’re right. Third, try any examples or exercises that
are presented in the video on your own. Even if you aren’t a programmer, write pseudocode
on paper, and maybe even give coding a try. Active learning techniques like these have
been shown to increase learning by a factor of ten. And if you want more information like this
– we’ve got a whole course on it here. The idea of video as a way to spread quality
education has appealed to a lot of people over the last century. What’s just the latest incarnation of this
idea came in the form of Massive Open Online Courses, or MOOCs. In fact, the New York Times declared 2012
the Year of the MOOC! A lot of the early forms were just videos
of lectures from famous professors. But for a while, some people thought this
might mean the end of universities as we know them. Whether you were worried about this idea or
excited by it, that future also hasn’t really come to pass and most of the hype has dissipated. This is probably mostly because when you try
to scale up learning using technology to include millions of students simultaneously with small
numbers of instructional staff – or even none – you run into a lot of problems. Fortunately, these problems have intrigued
computer scientists and more specifically, educational technologists, who are finding
ways to solve them. For example, effective learning involves getting
timely and relevant feedback – but how do you give good feedback when you have millions
of learners and only one teacher? For that matter, how does a teacher grade
a million assignments? Solving many of these problems means creating
hybrid, human-technology systems. A useful, but controversial insight, was that
students could be a great resource to give each other feedback. Unfortunately, they’re often pretty bad
at doing so – they’re neither experts in the subject matter, nor teachers. However, we can support their efforts with
technology. Like, by using algorithms, we can match perfect
learning partners together, out of potentially millions of groupings. Also, parts of the grading can be done with
automated systems while humans do the rest. For instance, computer algorithms that grade
the writing portions of the SATs have been found to be just as accurate as humans hired
to grade them by hand. Other algorithms are being developed that
provide personalized learning experiences, much like Netflix’s personalized movie recommendations or Google’s personalized search results. To achieve this, the software needs to understand
what a learner knows and doesn’t know. With that understanding, the software can
present the right material, at the right time, to give each particular learner practice on
the things that are hardest for them, rather than what they’re already good at. Such systems – most often powered by Artificial
Intelligence – are broadly called Intelligent Tutoring Systems. Let’s break down a hypothetical system that
follows common conventions. So, imagine a student is working on this algebra
problem in our hypothetical tutoring software. The correct next step to solve it, is to subtract
both sides by 7. The knowledge required to do this step can
be represented by something called a production rule. These describe procedures as IF-THEN statements. The pseudo code of a production rule for this
step would say if there is a constant on the same side as the variable, then subtract that
constant from both sides. The cool thing about production rules is that
they can also be used to represent common mistakes a student might make. These production rules are called “buggy
rules”. For example, instead of subtracting the constant,
the student might mistakenly try to subtract the coefficient. No can do! It’s totally possible that multiple competing
production rules are triggered after a student completes a step – it may not be entirely
clear what misconception has led to a student’s answer. So, production rules are combined with an
algorithm that selects the most likely one. That way, the student can be given a helpful
piece of feedback. These production rules, and the selection
algorithm, combine to form what’s called a Domain Model, which is a formal representation
of the knowledge, procedures and skills of a particular discipline – like algebra. Domain models can be used to assist learners
on any individual problem, but they’re insufficient for helping learners move through a whole
curriculum because they don’t track any progress over time. For that, intelligent tutoring systems build
and maintain a student model – one that tracks, among other things, what production
rules a student has mastered, and where they still need practice. This is exactly what we need to properly personalize
the tutor. That doesn’t sound so hard, but it’s actually
a big challenge to figure out what a student knows and doesn’t know based only on their
answers to problems. A common technique for figuring this out is
Bayesian knowledge tracing. The algorithm treats student knowledge as
a set of latent variables, which are variables whose true value is hidden from an outside
observer, like our software. This is also true in the physical world, where
a teacher would not know for certain whether a student knows something completely. Instead, they might probe that knowledge using a test to see if the student gets the right answer. Similarly, Bayesian knowledge tracing updates
its estimate of the students’ knowledge by observing the correctness of each interaction
using that skill. To do this, the software maintains four probabilities.. First is the probability that a student has
learned how to do a particular skill. For example, the skill of subtracting constants
from both sides of an algebraic equation. Let’s say our student correctly subtracts
both sides by 7. Because she got the problem correct, we might
assume she knows how to do this step. But there’s also the possibility that the
student got it correct by accident, and doesn’t actually understand how to solve the problem. This is the probability of guess. Similarly, if the student gets it wrong, you
might assume that she doesn’t know how to do the step. But, there’s also the possibility that she
knows it, but made a careless error or other slip-up. This is called the probability of slip. The last probability that Bayesian knowledge
tracing calculates is the probability that the student started off the problem not knowing
how to do the step, but learned how to do it as a result of working through the problem. This is called the probability of transit. These four probabilities are used in a set
of equations that update the student model, keeping a running assessment for each skill
the student is supposed to know. The first equation asks: what’s the probability
that the student has learned a particular skill which takes into account the probability
that it was already learned previously and the probability of transit. Like a teacher, our estimate of this probability that it was already learned previously depends on whether we observe a student getting a question correct or incorrect, and so we have these two equations to pick from. After we compute the right value, we plug
it into our first equation, updating the probability that a student has learned a particular skill,
which then gets stored in their student model. Although there are other approaches, intelligent
tutoring systems often use Bayesian knowledge tracing to support what’s called mastery
learning, where students practice skills, until they’re deeply understood. To do this most efficiently, the software
selects the best problems to present to the student to achieve mastery, what’s called
adaptive sequencing, which is one form of personalization. But, our example is still just dealing with
data from one student. Internet-connected educational apps or sites now allow teachers and researchers the ability to collect data from millions of learners. From that data, we can discover things like
common pitfalls and where students get frustrated. Beyond student responses to questions, this
can be done by looking at how long they pause before entering an answer, where they speed
up a video, and how they interact with other students on discussion forums. This field is called Educational Data Mining,
and it has the ability to use all those facepalms and “ah ha” moments to help improve personalized
learning in the future. Speaking of the future, educational technologists
have often drawn inspiration for their innovations from science fiction. In particular, many researchers were inspired
by the future envisioned in the book “The Diamond Age” by Neal Stephenson. It describes a young girl who learns from
a book that has a set of virtual agents who interact with her in natural language acting
as coaches, teachers, and mentors who grow and change with her as she grows up. They can detect what she knows and how’s
she’s feeling, and give just the right feedback and support to help her learn. Today, there are non-science-fiction researchers,
such as Justine Cassell, crafting pedagogical virtual agents that can “exhibit the verbal
and bodily behaviors found in conversation among humans, and in doing so, build trust, rapport and even friendship with their human students.” Maybe Crash Course in 2040 will have a little John Green A.I. that lives on your iPhone 30. Educational technology and devices are now
moving off of laptop and desktop computers, and onto huge tabletop surfaces, where students
can collaborate in groups, and also tiny mobile devices, where students can learn on the go. Virtual reality and augmented reality are
also getting people excited and enabling new educational experiences for learners – diving
deep under the oceans, exploring outer space, traveling through the human body, or interacting
with cultures they might never encounter in their real lives. If we look far into the future, educational
interfaces might disappear entirely, and instead happen through direct brain learning, where
people can be uploaded with new skills, directly into their brains. This might seem really far fetched, but scientists
are making inroads already – such as detecting whether someone knows something just from
their brain signals. That leads to an interesting question: if
we can download things INTO our brains, could we also upload the contents of our brains? We’ll explore that in our series finale
next week about the far future of computing. I’ll see you then.

Danny Hutson

100 thoughts on “Educational Technology: Crash Course Computer Science #39

  1. Only one episode on brain uploading? 🙁
    I can't wait for the real science behind Arik from the C1764 series on /r/hfy.

    Oh, and I guess it's the finale too.

  2. You can get a head start on next week's topic by hitting some good futurist educational channels. Does anyone have some suggestions?

  3. Thank you guys. Its hard to put in words how much online education has helped me. It's like leaving the cave in Plato's allegory. I never had access to quality education and have been surrounded by violence and drug abuse for a big part of my life. It gets lonely at times because many assume scholarity is education and don't see the value in interdisciplinary learning. Despite that, my life has improved because of people like you and I now KNOW that it's within my hands to develop myself and enjoy every minute of life I have left. From the bottom of my cerebral concoction of neurotransmitters 😉 THANK YOU

  4. Best crash Course so far!, i Hope there will be Computer Science 2 with fokus on Deep Technical Content about Operating system, Programming language, database, AI, Cloud computing, AR and VR .

  5. Big fan of Crash Course, especially the Computer Science series. I have been waiting for an Educational Technology video – thank you!

  6. We shouldn't let our vision for the use of edtech be limited by the band wagon effect. I would like to see TOOCs (Tiny Open Online Coures) developed to help students in courses that are application or creative in focus so they can get personalized support from the teacher.

  7. Here's a problem for machine learning (or our AI overlords), If educational technology keeps getting better and better why is it that the average person doesn't seem to be any smarter?

  8. played the video because of the t-shirt. spoiler alert – raspberry pi is not mentioned. disappointed. nice t-shirt tho.

  9. Seriously, a woman talks about computer science?! U guys are hilarious lol At least u should’ve picked a hot chick. There’s no amount of vodka that could fix this kind of ugly…

  10. Quick and dirty IQ test: average the speeds that you can watch CC and still understand.
    Example I could understand CC CS at 1.5 and 2(with cc).
    But CC Physics has me watching at 1.

    If I round my average speed to the closest speed on the youtube player, and multiply by 100: I have an IQ of 125.

    Look mum! I'm smart!

  11. Please do actual computer science video like the registry and RAM, CPU stuff….. That was way cooler than these history packed videos.
    I know this is crash course and it is going to end like this but hey those episodes were awesome…. Like if u agree

  12. Sorry but the prospect of being able to download information directly into our brains is impossible reguardless of how much time passes or how much technology evolves. This can be viewed from simple biology. Learning is quite literally the connecting of synapses to form new neural pathways in the brain. This is short term memory. With repeated revists this neural pathways become stronger over time, and with use, and so become long term memory. Learning happens through this process, however dumbed down this explanation is. To download knowledge and/or skills into our brains? It goes against biology, and how memories are formed. It just isnt possible.

  13. As a teacher who often wonders about these developments (and how I could integrate them into my teaching), I want to thank you for summarising the current research so elegantly!

  14. Learning with videos at x0.75 speed? I'm learning at x2.5 (you will addapt very quickly to watching videos at high speeds), I can watch more then twice as much footage while the videos keep me engaged, because there is not time to drift away…

  15. Series Finale??? NOOOOOOOOOOOOOOOOoooooooooooooooooooooooooooo!!! Thanks Ms Philbin for your informative, fun course. Cheerio!

  16. This was a particularly interesting video for me, as I'm learning html coding via online courses. I think Carrie Anne believes in me.

  17. I just found this course and caught up only for it to end in a few days. Thanks for the information though, it has been fun learning it all.

  18. Carrie Anne ma'am.. Your videos are remarkable..amazingly amazing ..the concept I gained from some videos really helped me to understand the basic fundamentals of a CPU. I had a request to you ma'am. If you could make a video about IBM's AP 101 and how it works ..and how it guided the space shuttles for reentry maneuvering TAEM .. If you please could make a video about it I will be grateful. I've searched our local library and the city library and also all over the internet.. Google ,YouTube and all but couldn't find a suitable concept or working procedure. I'm asking a lot I know. But ma'am I'm kinda counting on you. Place I'm from people don't usually feel interested in these. Thank you. I'll be grateful.

  19. "So imagine our student is working on this algebra problem: 3x + 7 = 4. The correct next step to solve it is to subtract both sides by 7."

    This brings up a problem of educational software: subtracting by 7 is not the only next step. If a student approaches the problem differently, they could divide by 3, and that would be just as valid (not as efficient, but this is just a simple example.). If educational software is too pushy in its methods and doesn't allow enough freedom on the user's part, then it can actually be more of a hindrance to learning than a boon. My younger siblings have struggled with annoyingly specific and unclear software, so this issue goes hand-in-hand with the psychology of computing, and the considerations of usability.

    (Comment 129: breaking the computational symmetry of 2^7!)

  20. Isn't duolingo an AI driven tutoring system like the one explored in the video? It felt like it merited mentioning 🙂

  21. If anybody is interested in a network-based (as opposed to broadcast) variant of the mooc they should check out the history of cMOOCs. cMOOCs or connectivist MOOC were actually the original model formulated by canadian educators and technologists like stephan downes and george siemens. It's based on quite a radical and emancipatory pedagogy and, for me, much more interesting than the later, broadcast model formulated by the ivy league/venture capital crowd

  22. The Diamond Age: Or, A Young Lady's Illustrated Primer by Neal Stephenson is an excellent book. If you've watched all parts of this series, you should definitely read it!

  23. Downloading packets of info as in the Matrix movie would just be awesome. Problem is: scientist have not determined WHERE data is stored. They keep looking in the brain (a piece of meat), but the brain is just a switchboard for a quite complex signaling /response system (the nervous system). I read a book some years ago that studied this in detail: it was called "the Evolution of a Science" written by an engineer. Wonder if his theories were ever followed up

  24. I love how I'm learning about taking your time to study subjects while I'm playing these video's at twice the normal speed XD

  25. How can we use technology to learn if most schools, including mine, don't even allow the use of Kindles. Seriously, I'm pretty sure they're gonna ban even smart watches next! I literally can't use Khan Academy.

  26. I dealt with this type of tech in an accounting class. Wasn't very well developed. You had to put exact answers even if there was more than one way of entering your answer. These methods work well with scientific studies like algebra, but are total trash with fill in the blank type questions or essay answers.

  27. Thank you for advice! I've been looking for these two week and now, while procrastinating, I finally found them 🙂

  28. When I was in high-school, I once wrote a paper about a new way to educate students by turning a curriculum into a sort of Roleplaying/Puzzle/Exploration game in terms of non-linear progression and teaching mechanics, only a bit more abstract. It was heavily inspired by my favorite MMO at the time, EVE Online. Unfortunately, I lost that paper a long time ago.

    You should look up the channel Extra Credits, as well as the show Digressing and Sidequesting (which is under the umbrella of The Game Theorists). The former is a channel dealing primarily with the principles of Game Design, but has an episode regarding "Gamifying Education" / "Gamification of Education". The latter, meanwhile, has an episode about Super Metroid, and how it is a shining example of how a well-designed game can effectively teach players through their design, and without using any words.

  29. This video seems very odd after 4 hs aprox of video, but thank you so much for the time and effort, as it is useful anyway 🙂

  30. carrie i have learned a lot from you… just love and thanx. For the wonderfull job you have done.. thank you thank you thanks a lot and lot.
    i have watched all videos of yours from abacus till robot… learned every bit from scratch. No doubt is in my mind . You have cleared all my doubt.. .thanx once again. Gain Knowledge . Be happy. God Bless You.

Leave a Reply

Your email address will not be published. Required fields are marked *