{"id":180,"date":"2012-11-10T09:44:05","date_gmt":"2012-11-10T15:44:05","guid":{"rendered":"https:\/\/skepticink.com\/smilodonsretreat\/?p=180"},"modified":"2012-11-10T09:44:05","modified_gmt":"2012-11-10T15:44:05","slug":"educational-testing-and-learning","status":"publish","type":"post","link":"https:\/\/skepticink.com\/smilodonsretreat\/2012\/11\/10\/educational-testing-and-learning\/","title":{"rendered":"Educational Testing and Learning"},"content":{"rendered":"

You may not know it, but I work for a for-profit education company.\u00a0 I’d like to take a few minutes to talk about US education and things like testing.<\/p>\n

The current US educational system is state-of-the-art 1940s technology.\u00a0 The teaching methods basically haven’t changed ever.\u00a0 Unfortunately, the material has grown exceedingly complex.\u00a0 Sixty years ago, only the brightest and wealthiest went to college.\u00a0 Many people didn’t even graduate high school.\u00a0 In fact, the GED program was developed to provide high school equivalency certification to the WWII vets returning home.\u00a0 It was never intended to be a forever thing.<\/p>\n

But the teaching methods are the same.\u00a0 Here are the facts, memorize them, good luck on the test.\u00a0 But ask any educational researcher and they will tell you that is, by far, the worst method for education.<\/p>\n

In this day and age, any 8-year-old with a decent cell phone can look up any factual knowledge in the world.\u00a0 My boss is fond of saying that “content is dead”.\u00a0 What he means is that there is little point in filling kids’ heads with fact, when they can hop on the internet and learn the tensile strength of any of a dozen varieties of steel in seconds.<\/p>\n

Our modern educational system needs to focus on skills and reasoning ability.\u00a0 Unfortunately, things like this are very difficult to teach.\u00a0 And teachers often don’t have those skills themselves, because they are a product of our education system.<\/p>\n

The ability to critically examine content and judge its worth, accuracy, validity, is a very difficult skill to learn.\u00a0 As we’ve seen in the recent presidential election, one can become a billionaire without learning these kinds of skills.\u00a0 As xkcd says<\/a> “To the surprise of pundits, numbers continue to be the best system for determining which of two things is larger”.<\/p>\n

Unfortunately, this utter lack of critical thinking in our society has done things like make Mitt Romney a valid candidate for the highest office in the land, with almost 50% of the popular vote.\u00a0 I maintain that anyone who can think critically and judge the worth of various sources of information would not vote for Romney.\u00a0 That’s just a notion though, not even quite a working hypothesis.<\/p>\n

Some of the testing programs that I’m familiar with are beginning to see this.\u00a0 They are focusing on skills much more than content knowledge.\u00a0 Let me say that when these tests go live, the student population is going to be very, very shocked.<\/p>\n

Here’s the thing about testing, even standardized testing, that a lot of people do not understand.\u00a0 It is being used completely incorrectly by nearly every organization and school that uses it.\u00a0 Would you blame the toaster oven for not cooking the Thanksgiving turkey very well?\u00a0 No, you don’t blame the tool because some idiot decided to use for something other than its intended purpose.<\/p>\n

Standardized tests are not good for judging the quality of teachers, the quality of schools, the quality of educational systems, or philosophies of education.\u00a0 What’s missing in this list of things that people use standardized testing for?\u00a0 The people actually taking the test.<\/p>\n

Any competent scientist will tell you that you can’t judge a variable that’s not being tested for.\u00a0 If you want to test teacher quality, then test teachers.\u00a0 Not students.<\/p>\n

Research shows that the best predictor of school results on standardized tests is not teachers, it’s socioeconomic status of the students.\u00a0 Teachers really have little impact on the test scores of the students.\u00a0 Sure, you may get an exceptional teacher who can turn around her one class of students, but the rest of the school probably doesn’t have her skill in teaching.<\/p>\n

So, what’s the purpose of educational testing?\u00a0 The sole purpose is to judge the student’s knowledge and skills of the curriculum.\u00a0 These tests can’t be used to say if kids should go to college, or anything else.\u00a0 The only thing these tests can measure is the student’s knowledge and skills of the curriculum.\u00a0 Yes, I’ve said it twice, because it’s vitally important.<\/p>\n

If the curriculum sucks, then that’s not the tests’ fault.<\/p>\n

In an ideal world, where boards of education understand this, the test would be administered and the students would be remediated on the areas of the curriculum that they lack.\u00a0 It’s a complete and utter waste that this is not done.<\/p>\n

The data that testing companies collect from standardized tests is immense.\u00a0 We can look at a student’s response to an item and, in a well crafted item, determine what misconception they have that led them to the wrong answer.\u00a0 “Oh little Johhny missed this question because he didn’t remember that in the order of operations, parentheses come before division”.\u00a0 Yes, we can actually make statements like that on for these tests.<\/p>\n

Most of the time, we can tell when a student was guessing on a question in the test.\u00a0 We can generate a report that can tell a teacher exactly which areas of the curriculum the student needs assistance.\u00a0 We can, on some tests, even tell what areas of a specific curricula line item the tester is having trouble with.\u00a0 We can identify which skills are missing.<\/p>\n

There’s been decades of educational research that goes into these types of tests and all that fantastic information is boiled down to “pass\/fail” and the school’s score (at least in Texas).<\/p>\n

That’s the problem with standardized testing.\u00a0 It’s just that it is used incorrectly.<\/p>\n

I predict that in 15 years, we won’t recognize modern education systems.\u00a0 I think that the lead taken by educational companies, education researchers, and progressive school districts that are actually interested in education (instead of football) will begin a massive change in how students learn.\u00a0 Taking the lessons learned from programs in Africa, students will have to responsible for their own education.\u00a0 Cooperative education will be emphasized.\u00a0 Problem solving and critical thinking will be the only required learning topics, content will come from those.<\/p>\n

A personal example: I could go back to school for a Master’s degree or a Ph.D., but why?\u00a0 I can pick up a peer-reviewed research paper in almost any field, read it, and understand it.\u00a0 No, I can’t do the advanced math and statistics, but I don’t use those in my day job anyway.\u00a0 I don’t really need those skills (I have psychometricians for that).\u00a0 In other words, I can learn whatever I want to, whenever I want to.\u00a0 Yes, my knowledge is pretty eclectic, but I have no problems learning new skills or new content.\u00a0 Not because I’m intrinsically smarter than other people, but because I have a unique skill set.<\/p>\n

I have learned how to learn.\u00a0 Once we install that skill in our kids, they can, literally, do anything.<\/p>\n","protected":false},"excerpt":{"rendered":"

You may not know it, but I work for a for-profit education company.\u00a0 I’d like to take a few minutes…<\/p>\n","protected":false},"author":27,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[44,46,45],"tags":[940,120,119],"class_list":["post-180","post","type-post","status-publish","format-standard","hentry","category-culture","category-education","category-society","tag-education","tag-learning","tag-testing"],"_links":{"self":[{"href":"https:\/\/skepticink.com\/smilodonsretreat\/wp-json\/wp\/v2\/posts\/180","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/skepticink.com\/smilodonsretreat\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/skepticink.com\/smilodonsretreat\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/skepticink.com\/smilodonsretreat\/wp-json\/wp\/v2\/users\/27"}],"replies":[{"embeddable":true,"href":"https:\/\/skepticink.com\/smilodonsretreat\/wp-json\/wp\/v2\/comments?post=180"}],"version-history":[{"count":0,"href":"https:\/\/skepticink.com\/smilodonsretreat\/wp-json\/wp\/v2\/posts\/180\/revisions"}],"wp:attachment":[{"href":"https:\/\/skepticink.com\/smilodonsretreat\/wp-json\/wp\/v2\/media?parent=180"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/skepticink.com\/smilodonsretreat\/wp-json\/wp\/v2\/categories?post=180"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/skepticink.com\/smilodonsretreat\/wp-json\/wp\/v2\/tags?post=180"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}