Wednesday, January 6, 2016

Favorite comments of '15, cont: R. Craigen, Anonymous, Paul Bruno, Barry Garelick, and Anonymous

On Explaining answers to easy problems vs. doing mathematically challenging problems:

R. Craigen said...
Cognitive scientists speak of a well-established pattern called the Expertise Reversal Effect. Essentially what it says is that discovery-based teaching/learning is ineffective with novices but effective with experts. That's why, for example, we tell PhD students "Here's your subject matter and the question you must solve. Good luck because nobody's ever solved it before. Go dig up all the relevant references and become and expert. Then consider how you plan to attack the problem and come back to me and we'll discuss whether you are likely to make a successful thesis out of this." That's discovery learning of a sort that blows Boaler, Meyers, Mitra etc out of the whole discussion. Even when they imagine themselves leading such a thing they have no realistic idea of how to bring it to fruition. But we do it all the time with PhD candidates, and they are SUCCESSFUL. Why? Because you don't even get INTO the PhD program without establishing your expertise. Then the first thing we do is put you through a barrage of Comprehensive exams to test your mastery of that knowledge. Then, and ONLY THEN, do we say, "okay, now lets get started on your thesis work." (Well, I'm obviously generalizing and glossing. But this is the essential principal of the matter as pertains to our success rate in producing PhDs)

When my children were in an elementary school in Fresno California they were put in the pull-out GATE (Gifted and Talented Education) program. There they did more open-ended exploration. To me that's a no-brainer. You do that with kids who have mastered the "canon" and are ready to build upon it. Nevertheless every one of those kids still sat in regular classes and did the timed drills etc with the rest. Had they not done so, and their skills fell behind, their GATE experience would have been a millstone around their educational necks.

Now I'm no rah-rah "my kids are better than yours" elitist on these matters and that's not why I bring this up. It is that I am enraged at the tendency for some to argue that because some program dealing with very talented students with a strong background is able to accomplish something with their demographic that somehow this means that it is an ideal way to teach average students. What is the basis for this argument? I fear it is as simple a logical error as causation reversal: Some seem to believe that open-ended instruction (etc) CAUSES students to be advanced. Uh, no. The observation of students having advanced abilities or backgrounds, in contrast, does open the door ("cause" is a bit of a strong word) to these possibilities with them. Causation reversal on this point is cargo cult deception.

Anonymous said...
The edworld has been assigning causation wrongly for decades; self-esteem, Latin, 8th-grade algebra (when it was only honors), foreign languages, honors and APs, debate, music etc. When it was found that kids who had high self-esteem were very successful, the edworld immediately jumped to the conclusion that the former caused the latter. When data showed that kids who took Latin, 8th-grade algebra etc. did better on a variety of measures (graduation, college etc), they jumped on the Latin-for-all (a local MS did this) etc. as a causative factor for success. In fact, those courses merely served as a proxy variable for the identification of the most able, prepared and motivated students. Inability to recognize that has lead to placement of kids into courses where they lack the background knowledge and are unable to do the work. No, the same approach does not work for all students.

Paul Bruno said...
I'm not sure why that commenter wants to cherry-pick PISA scores rather than all of the various other measures employed in the Quebec study, but the raw scores are not relevant anyway since you have to control for various student characteristics that may change between provinces over the course of the intervention. (Especially relevant here because the intervention took place over so many years.) And indeed the authors do just that in their DID/CIC methods. I will grant that the econometrics involved are complicated but these particular "compare to the rest of Canada!" and "PISA!" objections seem to be based in misunderstandings of the authors' methods and the right way to use test scores.

If only fans of reform math were this concerned with rigorous controls and falsification exercises when considering their preferred education research.

Barry Garelick said...
"What is the basis for this argument? I fear it is as simple a logical error as causation reversal: Some seem to believe that open-ended instruction (etc) CAUSES students to be advanced."

I agree with that statement and add that some also seem to believe that traditional math worked only for a small group of students who happened to be advanced. I.e., the advanced nature of the student CAUSED traditional math to work. It failed for everyone else. The logic of this breaks down when one stops to define "advanced" and takes a close look at the other factors at work with traditional math. E.g., did the teachers teach it poorly or well? Of those for whom traditional math worked, what was the breakdown of IQ's and "advanced" nature of these students. For many if not most of the truly "advanced" students, the factual and procedural foundation for their success was predicated on their obtaining that foundation through the traditional teaching of math.

In the various online discussions of traditional vs reform math no one ever bothers to look at what is happening with the students who manage to make it through to HS calculus and major in a STEM field. For many of these students, they do a lot of practice and drills and memorization, either at home, or at a learning center, if they're not getting that through school. One has only to look at the Asian countries to see that Jukus and similar organizations are providing foundational skills to make these students excel at what appear to be inquiry-based assignments at school.

   
Anonymous said...
I had well-taught, traditional math in my small-town 1-12 school, in the 50s-60s. Most of the town was poor, but all kids came from respectable, intact, two-parent homes (widowhood aside)and were all well-socialized at school entry (no pre-k-k available). Of HS classes of 30-36, only 3-4 went to a 4-yr college and there probably weren't 10 adults with college degrees in town. At the end of 8th grade, however, everyone was decently literate, numerate, could write correctly and had decent general knowledge. ES teachers taught science, history (including art and music hx/appreciation), geography and civics. In no way was this a high-IQ or highly-educated population. The ability to use math for everyday purposes (this was before calculators) came strictly from school (perhaps some flashcard math facts at home, but only a few kids). We were taught well enough that we could calculate tax, interest, gas mileage, amount of materials needed for household projects and the like. Traditional math worked for all.

No comments: