Tuesday, March 29, 2011

Intuitive ontologies and the possibilities for instruction

I was recently reminded of a set of very influential papers by M. T. H. Chi, J. D. Slotta, and their collaborators (because I reviewed a paper that relied on that work). These papers have a lot to offer the Energy Project in that Chi and Slotta see ontological categorization as being key to understanding physics concepts.  They make a stronger claim than that, which is that ontological mis-categorization is at the core of novices’ difficulties with many concepts in physics -- in fact, in their view, it's one of the key features that distinguishes novices from experts, period.

This is in some ways a fantastically progressive position, at least for the 1990s when (IMO) it was peaking.  The claim is that the difference between novices and experts is not in the quantity of information in their brains, nor in the development of "abilities" like memory or "intelligence," but rather in how the information we all have is organized.  I am in this school of thought.  I also relate strongly to the ontological categorization issue, of course, since one focus of the Energy Project is to help people develop a particular ontology for energy.  Part of the deal, in our opinion, is that it's going to be very helpful for people to model energy as a certain kind of thing.  This general issue has been dear to physics education researchers pre-Energy Project, as well:  for example, we've considered it a key problem when students talk about objects having force or giving force to other objects, apparently thinking of force as a substance, whereas we think of force as an interaction.  Chi and Slotta are the primary figures responsible for this general idea in the literature (for example, they are referenced extensively in the expert-novice chapter of How People Learn) and we should all know about them.

Chi, M.T.H., and Slotta, J.D. (1993). The ontological coherence of intuitive physics. Cognition and Instruction, 10, 249–260.
Slotta, J.D., Chi, M.T.H., and Joram, E. (1995). Assessing students’ misclassifications of physics concepts: An ontological basis for conceptual change. Cognition and Instruction, 13, 373–400.
Chi, M. T. H. (2005). Commonsense conceptions of emergent processes: Why some misconceptions are robust. Journal of the Learning Sciences, 14, 161–199.
Slotta, J., and Chi, M. T. H. (2006). Helping students understand challenging topics in science through ontology training. Cognition and Instruction, 24, 261–289.

Important and valuable as this work is, there are parts of it that I strongly disagree with.
  • Chi and Slotta assert that novices misunderstand concepts such as heat, light, and electric current as being matter-like substances, to their detriment, whereas experts know them to be emergent processes.  This doesn't fit my experience of either novices or experts.  In the case of energy, for example, it's we experts who think of it as a substance (at least sometimes), and that thinking is productive, not problematic.  (Chi was invited to discuss this issue with the PER community at an AAPT meeting once, but it wasn't a helpful conversation.)
  • Chi and Slotta lay out a hierarchical tree of ontologies in which "matter" and "process" are on different branches, and assert that these categories are cognitively mutually exclusive.  This theory of "ontological distinctness" is based on (1) the idea that entities in the world are strictly ontologically distinct (a dog cannot be an hour long) and (2) the observation that novices have a very hard time changing ontological categories.  If you mistakenly think of light or electric current as being a matter-like substance, you are separated from experts by a cognitive abyss:
Unfortunately, once an ontological commitment is made with respect to a concept, it is difficult through any stages of mental transformation to change one's fundamental conception from substance to process... Thus ontologically misattributed concepts would require an extraordinary process of conceptual change. (Slotta and Chi, 2006, p. 263)
  • Chi and Slotta use the theory of ontological distinctness to account for the persistence of student difficulties generally.  In their view, novices can't think the way experts do because their cognitive structure is different.  (For example, they lack ontological categories that we have, such as "emergent process.")  They go even further:  Because novice cognition is different, it is “not possible to refine or develop intuitive knowledge to the point that it becomes the veridical physics knowledge."
Unfortunately, that third bullet has been very influential.  Chi and Slotta are pillars of the perspective that novice thinking is fundamentally flawed.  The educational implications of this perspective are pretty direct:  the job of instruction is to prevent students from thinking in the ways that they're used to and give them something worthwhile to think instead, because it's not possible to build right thinking on a wrong foundation.
Teachers should not try to “bridge the gap” between students’ misconceptions and the target instructional material, as there is no tenable pathway between distinct ontological conceptions. For example, students who understand “force” as a property of an object cannot come gradually to shift this conception until it is thought of as a process of interaction between two objects. Indeed, students’ learning may actually be hindered if they are required to relate scientifically normative instruction to their existing conceptualizations. (Slotta & Chi, 2006, p. 286)
Recently the Journal of the Learning Sciences published what I think is a pretty ringing critique of Chi and Slotta’s framework, assembled by my former colleagues at Maryland.  Here is an excerpt from the abstract:

Gupta, A., Hammer, D., & Redish, E. F. (2010). The case for dynamic models of learners' ontologies in physics. Journal of the Learning Sciences, 19(3), 285-321.
[We argue] that expert and novice reasoning often and productively traverses ontological categories. We cite examples from everyday, classroom, and professional contexts to illustrate this. We agree with Chi and Slotta that instruction should attend to learners’ ontologies, but we find that these ontologies are better understood as dynamic and context dependent rather than as static constraints. To promote one ontological description in physics instruction, as suggested by Slotta and Chi, could undermine novices’ access to productive cognitive resources that they bring to their studies and inhibit their transition to the dynamic ontological flexibility required of experts.

Equally exciting is that JLS also published Slotta’s defense of Chi’s framework, and a response to that defense. It's quite a spirited exchange.

Slotta, J. D. (2010). In defense of Chi's ontological incompatibility hypothesis. Journal of the Learning Sciences, 20(1), 152-162.
Hammer, D., Gupta, A., & Redish, E. F. (2011). On static and dynamic intuitive ontologies. Journal of the Learning Sciences, 20(1), 163-168.

Part of why I think this conversation is exciting is that it might reinvigorate questions about the nature of student ideas and the possibilities for instruction.  Gupta, Hammer, and Redish assert that both experts’ and novices’ ontologies are dynamic and context-dependent; that both experts and novices can, do, and should use substance metaphors for energy productively; and that fruitful instruction takes advantage of novices’ ontological flexibility.  Their work is a new challenge to the “misconceptions” cognitive theory that has been debated in JLS since the 1990s:

Smith, J., diSessa, A., & Roschelle, J. (1993/1994). Misconceptions reconceived:  A constructivist analysis of knowledge in transition. Journal of the Learning Sciences, 3(2), 115-163.

I think part of the significance of all this for the Energy Project is for us to be aware that the issues of teaching and learning that we're grappling with go all the way to the top.  

Tuesday, February 22, 2011

Teaching Seminar: Which student do you like the most?

Aargh, more technical difficulties! I didn't realize how low the batteries on the mics were and couldn't find more, and they all died, receivers and transmitters. Hopefully the receivers died first and the camera switched to its internal microphone. At least I took really detailed notes (4 pages of them)!

Stamatis led the class tonight, and it was a very different kind of class than usual. I was not involved in the planning and didn't know what he was going to do ahead of time, so the class unfolded a bit like a mystery novel for me.

He started with a demo in which he put a tube of liquid nitrogen into water and it started spinning, and then asked people to figure out what was happening with the energy in this situation. After some discussion, he reminded them of the discussion of "features" of energy and asked what kind of questions, in terms of what features, they asked themselves when trying to figure out what what was going on. He said they were trying to think of a name for this type of question and needed help. I'm not sure I quite understood what this was about.

Then we switched to watching a video from the Hammer and Van Zee book of students discussing what would happen if you cut the string on the pendulum at its highest point. He prefaced the video with "Tonight we’re going to go to a different kind of video. We’re not going to be thinking so much about student ideas, but about the students themselves as human beings." Several people laughed at this comment, and I'm not sure why. Then he hit play and we watched for 10 minutes. After the video, he said, "The question I’m dying to ask is: “Which student do you like the most and why?" People really didn't want to answer the question. One group said they couldn't answer it because they hadn't been watching with that question in mind, they'd been paying attention to classroom culture. So Stamatis showed the video again so they could watch with that question in mind. And they still refused to answer the question. Stamatis kept pushing them and eventually one person volunteered their favorite and then a few more people. The point of all this, according to Stamatis, was to look at what values were inherent in their choices. Then someone said she thought about it in terms of who she calls on in class and this launched everybody into a long discussion about who we call on in class and why. And then everybody started talking about what they liked about the classroom in the video. This discussion was relevant to the topic of what values inform our teaching, but it seemed like it undid months of training to focus on student ideas and not evaluate the lesson. Or maybe it just cut through the very thin veneer of restraint they acquired over the last few months.

Then Stamatis showed them the "Initial findings from the Measures of Effective Teaching Project" and they discussed how it's important to think about your own values in teaching and the values of administrators making decisions about education.

Stamatis ended by asking them whether they wanted to watch more video of each others' classrooms, as a segue into trying to convince them to sign up to be videotaped because we need volunteers. I did know this part was coming, and was disappointed in the response. Nobody jumped up to say that watching video had been really valuable for them. A couple people said, "Or? What's the alternative?" which I guess could be interpreted as, "Of course we're going to do that, why wouldn't we?" or it could be interpreted as, "Can we do something else please?" Lisa 2 said "I want to see more video of people I don’t know, but I don’t want the discomfort of seeing people I know." Margaret said after watching the video from Matt's class she had gone home and asked her students the same questions and was really excited to see that they responded in the same way as Matt's students. She said she'd love to do activities where they all ask their students the same questions and then come back and talk about them. This sounds to me like what teachers proposed in the AYPD last year, but never really did. Then Nina said, "I’d be disappointed if I didn’t get to see my video, and I’d love to see other people’s." That was the most positive response we got about the video.

What to do if the mic is giving a lot of static

At the last teaching seminar, I encountered this problem where I turned on the mic and listened in on the headphones and there was a ton of static. It happened on two different cameras, but it turned out that the culprit was not the mic, but the camera, which had gotten onto some weird setting. No idea how it happened, but in case it ever happens again, here's how to fix it:

Press the "FUNC." button.
Use the arrows on the "SET" button to scroll down to "menu" and then press "SET" to select it.
Scroll down to "SYSTEM SETUP", then use the right arrow to get into that menu
Select "AV/PHONES" and then push "SET"
Switch from "AV" to "PHONES"

Teaching Seminar: Continuation of Leaves in the Street episode

I'm finally getting around to blogging about the Teaching Seminar from 2/7, where the teachers discussed another 12 minutes of Matt's class. I had some technical difficulties, so there was a good chunk of time I wasn't able to listen, and then then battery on the mic died at some point, so I don't know how much of the discussion we actually have audio for. Too bad, because it may have been an interesting discussion. Also, I was so excited about the video myself (I had not seen it before class) that I had a hard time going meta and analyzing their discussion of it.

What excited me about the video: Lots of language about energy that I didn't understand. Using strange grammar and making strange distinctions like "It has a source of energy" and "Does it have energy or does it just use energy?" I suspect that the students are implicitly using some other metaphor for energy, but I'm not sure what it is.

Also, one thing that came up the next week in our research group meeting when we discussed the video: There's a point when Matt says, "So it's not necessarily that an object that is moving has energy, it just takes energy to cause something to move?" He's listening to what the students are saying and he's noticing a distinction that most experts wouldn't even see, because to an expert, those things are the same. Someone argued that he's been primed to hear that distinction because he's been in our summer courses and teaching seminars for two years, where we've talked in great detail about these distinctions. But if that's true, is this a piece of evidence that our course is actually having an impact on a teacher's classroom practice? Or maybe Matt would have done this even if he'd never been part of this course.

What may be interesting about the teaching seminar: Lots of rich discussion about what students were thinking. I caught teachers saying a lot of things that seemed too simplistic to me, like they weren't really getting what students were thinking, but at the same time, they were really talking the whole time about what students might be thinking. If we want to write a paper about how teachers' attention to student thinking changes over the course of the teaching seminar, there's probably some good data here, but I'd have to watch it again to know what to pick out.

Friday, January 28, 2011

Teaching Seminar: Leaves in the street episode

Instead of identifying the Teaching Seminars by number, I'm going to identify them by topic from now on.

In preparing for this session, I got really excited, because (drumroll please) we actually have video from one of our participants' classrooms in which students' ideas are highly visible!  This is pretty much a first for the project.  Wow!  It's Matt Jones's class, and it's great stuff.  (I'm having a technical problem posting the episode here - maybe later.)

Only six teachers showed up to the session, which is too bad, but oh well.  As far as how it went, I feel unsure about reporting on it, because I was really engrossed in it and I'm not sure how much of the discussion was them and how much was me.  I can say that I felt very comfortable and happy with the conversation:  it seemed like there was a lot of interest in the students' ideas about energy, and a pleasant willingness to talk about other features of the episode I thought were interesting (like how the group handles dissent).  Nobody dissed anybody.  Nobody said the students were not getting it, or were getting it, or were wasting their time, or needed the teacher.  One teacher (Cindy) started to say something that I thought was going to be a judgment of the lesson, and I stopped her, and in response she said, "Actually I think the lesson is brilliant!" which ... is also a judgment; but it didn't seem like too big of a deal.  By the end of the class, it seemed reasonable to do something I think of as fairly advanced, which was to identify the features of the conversation that make us feel that, as teachers, we are getting a lot of good information about student thinking. Here is what we came up with:


Again, I feel hesitant saying that this is super fantastic because I think a lot of it might have been me.  But maybe it's significant that they and I were well-aligned enough that the exercise was acceptable to everyone in the room.  

Because I liked them, I am also posting the discussion questions that I came up with in advance.  In the moment, I decided not to hand these out, but rather to just use them as prompts for myself. I think we covered a lot of this territory in the two hours. 


Do leaves in the street have energy?
Episode 1 – Students talk amongst themselves

1.     What do you infer S2 means by “perpetual motion”?
2.     What do you think of S5’s argument responding to the perpetual motion statement?  Is it convincing to you?  Does it seem to affect S2?
3.     S2 differentiates a leaf from a bus (and bicycle) by saying you don’t “use” a leaf; it doesn’t “do much”; it kind of just “sits there until someone moves it.”  Summarize the distinction you think she is making.
4.     S2 very dramatically draws out the vowels of “use,” “do,” and “sit.”  How would the meaning of what she says be different if she did not do that?
5.     The students propose various things about energy and wind:  that wind has energy, that wind can create energy, that wind can be a source of energy, and that wind is like a foot on pedals (presumably of a bicycle).  Draw a diagram for each of these that illustrates how they are different.
6.     When S2 says the leaves wouldn’t move without the wind, S5 says that a bus wouldn’t move without gasoline, either.  She seems to be arguing that as regards energy, a bus and a leaf are not fundamentally different kinds of things.  What point specifically do you think she is trying to make about the role of energy in each case?
7.     S4 complains that they didn’t listen to her.  What did she say that they disregarded?  What was she trying to get them to do that they did not do?
8.     Other times, it seems that the students are definitely listening to each other.  One kind of evidence is that they look at each other while they talk, but as we all know, it’s possible to appear attentive while actually thinking about something else.  Find moments where there is strong evidence that one student has really listened to another one.  The evidence might be in what they say or in how they say it.
9.     There are moments of dissent in this episode.  Dissent is a big deal because it’s intellectually and emotionally risky – a “hot spot” for learning.  How does this group handle dissent? Are the students interacting with one another in a way that is respectful and inviting?  How or how not?
10.  Dissent also can be very informative for us as observers, because it places two ideas in contrast, potentially clarifying both.  What is clarified in each moment of dissent that you find, if anything? 
11.  It seems like we have the opportunity to learn a lot from this episode about what underlies the short answers students write in their notebooks.  We don’t have evidence for why they have such an interesting conversation.  We can, however, discuss what is happening:  What are the features of the conversation that make us feel that, as teachers, we are getting a lot of good information about student thinking?  (For example, we can tell that they are listening to each other (above), and they challenge each other (where?).  What else?)
12.  What evidence is there in this episode that this kind of discussion is a good use of the students’ time?  Do you think they think it is a good use of their time?

Wednesday, January 19, 2011

Teaching seminar, seventh session - observations we made

Sam also blogged about this session.  I wanted to add some of the specific observations we made of the video we watched.

As Sam said, the students are not very enlightening with their discussion as they are creating the white board.  A lot of what they do is just say things, and write them down or not; there's not much in the way of discussion or debate.  A big idea that I prompted is that from watching the video you learn that what makes it onto the white board is not representative of "the students' ideas" in any simple way.  For example the guy in the grey shirt, who we call Boy 1 (B1), says energy is "fuel" and "nutrients," but that doesn't make it onto the board.  It seems like his seatmate, Girl 1 (in the green sweatshirt), takes charge of managing the space on the board -- she divides it into sections, she tells other people what to draw, and she even erases something elaborate that B1 had drawn.  Later the other girl (G2, in black and white) is busy drawing stuff by herself while G1 isn't really looking.  So what we as teachers see, looking at the final product, has a lot to do with the social dynamics of the group, not only their ideas about energy in any pure way.

Margaret asked why the teacher had such a strong priority that people should draw pictures, not write words.  She was extremely gracious about this.  What I saw in the video is that Chris is shouting over and over, "Draw pictures!  More pictures, less words!" so forcefully that I could hardly think.  Lisa suggested that it was maybe easier for the students to just regurgitate words, but with pictures kids tend to be more original, so maybe the teacher was pushing for that.  I've asked Chris what her reasons were.  (She wasn't there for the discussion.)

One story from the video, starting at about 5:20 in the captioned movie:  B1 says, "I want to draw something!  I feel excluded!" in a fake-whining kind of way -- we observed that he is pretty jocular most of the time.  G1 tells him to what to draw and where to draw it (she wants him to draw a light bulb under the word "look," to show what energy looks like).  He is quiet for a second, his face relaxes, he reaches back to touch his own neck, and he says, "No, shouldn't we put like a little --" and makes a gesture in the air.  The thing that struck me is that I felt like it's the only time in the whole 12 minutes where I heard his normal voice, instead of a singsong jokey voice.  I was also struck because I think this is the only moment of dissent in the episode -- the only time when someone says something and someone else says, "No, I don't think so, I think it should be this instead."  Those moments always seem really key to me for finding out what people think.  Unfortunately this little moment doesn't last long; G1 tells him to draw what she said, he creates some rather elaborate thing while she is talking to other people, and then when she looks back at him, she says, "What is that?" pretty confrontationally.  He says he was having a "creative fart" (?) and starts to change one part of his picture, and then she just erases the whole thing.  It seems pretty harsh.  Right after that, they're talking about how energy would feel, and he offers to go outside and cut a wire and electrocute himself and tell them how it feels.  "It feels... not... so... good," he says, and pretends to die in his chair.  The symbolism of the whole thing broke my heart!  One moment of genuineness from him, and they wipe out his contribution so definitively that he offers to go out in the street and off himself!  Then, to add insult to injury (or maybe drive the nail in the coffin...), when it was time to present, the other three kids used up all the material on the board and he was stuck very awkwardly without anything to say.  It was painful... they had wiped out his big contribution (both physically and emotionally), and now he was on the spot.  But then when he did say something, he said something really cool about energy being "how the world works." And it seemed like the whole thing was kind of coming full circle, because he had initiated the conversation with "fuel" and "nutrients," which was also very cool even though it didn't get onto the board.

Friday, January 14, 2011

Teaching Seminar, Seventh Session - paying attention to student thinking

I am back from maternity leave and attending teaching seminars again, and catching up with what I've missed in the last few months.

Apparently in the last teaching seminar, participants looked at and discussed the whiteboards about energy from Chris's class. Rachel started tonight by reminding them of this, and pointing out that they had a lot of questions about how what they saw on the whiteboards was generated, which they couldn't get from just looking at the final products. To help them answer some of these questions, today they watched a video of students generating one of these whiteboards (the first one shown in the blog post linked above). It was a 12-minute video, too long to watch the whole thing all the way through, so Rachel asked them to stop it when they saw something they wanted to discuss. As it turned out, no one ever stopped it except Rachel. The way the evening went was that we would watch a few minutes of video, Rachel would stop it, they would discuss it in small groups, then report back to the whole group, then repeat, until we'd watched the whole video.

One of the goals of the Teaching Seminar is to encourage teachers to pay attention to student thinking. Judging from the conversations I heard in the group we were taping, I think we're making some progress. Last year we spent a lot of time asking teachers to discuss students' written work, and I found the video painful to watch: there was a lot of bitching about how dumb students are, and not a lot of curiosity about their thinking. What I saw today was that teachers were desperately curious about student thinking. They were going bonkers trying to figure out why the students were doing what they were doing, what they were thinking, and how to modify the activity to find out more about student thinking. They were frustrated that the students weren't articulate about their thinking, and wanted to find more ways to draw them out. Some of their ideas for how to learn more about student thinking were not very good. For example, they suggested asking students to present their whiteboards, imagining that in a presentation they would suddenly lay out all their thoughts clearly in a way they hadn't in the small groups (whereas I always find I learn more by listening to small group discussions than polished final presentations). When they were told that these students did present their white boards at the end of class, they begged to see the video of the presentations. Then they watched it and had to grapple with the realization that it wasn't very enlightening.

It seems to me that at least some of the teachers have really gained a new appreciation for the value of paying close attention to the value of student thinking. But they are still figuring out how to go about actually finding out what students are thinking. This is a great place to be. A lot of progress, and a lot of potential for further development.