Friday, June 29, 2012

models of forms - flop or success?

Last year in UE1, one of the activities was filling out a table with different forms of energy, and the evidence that each form is there. Teachers found this useful because the standards often ask them to teach some set list of forms, and the table helped them contextualize this list and recognize that it is constructed, rather than given by authority. However, one aspect of this table seemed like it was not particularly productive: The focus on evidence as the main indicator of a form led to what I considered to be an overemphasis on what was or was not observable, with teachers questioning whether a form could even exist if you couldn't observe it (e.g. does sound energy exist if you can't hear it?). To me, the defining characteristic of a form of energy is not whether you happen to be able to observe it, but what your model is for what's happening in the physical system when that form is present. In some cases that model overlaps with the evidence (e.g. for kinetic energy, the model is that something is moving, and the evidence is generally that you observe something moving), but in other cases it's very different (e.g. for thermal energy my model is that molecules are bouncing around, but the evidence is that you have a reading on a thermometer or you feel warm). To address this, I suggested that we add an additional column to the table for "model". Lane and Lezlie offered an additional suggestion to split the evidence column into "evidence for the presence of this form" and "evidence for change in this form", since in some cases we tend to observe the presence of energy (e.g. kinetic energy), and in other cases we usually only observe a change (e.g. chemical energy).

Here is a link to Lane's table illustrating the kind of thing we had in mind, except that instead of having separate columns for changes and presence, he put stuff related to presence in black and stuff related to changes in red.

Eleanor took up our suggestions in UE2, and at the end of the first day, she introduced a Keeley probe on models and presented the new columns for the forms table. Then they spent the entire second day negotiating what a model is.We knew that the term "model" would take some getting used to and expected there to be negotiation. But I don't think anyone, including Eleanor, realized just how much negotiation it would require.

To me, and to other scholars, it seemed like they were getting bogged down with the idea of a pedagogical model, rather than a mental model, as Hunter blogged about here.  The reason I had introduced the model column to the table was that when there was only an evidence column, they were bogged down talking about the evidence for it, rather than talking about it. Introducing the model column, rather than getting them talking about it, appeared to be getting them bogged down in talking about how to teach it. "Model" was the best word I could come up with for what I meant by it, but after seeing what it led to, I was afraid it was still not the right word. After the second day, I was convinced that my idea had completely flopped, and I should go back to being a researcher on the side and not make any more instructional suggestions ever again.

But I forgot about Eleanor's ability to help learners pull together what looks like a giant mess into a coherent structure, and this is exactly what she did by the end of the third day. I think the process of putting the mess back together started in the afternoon of the second day, when she split the model column into "pedagogical model" and "mental model" (or something like that), so they had a place to put the stuff they were talking about and could see that there was also something else they needed to talk about. They also watched a video of Feynman talking about imagining jiggling atoms. They spent pretty much the whole third day making sense of the Feynman video via both thought experiments and real experiments, and constructing and refining a very hard-won mental model of thermal energy. By the end of the third day, it seemed like everybody had a clear mental model of thermal energy, as well as an understanding of what a mental model is, and they were really happy about it.

The thing I didn't know before this week is that these teachers did not already have a mental model for thermal energy coming into the class. Knowing this, it makes perfect sense to me why this whole process took so long (two days)! For me, thermal energy is the quintessential example of why I need a separate column for evidence and model: because for thermal energy, more than for any other form of energy, the evidence and the model are completely separate in my mind. My evidence for thermal energy is a reading on a thermometer or the feeling of warmth, and my model for thermal energy is microscopic particles bouncing around. When people are confused about what goes in the model column, I want to say, "Just think about thermal energy." But they didn't have a model of thermal energy, so it makes sense that they would be confused about the whole exercise. It was worth spending two days to develop this model, because, as Eleanor said at lunch, "If you don't have a microscopic model of thermal energy, it's hard to really believe in energy conservation because it looks like energy just goes away."

Representational flexibility as evidence of sense making


I think that representational flexibility can be evidence of physical understanding.  By "representational flexibility" I mean students' ability to use representations in ways that differ (in major or minor ways) from their instructors' usage, or from their own past usage.  This may involve incorporating facts that were not previously mentioned in connection with this representation or exploring variations and representational conventions that have not previously been discussed or emphasized.


On Wednesday, UE2 students participated in energy theater about the diffusion of thermal energy from a cup of hot coffee.  On Thursday, they were asked to produce a diagrammatic representation of that energy theater.  Two of the three groups produced diagrammatic representations that closely mimicked the energy theater.  A third group demonstrated flexibility (in my opinion) by producing a diagram that was unlike the theater.

Here are the first two groups.  Notice that they drew exactly 13 T's (because there were 13 students in the energy theater), and they drew a single circle to represent the coffee cup.  (Or in one case, they drew the single circle twice; but both circles represent the cup.)




Here is the third group, table 7, which produced a markedly different representation.  Table 7 drew three circles -- one for the cup and two for thermometers that they used in an experiment.  This representation had been suggested and attempted for ET on Wednesday, but had been quickly discarded by the class and never acted out.  Table 7 also drew nine T's instead of thirteen.  (And drew six rows of circles instead of one or two.)



I suspected that Table 7's representation was a clue that the third group had a deep understanding of the physical situation.  Although I cannot quantify the depth of their understanding, I can at least verify that the construction of the new representation was associated with a sense-making conversation.  Below is a video of Table 7 constructing their diagram and beginning to engage in a sense-making conversation.  One teacher had invented the representation, and before the group can use the picture, he has to explain it to others.  At the beginning of the conversation, this teacher (Tim) explains his diagram.



Sherry: Oh but we, this isn't visualizing the energy theater model.
Gayle: It isn't?
Sherry: I mean it's not easily seen.
Tim: It is for me.
Gayle: It is for me too, so what, um,
Tim: Here is ... maybe I could explain why I drew it this way.
Sherry: Did you go home and do it last night?
Tim: No, I did it in class yesterday.
Sherry: Oh is that why you came up with the zero (???) two, every five minutes?
Tim: No, this is just an increment of time that's not defined.  Um, so here's the cup of hot water.  (Sherry: right.)  All of the thermal energy is right there at time zero, the beginning of the experiment, all the thermal energy is right here.  Few minutes down the road, whatever that few minutes might be, some of the thermal energy (Sherry: right, I mean, I can) travel, uh leaves the cup and is transferred to the air.  (Sherry: right, I can see)  And more and more is transferred away from the cup

The representation continued to generate conversation; for instance, this exchange about the end result of thermal equilibrium:

Tim: Well in the end, in the end, the room is actually hotter from that cup of tea.
Sherry: I mean what end are you talking about?  It will go off into Seattle's air.

Written data versus video data: what questions are answered about the nature of science?

I had the idea this morning that I think it would be interesting to compare video records of what happened in UE2 on days 2 and 3 (lack of shared consensus about what a model is to shared model for thermal energy) to written records of the nature of science pre- and post-surveys we are collecting.  I think the latter might tell us if there are shifts in teachers' thinking, and the former might tell us how those shifts happened.  I'd bet our community would appreciate such a paper -- about the same thing, involving the same people, using different data and answering different questions.  I'll put it on my to-think-about list.

UE2: Understanding models

My impression is that a bird's-eye view of the UE2 course over the past several days would show the teachers negotiating and coming to consensus about what 'model' means.  This started on the first day of class, which ended with a Paige Keeley probe entitled "What is a model?"  The teachers answered the questions, received Paige's answers, then left for the afternoon.  The next morning they discussed as a group.  Throughout day 2, I felt discouraged by what felt like a lack of deep substance to their conversations -- it seemed like they were not differentiating "mental models" (a learning tool) from what Hunter has labeled "pedagogical props" (teaching tools).  But yesterday, it sounds like they ended the day with conviction and enthusiasm, having developed their own mental model for temperature.

I'd love to watch this unfold, to figure out what might have 'kept them from' understanding what kind of model Eleanor was encouraging them to develop and then to see what happened yesterday that precipitated a sequence of events that ended in understanding.  This morning, I did watch a group discussion from the morning of day 2, when the teachers were describing their responses to the Keeley probe. 

I'm not going to clip an episode because I'm still not sure this is something I want to formally pursue, but as a note to future readers, you can find the discussion I describe in minutes 49.42-1.05.54 in the video labeled UE2 120627 1056 T2.  Basically, I see (and infer) the following things to be happening:
  • Wendy says that she carefully read and understood Paige's prompt to be asking about which of the choices addressed the use of models, not just models.  So even if she thought one of the choices was about models, if they weren't models-in-use, she didn't choose it.
  • Hunter tells the story of making a cell cake and how constructing the cell cake didn't teach him anything.
  • Tim wonders whether building a model is using it, in a way, since the act of representing something requires having a picture in your mind of the thing.
  • Joan adds that in order for something to be a model, it needs to be a replica of the thing it represents.  So building a paper airplane is not a model, since it doesn't include an assembly line (which is an important part of the process of building an airplane).
  • Jeff expresses his frustration that the conversation that's being had is way off-point of his understanding of what a model is.  He uses the word "semantics."  When Eleanor asks him what he thinks is the meaning of the probe, I think his answer suggests that he thinks the point of the probe is to help him (them) better understand what a model is, and I think he's frustrated because it didn't help him and actually left him feeling confused because he's trying to guess what Paige means.
  • Tim reminds Jeff that he wrote a definition for 'model' that Tim liked, and Jeff says that he did it because he thought he needed to in order to answer the question.  He reiterates his frustration that he thinks that people in the room -- Wendy, for example -- understand what a model is but got caught up in the "semantics" when answering the question.  Wendy affirms that she was affected by the words and adds that her attention to words was augmented by her confusion about her experience with the mouse trap car question, when there were two different ways of interpreting the question.  (My sense is that she's still confused about what those two ways are -- that this has not been resolved for her -- so now she's being extra careful to answer the question that was asked, not trusting her interpretation.)
  • Eleanor invites Jeff to share his working definition of a model, and he does: "models are used or useful in explaining-slash-predicting phenomena in real life in a simple or more accessible way, accessible meaning visual, whatever."  He says he used that definition when he answered the Keeley probe. 
  • Adria and Jeff exchange some about which ones Jeff picked, and he explains that Wendy and he had a discussion in which they felt they were clear on what a model is and then they had trouble answering the Keeley probe.
  • Sherry says that she thinks a model is "something that's built to replicate the real thing because you're not able to see and use the real thing."  She was thinking a physical model, but then this conversation/reading the probe made her think that maybe it includes conceptual things.  She thinks it's less about the answers and more about the learning.  Jeff agrees, but that's not how it worked for him.  Eleanor agrees with Sherry that it's not about the right answers; the probes are intended to be conversation starters.  Jeff says that although he agrees that we should value the process, the first thing that his table did was compare their answers to the 'right' ones.
  • Barb (?) says her definition did allow her to answer the probe straightforwardly.
  • Alicia says that she has a problem with just visualizing models, (I think) because there's no way for others to evaluate or assess it.  You need to be able to demonstrate it with a drawing or in words.  How can you prove you have a model, or that it's right, if it's just in your head?  Tim concurs, adding that the model can be in your head, but you have to be able to represent it for state tests.  Michelle (playfully?) disputes this, referring to the standards, saying they only say "create," not write it down.
  • Eleanor summarizes the different kinds of models they've been discussing.
Originally, I thought this interchange was significant because I read a paper in graduate school about different ways in which students and teachers use the word "model," and I was thinking that maybe this was the source of Jeff's frustration -- the other teachers were using the word "model" in a different way than he was, and he thought it meant the task wasn't clear.  Now I'm not so sure that this is what happened.

In any case, I do get the sense that Jeff feels that this activity did not advance his understanding of what a model is, which is what he thought the purpose was.  And I wonder if this (paired with other things) might have been one of the hang-ups on day 2 in terms of understanding what 'model' means.

Thursday, June 28, 2012

Let's just be vulnerable and learn





This short episode was from a conversation at the start of class, when the learners were sharing their thoughts about the previous day. The first part of the conversation was their frustration at how what they were doing would not easily transfer to their classrooms, which prompted Ana to say that they designed this class for adult learners. Several people said some positive things about the class, and then Dan talked about being an adult learner.

UE1 120628 1000 T5&ET Vulnerability 855
Dan: Listening to this discussion, that we as adult learners, the bad habits that we might pick up, or, like, for me as an adult learner I won’t participant in a discussion if I don’t have the right English word because I don’t want to sound like an idiot. So all those little stories that we begin to tell ourselves on the way, whereas with kids still, we can help them still be playful, to explore, to take risks, and to suspend that judgement. It’s like Ana said, I remember her saying, you know easier said than done, it’s what we do over the course of trying to  be intelligent, functioning people, um to appear knowledgeable about things. But to, to take that risk, I guess? Um, and for me, since I don’t know the subject it’s not ever pretending, it’s that fear, okay let’s just be vulnerable and learn, for learning’s sake.

This was a powerful statement, at least to us researchers. Dan is recognizing something that is common to all adult learners (and that applies to the undergraduates I usually interact with, as well). By the time we get to be adults, we're supposed to appear knowledgeable about topics, and, perhaps more importantly, about situations. Thus, when we we're in a situation, we're supposed to know how we're supposed to act in that situation. Being an adult learner is uncomfortable for at least two reasons: (1) We don't know the content we're talking about (as Dan pointed out), and we might say something foolish. (2) We're adults, but the teacher is the authority, so we don't get to decide what kind of activities we'll engage in, and what the rules of those activities will be. We know that many students are uncomfortable when they are first involved in learning activities that aren't what they're used to (i.e. traditional lecture). They probably don't want to say something wrong, but I would suspect that it's also uncomfortable because they're not sure what's going to happen next, nor how they should talk or behave.

Direct Evidence vs. Prior Knowledge: A Nature of Science Question


What directly preceded this conversation: This episode is preceded by Lane posing a thought experiment. The class had considered the situation of placing an ice pack in a water bath. Now Lane asked them to considered what it would be like if the ice pack was placed in the canal outside. If they had a thermometer in the canal and recorded no change in temperature, would they have evidence that heat energy had been transferred to it?

UE1 120628 1202 T5 NOS 1045
Valerie: On one hand, you are arguing that we should base what we’re doing on knowledge that we’re constructing. And to argue that there was a transfer of thermal energy, which we all know there was, even if there’s no evidence for it, to use our prior knowledge, to affect, to interpret what we’re seeing. So, we have to think about that. I mean, which one are we trying to do?
Lane: Do we, in that case, do have evidence?
Valerie: We don’t have any evidence.
[Several learners jump in.]
Valerie: But we could come up with a completely other scenario for it, for why the ice melts. There’s like no evidence that there’s thermal energy coming from it. Only prior knowledge that there’s thermal energy coming from it.
Kristy: Well, I think the ice pack melting is evidence that  [Several people overlap speech.]           
Jeannie: Canal water isn’t room-
Sean?: [inaudible] controlled experiment, because here you have a limited amount of stuff and there you have a huge amount of stuff. So you can’t say that one thing affected the other, without using a smaller scale. The bath water actually got colder so you could see the energy changing. [Inaudible].
Lane: But I think Kristy’s saying, what I hear Kristy saying is that there’s evidence of a transfer of energy into the ice pack, even out there, because its temperature changed in a [inaudible] way. That is evidence of transfer into the ice pack, but it’s not evidence of where it came from.
Valerie: Yeah, but there’s a lot of inferring there and basing it on prior knowledge. Because just imagine someone who know nothing about thermal energy, what would they think of the ice pack melting? I mean, if you say there’s a transfer of energy because [inaudible]. You’re just using what you know to answer a question.

I have two unrelated thoughts about this episode. First, Valerie seems to be struggling with what kind of information you can use what making a scientific argument. It's relatively straightforward to tell learners we need to base our claims on evidence, but here it looks like that is hard to put into practice. While we base our claims on things we can observe, we have to use deductions and reasoning to make the connection between evidence and claims. When you've also adding reasoning to the process, then it seems kind of silly (from Valerie's point of view) to ignore previous knowledge gained from the recent experiment: the temperature of the water in the bath goes down, so our model tells us it's losing heat energy to the ice pack. I sympathize with Valerie, because she's taking a conclusion based on evidence and extending it to the new thought experiment: if we conclude the ice pack is gaining thermal energy and it's in the canal, it seems like we're using reasoning to say the likely place the thermal energy comes from is the canal. 

My second, shorter, thought is about the researcher characterization of this conversation. Ben and I both heard this conversation and labeled it "about the nature of science." But it occurs to me that it's really about what rules they're following in this discussion and in this class. It would only be about the nature of science if the learners see what they're doing in this discussion and in this class as science. (And I'm sure many NOS researchers have already had that thought, but it's new to me.)

UE2: We leave with more questions than answers

Last year, I-RISE scholars observing UE2 were struck by the number of seemingly 'aha' moments related to the nature of science and the teachers' identities as participants in the scientific community.  One thing that was flagged -- described in this post -- was the sophistication of the idea that science learning often concludes with more questions than answers.

This year, my ears perk up every time I hear something like that, and it's come up twice with not much additional attention.  Two instances come to mind in particular:
  1. During the "Rights and Responsibilities" discussion, there was a lot of talk about teachers having a "right" to leave with correct answers.  Tim responded with something like, "My sense is that these kinds of classes leave us with more questions than answers."  And I got the feeling that this is okay -- even welcome -- to him, as though he wouldn't want to interfere with that by making a rule that they have to leave with all of the answers.
  2. Yesterday (06/27) afternoon, the teachers were discussing an experiment that Eleanor did using three temperature probes: one that was placed in a cup of hot water and two that were placed in the air outside, one three inches away and the other six inches away.  She graphed the temperature over time, and there were lots of bumps in the graphs if you zoomed in close enough.  The teachers were asking lots of questions about what might have made the bumps happen, and one teacher suggested that maybe the bumps were because of air currents.  Sherry piped up to say that the bumps in the graph for the temperature probe in the water could not have been because of air currents, because the probe was in the water.  They are wondering about this, and Sherry points out that one question always leads to many more.  Eleanor agrees that "that's the way it always is."
These are sort of isolated moments in time -- no sustained discussion around them -- but I wanted to make note.