Wednesday, June 20, 2012

How to use Primary Pad

(This post updates a similar post from last year.)

Normally during the I-RISE, two Scholars at a time act as observers in the classroom, taking field notes.  Two partner-Scholars who also observe that same class are back in the office, thinking, talking, and writing about what they have already observed. We have developed a system in which the two classroom observers take field notes in a document that is shared online, so that both they and their partner-Scholars back in the office can see what's written. This system is powerful, and presents both intellectual and technical challenges. This post addresses the technical issues. The intellectual issues are addressed elsewhere.

We use a free online program called Primary Pad for field notes. Basically, Primary Pad has a window for a shared, multi-author text document that authors edit together in real time.  There is also a chat window. Features of this system include:
  • The document window updates every half second, so you get to see what other people are typing right away.  
  • Each observer's typing appears in a different color, so you can easily see who wrote what.
  • Since each observer is normally observing a different person or group, you can easily read the observations of that particular person or group by reading only that color.
  • The complete revision history of the document is automatically recorded. In a separate window, you can slide a slider along a timeline and see what the document looked like at a specific time. Even if someone erases text, it remains in the revision history.  
  • You can slide to any time you like to see what the document looked like at that time, theoretically obviating the need for time stamps. However, you should still insert visible time stamps in ordinary text, so that they show up in exported versions of the document.  
  • Primary Pad is inexpensive, secure, and has no platform dependencies since it's all online.
  • Primary Pad documents are exportable to various formats (pdf, doc, etc)
  • There is essentially zero learning curve.  It's obvious how to use it and it's hard to screw it up or lose data. (As for the security and stability of the information we record, we rely on the Primary Pad providers not to crash, and we export backup documents twice a day.)
In order for you to take field notes using Primary Pad, the owner of the appropriate document will invite you by email to access the document. Access is by invitation only. There will be a separate document for each session of each class.  

At the beginning of the document, write the name of the observer, the table you're observing, the names of all the people at the table, and who's wearing the microphone, if anyone.  For example: "Sam observing Table 3: Joe, Helen, Mike, Sylvia, Shawn wearing the microphone"

When something interesting happens, such that you will want to look at the video of that later, flag it by typing the word "flag" and a phrase indicating the issue that got your attention.  For example: "flag - inventing a new representation" or "flag, rogerian discourse" or "flag: gesture."  This will make it easier to find later.

If there are two observers observing different tables, each person should keep all their field notes together separate from the other person's notes, as long as the participants are working in small groups and not as whole class. When the class shifts to whole-class discussion or lecture mode, and both observers are observing the same thing, both should skip down to the bottom of the two sets of small group activity notes and intersperse their comments so that they appear more or less in chronological order. At the beginning of each shift between whole class and small group activity, one or both observers should type in a manual time stamp and the phrase "small group" or "whole class."

There is a chat window, also. Chats are saved as part of the pad, but are probably not saved as part of the exported documents, so it's best to use the chat for stuff you don't need to keep (such as, "I'm going to grab a cup of coffee, okay?") In a strange twist, chat is the slowest way to say what you have to say, because it isn't sent until you hit return. Everything else, the other observers see in half a second.

Research sequence for video microanalysis in education

This is an outline of the research sequence associated with a short-term collaboration such as the I-RISE, whose purpose is project documentation and research synergy centered on a special event. The activities labeled "Daily" are the basic daily expectations of I-RISE scholars. The other activities are for deepening investigation of a particular issue in preparation for the Congress.

This is not a hard-and-fast sequence, just the general lay of the land. We will be supporting you in these activities during the I-RISE.

Stage
Prompt
Skills developed
Product
Daily data collection
Observe and record the class for half of every day.  Take field notes. Label and store everything appropriately.
Research documentation. Professional vision for video research. Technical facility with equipment and software.
Indexed library of video and text documentation
Daily episode selection
What happened today that got your attention? Find the highlights of today’s activity. 
Create an episode that includes only the events of interest. Get it down to less than five minutes. Transcribe and caption it if possible.
Professional vision for video research. Close observation of video.  Technical facility with Inqscribe and Quicktime.
Library of captioned episodes
Daily identification of interests
What is it about what you have observed that speaks to you? Blog about it on the project blog.
Sense of research identity
Identification of research questions
Research questions
Daily development of claims
What is true and matters about what you have observed? Blog about it on the project blog.
Make a meaningful claim
Title and abstract of Congress presentation
Theory reflection
For your very favorite episode: What theoretical assumptions are inherent in your thinking about these events? What do your interpretations, research questions, claim, etc. say about how the world (the mind, people. learning) work(s)? Read papers and blog a 500-word reflection on each.
Explicit awareness of theoretical premises
Placement of theory in scholarly context
Theory section of Congress presentation
Issues-oriented literature
For your very favorite episode: Identify papers relevant to the claim you are making. Read papers and blog a 500-word reflection on each.
Situating work relative to existing scholarship
Literature review of Congress presentation
Presentation
Create a presentation for the EPSRI Congress.
Present work to colleagues
Presentation to EPSRI Congress


Friday, June 15, 2012

Good blog posts

As an I-RISE scholar, you share your work in two ways: (1) by talking to the people around you and (2) by posting to this blog. Talking to people is fun and generative and you should do a lot of it while you’re here. But if (and only if) you blog, your contribution to the research can last longer than your visit. Thanks to previous scholars, this blog is now a valuable archive of research contributions from many perspectives.

Good blog posts come in a variety of different types.

Episode posts
Some posts are primarily for the purpose of sharing a video episode. They consist of (1) the episode, maybe with a bit of transcript, and (2) enough context so that the reader can understand what’s going on. They may also contain a bit of what the scholar thinks of the episode. Here are some good posts of this type.
Some blog posts in this category not only share a video episode, but also conduct significant analysis of that episode and/or delve into the literature that informs the scholar’s interpretation of events. These are the kinds of posts that could be the starting point for research projects. They are something to aspire to, but they can take days to produce; try to balance depth with coverage.

Issue posts
Some posts put out an issue for discussion that is not attached to a particular episode; it’s just something on the scholar’s mind that s/he wants to put out there for others to consider and comment on. The comment threads on some of these are significant.
“Field energy – my own curiosity” (Emma Kahle) 

Event posts
Some blog posts document an event that is worth sharing, but for which there is not video. In this case, the blog post is possibly the only record of what happened. They can be research-worthy or lighthearted.
“S.C.R.E.A.M.” (Rachel Scherr)
“Coffee break” (Dorothy Echodu)
“My favorite quote of the day” (Sam McKagan) 
“Vortex of intellectual intensity” (Rachel Scherr)

Features of good blog posts
There is a lot to be said for just reading these posts and getting a sense of what different kinds of good posts can be like. I noticed the following features that I think these posts all have:

  • They tell a little story. They have narrative coherence, instead of being just notes or a list or a transcript.  
  • They tell you enough about what was going on that you feel like you are back in the scene, without being so detailed that you feel swamped with minutiae. 
  • They have a good title – one that tells you what the post is actually about. 

What other features do you notice that the good posts have in common? (Answer in the comments!) 

You might find it instructive to browse around the blog and find blog posts that seem to lack the features that make them valuable for later readers. Please don’t judge the authors – it’s an art form that we are all learning!

Thursday, June 14, 2012

Episode selection

One of your most important responsibilities as an I-RISE scholar is episode selection. Episode selection is when you identify and share short bits of video within the longer video record that deserve special attention. There are at least three important purposes of episode selection:

1. To make your own intellectual contribution to the data you collect. We don’t bring you here just to run a video camera; we want to know what you think about what you see. Episode selection is a major means of substantive engagement with the data.

2. To give the other I-RISE scholars and directors the opportunity to collaborate with you on what you are observing. Episode selection is how you show other people what you’ve seen. It enables you to have evidence-based discussions of what occurred and get the benefit of each other’s perspectives on it.

3. To give later researchers entry points for investigation. I-RISE scholars produce about 160 hours of video every week (20 hours each). If all of your hours just get shelved, it’s good that they’re there, but later researchers won’t know where to start.

Here are the basic instructions for episode selection:
Find and share a moment where something interesting happens. 
That’s really it. Now I will try to unpack this for you.

"Find" 
You will be observing what’s happening in the class as you videotape, by watching the whole class visually, by listening to your group with headphones, and by taking page after page after page of time-stamped fieldnotes. Some things that you see happen will stand out to you as especially exciting or noteworthy. (If you don’t see anything all that interesting, or if you are not sure, you may be taping the wrong group; consult your director.) In order to find those exciting or noteworthy things in the video record later, write the word “FLAG” in the field notes, along with a short description of what caught your eye. For example, “FLAG: Usefulness of energy” or “FLAG: Tons of gestures.”

It takes a few hours, or overnight, for your video to become available to you. This is because it has to be retrieved from the camera, archived to multiple locations, and converted to an editable format before you can have at it. Write enough in the field notes that you will be able to find your spot in the video later and remember what was so cool about it.

“Share”
There are two crucial forms of sharing in the I-RISE. One is to grab whoever else is around and show them your episode. The other is to post the episode to the blog. Do both of these as much as you can.

“A moment”
In my episode-selection world, a moment is a few minutes. Under five minutes is best. Two minutes is excellent. You are likely to identify longer sequences of interaction that are interesting to you: for example, it might take a group of participants twenty minutes to work out an Energy Theater enactment and you feel like you need the whole thing in order for it to make sense. That’s fine; go ahead and identify that longer sequence, blog about it, and label/archive it for other people to access. You will find, though, that very few of your fellow researchers will be able to collaborate with you on an episode that is more than five minutes. There’s just too much that happens in that long of a video; your viewer will not know what to focus on, and won’t be much use to you in helping you refine your ideas. Try really hard to find a short episode within your longer sequence that is makes your point. Engaging in this effort will help you recognize what point you think this piece of data makes. In other words, it will push you toward claim development.

“Something happens”
An event is something that happens. The time scale of a couple minutes corresponds to a certain kind of event. For example, a learner presents an idea; another participant responds to that idea; multiple learners negotiate a joint understanding. Each of these events could correspond to an episode.

Alternatively, an event could be something that happens on a shorter time scale: someone makes a certain gesture, uses a certain surprising word, stomps her foot, something like that. For these kinds of events, you can make a short episode (perhaps under 30 seconds); or you may find that you still need two minutes to provide context for the quick event.

For each episode that you share, you will need to explain to your audience what you see happening in that episode – the nature of the event.

“Interesting”
This is the word that really seems to worry some people. What does it mean for something to be “interesting”? What kinds of things are interesting? Interesting to who? Here are a few possible answers.

  • Your areas of interest. You are a scholar with a unique background and experiences. Those experiences shape what you see when you make observations. For example, a high school teacher might especially notice teaching strategies that instructors use in the class, whereas a graduate researcher with cognitive science background might see evidence of mental models. Please share your perspective with us by selecting episodes that highlight your own interests. 
  • Energy Project research themes. We have a number of existing research themes, and we are interested in whatever you might see that contributes to one of those themes. You don’t have to provide episodes that match our themes, but if you see something, we’d love to know. 
  • You can’t get it out of your head. If history is any indication, you will probably observe something in class that is compelling to you, maybe even to the point of causing an emotional response. It may get under your skin, in a good way or a bad way. Maybe someone will say something that strikes you as strange or out of character. Maybe people will think of the physics in a way that you’re not sure if it’s right or wrong. Maybe you will see people debating the nature of learning. Maybe there will be uncomfortable argument. Maybe something will happen that you don’t quite know what it was, but something about it won’t let you go. These are often the most wonderfully productive starting points for investigation. Please select these episodes.

Monday, June 4, 2012

How to document a class session with video and photos

This is not going to be a detailed instruction manual for the specific equipment we use; we'll do that part in person. This is an overview of the procedures for video- and photo-recording a class session.

1. Arrival
Arrive at 8am so that you have time to get things in order before class starts at 8:30.

2. Equipment check
Every day and also at lunchtime, our technical assistant will have charged the cameras and put fresh memory cards in them, as well as putting fresh batteries in the microphones. Double-check to make sure nothing was missed.

3. Microphone wearer
The first order of business is to select a microphone-wearer for the day. You have to know who this will be before you can set up any other equipment. Try to choose a person who interacts a lot and who seems to be part of a good group. Ideally, your chosen person sits physically in the middle of the group, for the best pickup. Approach him or her, introduce yourself, and say something like the following:

You: "Would you be willing to be one of our microphone-wearers today? We're asking different people every day and we would really appreciate your help." *
Participant: "Um, sure, okay."
You: "Thank you so much. It really helps us out. The way it works is, you clip this part to your shirt, and put this part in your pocket or on your belt. If you need to turn it off, here's how - you open it up, and hold down this button. But realistically if you leave the room to use the restroom or for a personal matter you'll go out of range, anyway. If your group leaves the room to work, you'll see one of us hanging around.
Thanks again, we really appreciate everyone's willingness to take a turn."
(Participants at the table will now make predictable nervous jokes about being recorded.)
You: "I just want to assure you that we're not monitoring you and we're not interested in your private conversation or anything like that. We just know that the best work that you do is the work you do together, and we really appreciate getting the opportunity to observe that."

Before you go, learn their names; you will need them while taking field notes.

* Do not say, "Would you like to wear the microphone today?" - that makes it sound like they may as well let someone else have the privilege. Of course, if someone really doesn't want to, thank them and move on to someone else.

If you are observing in the afternoon, consult with your morning counterpart to decide whether to change mic wearers or not. If it's an interesting group, don't change; if they are less interactive, or seem uncomfortable or dysfunctional or anything like that, then change. Consult your Director for advice.

4. Camera setup
Position your camera so as to see the mic wearer well. Try shelves, countertops, whatever you can swing. The tripods can wrap around things so go ahead and get creative. Always plug in the camera when you can, so that you preserve the battery for when you need to be mobile.

Once you are set up, do a sound check, start recording (red means recording!), and find a place to settle in and take field notes. However, keep in mind that this is the kind of class where they're going to get up and move around. When they do, you will need to grab the camera and microphone receiver (these are both small) and follow them as best you can, be that out into another room or whatever. You will need to disconnect the camera's power cord as well as the wireless headphones, since the "base station" for those is big and clunky. Have other headphones handy so that you can still listen.

Do your best to be unobtrusive, but don't try to pretend you're invisible. You're not. We will make sure you get to interact with the teachers, which helps reduce the awkwardness of your observing them. During class, they will attend to you occasionally, but most of the time they have more interesting things to do than joke about the camera. Do what you can to minimize the disturbance to the class - the reason they are here is to learn with each other, not to provide us with video subjects.

5. Photography
We are responsible for still photography, as well. Every time the class takes a break, photograph every white board the participants produce - all the groups, not only the group you are observing. We need to know not only what's on the white board, but whose white board it is. The best technique is to have someone hold the board upright (to avoid glare from the ceiling lights) and photograph it from an angle that includes the table number in the photo.

2012 I-RISE Scholars

I-RISE for "Understanding Energy" (course for elementary teachers) -- June 26-July 6, 2012 
Hunter Close, Faculty, Texas State University
Michele Dillon, Undergraduate, Chicago State University
Benjamin Geller, Graduate Student, University of Maryland - College Park
Renee Michelle Goertzen, Postdoctoral Fellow, Florida International University
Brandon Lunk, Graduate Student, North Carolina State University
Joshua von Korff, Postdoctoral Fellow, Kansas State University
Lindsay Wells, Millbrook High School / Knowles Science Teaching Fellowship

I-RISE for "Energy" (course for secondary teachers) -- August 6-21, 2012 
Alex Barr, Postdoctoral Fellow, University of Texas at Austin
Brian Frank, Faculty, Middle Tennessee State University
Brant Hinrichs, Faculty, Drury University
Benjamin van Dusen, Graduate Student, University of Colorado - Boulder
Virginia Hayes, Undergraduate, Chicago State University
Gina Quan, Undergraduate, University of California - Berkeley
Rance Solomon, Undergraduate, Middle Tennessee State University
Tasha Williams, Undergraduate, Chicago State University

Friday, June 1, 2012

Existing Research Themes

Below are some of the ongoing research interests of the Energy Project. We encourage you to pursue whatever research interests grab you, whether those originate with you or with us. You do not need to pursue any of these. However, to help prepare for your I-RISE experience, we encourage you to pick at least ONE of the following topics and read at least some of the related articles and blog posts.


Conceptual metaphors for energy 
We find it very useful to use a substance metaphor for energy, in which objects are containers, and energy is in the containers. This metaphor supports ideas of conservation, flow, transfer, storage, etc, which are among our primary learning goals.


Forms of energy
Another primary learning goal is to coordinate our theoretical model of energy with observable properties of objects. One way we do this is by categorizing energy into forms that correspond to types of observable evidence of energy.


Energy conservation in physics and in society
Energy conservation is central both in a sociopolitical sense and in the formal study of physics, but the term has a different meaning in each context. In physics, energy conservation refers to the idea that the same total quantity of energy is always present in any closed system; energy is neither created nor destroyed. In the pubic consciousness, however, energy conservation refers to the idea that we have to guard against energy being wasted or used up; the energy available to serve human purposes is both created (in power plants) and destroyed (in processes that render it unavailable to us). We are creating a conceptual model for what happens to energy during physical processes, expecting to eventually include entropy and the second law of thermodynamics.


Representations of energy
The Energy Project developed has developed special representations that we call "Energy Tracking Representations," because they support learners in conserving and tracking energy as it flows from object to object and changes form. Such representations enable detailed modeling of energy dynamics in complex physical processes.


Embodied learning activities
An Embodied Learning Activity (ELA) is when instructors deliberately arrange for human bodies or parts of the body to stand for entities in the description or explanation of a phenomenon. ELAs are intended to promote and externalize conceptual understanding in physics for the benefit of the learner, the instructor and the researcher. An ELA we call "Energy Theater" plays a central role in Energy Project instruction.


Assessing responsive teaching
We are formulating a framework for assessing the extent to which teachers respond to the disciplinary substance of student ideas as they arise during classroom instruction.


Assessing aspects of the nature of science
We would like to measure growth in teachers' perceptions of science as flexible and constructed, as well as growth in their perceptions of themselves as participants in the scientific community.


Research paradigms in PER
We seek to understand explicit and implicit similarities and differences between research paradigms in PER.