In my inquiry course, students take a group exam with their research team. In the group exam, students are presented with a novel situation that they have not encountered before, although it is one I am confident they have the ideas to make sense of over the course of 30-40 minutes. As a group, they have to collectively come to a prediction and explain why that prediction should happen using words and diagrams that are consistent with the ideas we have developed as a class. They then go make the observation.
If they get the prediction wrong, they have to do two things:
(1) Explain how they are making sense of what they did observe
(2) Attend to the flaw in the reasoning or diagram that led them to initial prediction
If they they get it right, they also have to do two things:
(1) Discuss a different answer that some other person could have thought would happen and why they would think this
(2) Discuss the flaw in that reasoning.
I don’t grade on correctness of initial prediction at all. I do grade on the clarity, consistency, and completeness of their explanations and diagrams. Any lack of consistency or completeness in the initial explanation, which is later addressed after the observation is fine by me. Of course that means they can’t just explain the right answer after the fact; they also have to go back to their original explanation to discuss the flaw in their original thinking–specifically address what inconsistency or incompleteness was present.
In the exam this week, the groups that predicted correctly seemed to have done a worse job than those groups who predicted wrong. By worse, I mean that their final explanations were less clear, more inconsistent, and less complete than the other groups. I’ve been pondering over why this might be the case. I think it’s for several reasons:
(1) When you get the prediction wrong, there is a much more authentic need to explain the discrepant observation. It is problematic that the observation turned out that way it did. This authenticity drives different engagement with the task.
(2) Groups who get it wrong spend a lot more time discussing. It takes time and effort to really put together a good explanation.
(3) Groups who get it wrong not only have to sort out the right explanation, but they need to sort through their wrong explanations. Sure, groups who get it right still have to create a fictional wrong idea and response, but it’s not the same as responding to your own wrong idea.
(4) For groups who get the prediction right, there is very little check on “getting it right for the wrong reason”. So, groups who get it right and observe have very little incentive to reconsider their thinking.
(5) Even if you get the prediction correct for fairly correct reasons, it may just seem obvious to you why the answer is what it is, and you may construct a poor explanation, just because you don’t feel like there’s much to explain. Maybe students have the right explanation in mind, but they don’t put time and effort into carefully constructing that argument in words and diagrams.
Anyway, it’s an interesting situation. I will say that no groups did poorly, but by far the best final explanations came from groups who were articulate and clear about their wrong reasoning to start with.
Brain,
Can you put up some examples of the novel situations you use in these exams?
I’ll post specifics after students finish their take home and other students who missed it do the make up.
It’s really a game of figuring out, “where is the boundary of the class’ understanding?” And finding some context that is just at that boundary. If it’s too easy, everyone will get it right. If it’s too hard, no one will be able to make sense of it. I think the only reason I make a good guess is because I’m the best listener in class, and I’ve thought more about their ideas than they have. No class is ever quite the same with respect to that boundary.
Leslie, you around? How do you write exam questions for you inquiry course?