Scoring the Draw A Scientist Task
Last updated
Last updated
You will be scoring each drawing on three dimensions: the APPEARANCE of the scientist, the LOCATION that the drawing is set in, and the ACTIVITY that the scientist is doing.
Illustrations which score a “1” in APPEARANCE can be referred to as “sensationalized.” These drawings contain a man or a woman who may resemble a monster or who has clearly odd, or comic book-like APPEARANCE.
Illustrations which score a “2” in APPEARANCE can be referred to as “traditional.” These drawings contain a standard looking white male.
Illustrations which score a “3” in APPEARANCE can be referred to as “broader than traditional.” These drawings include a minority or woman scientist.
Illustrations which score a “0” in APPEARANCE can be referred to as “can’t be categorized.” These drawings may contain a stick figure, a historical figure, or no scientist or a teacher/student.
Illustrations which score a “1” in LOCATION can be referred to as “sensationalized.” These drawings contain a LOCATION that resembles a basement, cave, or setting of secrecy, scariness or horror, often with elaborate equipment not normally found in a laboratory.
Illustrations which score a “2” in LOCATION can be referred to as “traditional.” The setting of this drawing is a traditional laboratory with a table and equipment (may include a computer) in a normal-looking room.
Illustrations which score a “3” in LOCATION can be referred to as “broader than traditional.” These drawings include a scene that is not a basement laboratory and different from a traditional laboratory setting.
Illustrations which score a “0” in LOCATION can be referred to “cannot be categorized.” The scene of this drawing may be difficult to determine or that of a classroom.
Illustrations which score a “1” in ACTIVITY can be referred to as “sensationalized.” These drawings reveal an ACTIVITY that may include scariness or horror, often with elaborate equipment not normally found in a laboratory. Drawings which include fire, explosives, or dangerous work are also included in this category.
Illustrations which score a “2” in ACTIVITY can be referred to as “naïve or traditional.” These drawings reveal an ACTIVITY that the student believes may happen, but in truth, the ACTIVITY is highly unlikely to occur. This category also includes drawings where the student writes, “this scientist is studying...or trying to...,” but does not show how this is being done.
Illustrations which score a “3” in ACTIVITY can be referred to as “Broader than Traditional.” These drawings portray realistic activities that reflect the work a scientist might actually do with the appropriate tools needed to perform these activities. A student may write, “this scientist is studying...or trying to...,” and shows how this is being done.
Illustrations which score a “0” for ACTIVITY can be referred to as “difficult/unable to determine.”
Once you have read the mDAST article and the scoring criteria, you are ready to score some practice drawings.
For the first THREE practice drawings, we will score them out loud together.
For the next FIVE practice drawings, we will score them silently on our own and then check our inter-rater reliability. Please make a copy of this scoring sheet and put your name in the new sheet's title, and make sure it's shared with bergelsonlabharvard@gmail.com (or better yet, that it's owned by that email).
If need be, we will score FIVE more practice drawings to establish higher reliability.
Our goal will be to establish 80% reliability or higher between two sets of two coders.
Then, pairs of two trained coders will score each drawing from Feb-March elementary school students. Names will be withheld (if visible on the front of drawing), but we will only score drawings from students who submitted both Session 1 and Session 4 drawings.
Scores from two coders will be added together in each dimension to produce a raw score by dimension.