{"id":859,"date":"2008-03-01T01:11:00","date_gmt":"2008-03-01T01:11:00","guid":{"rendered":"http:\/\/localhost:8888\/cite\/2016\/02\/09\/evaluating-alignment-of-technology-and-primary-source-use-within-a-history-classroom\/"},"modified":"2016-06-04T01:42:58","modified_gmt":"2016-06-04T01:42:58","slug":"evaluating-alignment-of-technology-and-primary-source-use-within-a-history-classroom","status":"publish","type":"post","link":"https:\/\/citejournal.org\/volume-8\/issue-2-08\/current-practice\/evaluating-alignment-of-technology-and-primary-source-use-within-a-history-classroom","title":{"rendered":"Evaluating Alignment of Technology and Primary Source Use Within a History Classroom"},"content":{"rendered":"

 <\/p>\n

The chief value of technology lies, therefore, in providing the leverage so urgently needed for moving social studies instruction away from passive, teacher-dominated approaches emphasizing recall and regurgitation toward active student centered forms of learning demanding critical and conceptual thinking from all students at all levels. (Crocco, 2001, p. 2)<\/p><\/blockquote>\n

Researchers in the teaching and learning of history advocate instructional approaches that engage students in the process of \u201cdoing\u201d history, including building historical knowledge through the use of primary sources, conducting historical inquiry, and encouraging students to think historically (Kobrin, 1996; Levstik & Barton, 2001; van Hover & Yeager, 2002; Wineburg, 1991). This approach encourages students to raise questions and to marshal solid evidence in support of their answers; to go beyond the facts presented in their textbooks and examine the historical record for themselves; to consult documents, journals, diaries, artifacts, historic sites, works of art, quantitative data, and other evidence from the past, and to do so imaginatively\u2015taking into account the historical context in which these records were created and comparing the multiple points of view of those on the scene at the time to build understandings of historical significance (Levstik, 1996; Seixas, 1996; Wineburg, 1991; Yeager & Davis, 1996).<\/p>\n

For history teachers wanting to embrace historical thinking processes in the social studies classroom, there is much promise. In response to the greater demand for primary and secondary resources, Web sites or archives of historic documents created by libraries, universities, and government agencies have proliferated. These sites allow teachers to access and download documents free of charge for use in the social studies classroom.\u00a0 By allowing students to explore the raw materials of the past, digital history sites, as well as the use of complementary technologies, have the potential to engage students actively in the construction and interpretation of history (Ayers, 1999; Braun & Rissinger, 1999; Tally, 1996).<\/p>\n

However, using primary sources does not automatically translate into historical thinking (Swan & Hicks, 2007).\u00a0 Rather, it is the teacher who juxtaposes documents against one another, who asks critical thinking questions of a document, or who elicits the bias or perspective of the author of the document that allows students to practice historical inquiry skills.\u00a0 As the quote in beginning of this article suggests, technology has the potential for facilitating these processes, but it is the teacher who leverages the technology to conduct historical inquiry in the classroom.<\/p>\n

To date, little research has been done within this framework of intersection between historical thinking and technology in the history classroom (Swan & Hofer, 2008). As researchers wanting to explore this relationship, we constructed an evaluation matrix that would aid in categorizing observational data for one qualitative study of three secondary American history teachers and their uses of primary sources.\u00a0 In this article, we provide background information on the development of the evaluation matrix, present the instrument, and evaluate its effectiveness in categorizing both primary source and technology usage.<\/p>\n

Developing the Tool<\/p>\n

Miles and Huberman (1994) stated,\u00a0 \u201cA conceptual framework explains, either graphically or in narrative form, the main things to be studied \u2013 the key factors, constructs or variables \u2013 and the presumed relationships among them\u201d (p. 18). The development of the conceptual framework for the study, grounded in the literature on the efforts to bring technology and primary sources into history education, helped to provide a focus for the inquiry and means to display the data for analysis.\u00a0 Embedded within the framework are foundational premises about the relationship between technology and the teaching of history.<\/p>\n

Students\u2019 technology skills need to be more than a distinct and often disconnected goal of the curriculum (International Society for Technology in Education, 2007; Mason et al., 2000), but also an embedded support for instructional designs that move beyond teacher-centered, textbook-driven approaches and toward models in which students are more actively involved in their learning (Doolittle & Hicks, 2003; Harris, 1995; Mason et al., 2000; van Hover, Berson, Bolick, & Swan, 2004). Ideally, the technology is employed not only to invite student engagement, but to broaden and deepen student understandings through the purposeful acquisition and assembly of materials to guide students\u2019 learning and encourage independent inquiry.<\/p>\n

According to Crocco (2001), technology-infused pedagogy is evident in \u201cclassrooms that foster questioning, challenging, and reflecting by all students\u201d (p. 388). Incorporating the technology without framing it in sound pedagogy runs the risk of \u201cinvesting a great deal of time, attention, and money to educationally marginal means\u201d (Crocco, 2001, p. 387).\u00a0 More recently, Crocco\u2019s argument has been echoed in the development of Technological Pedagogical Content Knowledge (TPCK; Mishra & Koehler, 2006).<\/p>\n

In the area of history instruction, the interpretive student stance advocated by Crocco is wholly consistent with the broader orientation toward disciplined inquiry and historical thinking advanced by Levstik and Barton (2001) and others (Kobrin 1996; van Hover & Yeager, 2002, Wineburg, 1991). The second premise holds that an orientation toward historical thinking is valid and desirable and can be uniquely supported by technology at several pedagogical stages (Brush & Saye, 2000; Hicks, Doolittle, & Lee, 2004; Hofer & Swan, 2006; Lee & Calandra, 2004; Saye & Brush, 1999; Swan & Hicks, 2007). The National Standards for History<\/i> (National Center for History in Schools, NCHIS, 1996) characterized a set of five core skills under the broad concept of historical thinking; these include chronological thinking, historical comprehension, historical analysis and interpretation, historical research capabilities and historical issues-analysis and decisionmaking. From these historical habits of mind historiography, the writing of history, proceeds (Holt, 1995; Levstik & Barton, 2001; Van Sledright, 2001).<\/p>\n

Students are exposed to the ways historians use text-based and nontext primary sources, relics, and artifacts as building blocks in the historiographic process. The goals of the history curriculum encompass the narrative explanation of historical events, as well as the consideration of broader structures and themes and the inclusion of historiographic processes referred to by Leinhardt (1993) as metasystems.<\/p>\n

When such metasystemic processes are appropriately scaled and applied to the classroom use of historical sources, students are expected to frame historical questions, look for and evaluate evidence, identify viewpoints, make connections across sources, assess relevance, draw inferences from text and nontext resources, and develop plausible historical narrative of their own (Barton, 2001). Technology can play several roles in this multistep process, serving as a repository from which sources can be acquired, a platform through which the sources can be delivered and evaluated, and a tool through which student understandings can be demonstrated and assessed.<\/p>\n

These premises were incorporated into developing our evaluative instrument in several ways. First, historical thinking can clearly be taught well without using electronic means of access, delivery, and product demonstration. Consequently, the evaluation of the overall fidelity of the instructional design must be separate from, and must effectively outweigh, the evaluation of technology use per se. Similarly, primary sources are a necessary but not sufficient condition for the practice of historical thinking in the history classroom.\u00a0 For example, a teacher might use a primary source so that students could uncover author bias or to juxtapose it against another document of the same event to understand more fully multiple perspectives in history.\u00a0 In doing so, teachers are building students\u2019 understanding of historical comprehension<\/i> as laid out by the National Standards for History<\/i> (NCHS, 1996).<\/p>\n

Conversely, teachers could use primary sources as they would a textbook, not asking any questions of the authenticity or reliability of the document, but rather using primary sources as a content delivery mechanism.\u00a0 Although primary sources provide an entry point into historical scholarship, simply using primary sources does not translate into historical thinking (Barton, 2005).\u00a0 For those reasons, the evaluation matrix (see Appendix A [PDF]<\/a>) was constructed to gauge the fidelity of primary source use according to three domains, curriculum content, instructional processes, and student products or outcomes (Tomlinson, 1995).<\/p>\n

The first domain, \u201cContent,\u201d consists of the ideas, concepts, descriptive information, and facts, rules, and principles presented to the learner (Tomlinson, 1995). Since we were concerned with measuring the content specific to historical thinking processes, we viewed primary sources as the foundation for the teaching of history.\u00a0 In the evaluation matrix, primary sources used in the classroom were evaluated for their complexity, variety, and orientation.<\/p>\n

The second domain, \u201cInstructional Process,\u201d incorporated the presentation of content, including the design of learning activities for students, the framing of analytical questions, as well as the teaching methods and thinking skills used in the classroom (Tomlinson, 1995). <\/i>Because the study was confined to measuring methods of historical thinking, instructional process was limited to the way in which primary sources were used in exercises promoting historical interpretation, teaching historical methodology, and assembling historical narratives. This component of the matrix was informed, in part, by the continuum of historical teaching purposes framed by Leinhardt (1993).<\/p>\n

Finally, \u201cProducts\u201d are the outcomes of instruction that consolidate learning and communicate ideas (Tomlinson, 1995).\u00a0 The last domain of the evaluation matrix gauged the use of primary sources in assessment, looking at the autonomy given to students in constructing historical narratives.\u00a0 Specifically, assessments were dissected to examine the level of independence given to students in historical inquiry, the degree to which students were supplied primary sources within the assessment, and the extent to which students documented the historical processes used within the assessment.<\/p>\n

The three domains (content, process, and product) were broken into four components, which assumed greater degrees of fidelity.\u00a0 Because no similar evaluation tool existed at the time of this study, we called upon our own experiences as former high school history teachers and current teacher educators, as well as the amalgam of theoretical frameworks that presume levels of sophistication in the various components of instructional design, including content, process, and product, as well as technology integration (Crocco, 2001; Harris, 1997; International Society for Technology in Education, 2007; Kobrin, 1996; Levstik & Barton, 2001; Mishra & Koehler, 2006; Shulman, 1986).<\/p>\n

Although the first three components of each domain related to use of primary sources, the fourth component addressed the use of technology within the three instructional domains.\u00a0 For the technology component, the evaluation matrix confined the use of technology to a mechanism for teachers to acquire primary sources, for students or teachers to deliver primary sources for instruction, and finally, for students to construct a historical narrative using various software (e.g., Microsoft Powerpoint, or iMovie) and hardware (e.g., laptops, projectors, etc.).<\/p>\n

Special attention has been given to the relationship between the use of primary sources and technology, noting these two facets of instruction are potentially mutually exclusive. For example, a teacher may promote historical thinking in the classroom using a multitude of nondigitally acquired primary sources as a means of reconstructing a particular event.\u00a0 The teacher could have students write historical narratives taking into account author bias and historical perspective, meanwhile documenting the metacognitive skills necessary in historical research.\u00a0 Because we aimed to elucidate the role technology played in facilitating historical thinking, it was necessary to provide a mechanism for excluding technology as a factor in historical thinking.\u00a0 The evaluation matrix was constructed with this in mind and provided a lens for examining the data collected.\u00a0 A summary of the evaluation matrix is provided in Table 1.<\/p>\n

Table 1<\/b>
\nAn Evaluation Matrix (Abridged) for the Use of Primary Sources and Technology in the Secondary Classroom<\/i><\/p>\n\n\n\n\n\n\n\n
<\/td>\nPrimary Source Use<\/b><\/td>\nTechnology Use<\/b><\/td>\n<\/tr>\n
Domain<\/b><\/td>\nComponent 1<\/b><\/td>\nComponent 2<\/b><\/td>\nComponent 3<\/b><\/td>\nComponent 4<\/b><\/td>\n<\/tr>\n
\n

Content<\/p>\n<\/td>\n

Complexity<\/i>; to what extent the primary source(s) is appropriate for the student population.<\/td>\nVariety<\/i>; the degree to which various types of primary sources are employed within the lesson.<\/td>\nOrientation<\/i>; the degree to which the primary source(s) encompasses divergent perspectives.<\/td>\nAcquisition<\/i>; mechanisms through which the primary source(s) acquired.<\/td>\n<\/tr>\n
\n

Process<\/p>\n<\/td>\n

Fidelity<\/i>; the level of interpretation required of students in the reading the primary source(s).<\/td>\nPurpose<\/i>; the degree to which primary sources are used to teach students about historical processes.<\/td>\nActivity<\/i>; the degree of student participation in constructing historical accounts using primary sources.<\/td>\nDelivery<\/i>\u00a0extent to which technology is used by the instructor and students to present or manipulate the primary sources.<\/td>\n<\/tr>\n
\n

Product<\/p>\n<\/td>\n

Authenticity<\/i>; the level of independence given to students as they analyze the primary source(s) in the assessment.<\/td>\nSourcing<\/i>; the degree to which primary sources are supplied for use within the assessment.<\/td>\nDevelopment<\/i>; the degree to which students are expected to document and defend the historical processes used within the assessment.<\/td>\nDemonstration<\/i>; \u00a0the extent to which technology is incorporated within the assessment.<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

\u00a0<\/b><\/p>\n

Using the Evaluation Matrix<\/p>\n

The study entailed following three 11th-grade American history teachers during the 2003-2004 academic year.\u00a0 These teachers attended a sequence of professional development workshops sponsored by the historians at a digital history center at a large Southern public university. These University faculty members had begun developing resources to address the issues of access and implementation of primary sources that teachers face. In 2002, the digital history center developed professional development workshops intended to train American history teachers in the use of digitized primary sources and the online multimedia guide. Initial surveys of these three teachers indicated instructional practices that included the frequent use of primary sources within their American history curriculum and a varied response in the use of technology in supporting historical thinking practices.<\/p>\n

The evaluation matrix was used in observations to validate the teachers\u2019 self-reports, as well as to describe qualitatively the teaching methods used by each participant. Of particular interest were the ways in which these secondary history teachers used primary sources, whether their use constituted historical thinking (as defined by the study\u2019s conceptual framework), and finally, the contextual factors influencing use of primary sources.\u00a0\u00a0 Additionally, this study sought to explicate the role of technology in supporting historical thinking practices, as well as the intrinsic and extrinsic influences that inhibited or prohibited the effective use of technology as it related to historical thinking.<\/p>\n

Observations were conducted 12 to 15 times per participant using the evaluation matrix. Although all three participants consistently used primary sources in their American history classrooms, the three varied notably in the role primary sources played in the overall curricular design, as well as in the degree of instructional sophistication with which the sources were employed.\u00a0 Their use was characterized by degrees of sophistication, prevalence within the curriculum, and level of student centeredness within each lesson.\u00a0 Using the evaluation matrix, Table 2 offers both a characterization and summary of use in terms of historical content, instructional processes, and classroom assessment for each participant.<\/p>\n

Table 2<\/b>
\nCharacterization of Primary Source Use in Supporting Historical Thinking Practices<\/i><\/p>\n

 <\/p>\n\n\n\n\n\n\n
Participant<\/strong><\/td>\nCharacterization of Primary Sources Use<\/b><\/td>\nUse of Primary Sources in Teaching Historical Content<\/b><\/td>\nUse of Primary Sources in Facilitating Instructional Process\u00a0<\/b><\/td>\nUse of Primary Sources as Components of Student Assessment\u00a0<\/b><\/td>\n<\/tr>\n
\n

Larry<\/p>\n<\/td>\n

Sophisticated and systematic.<\/td>\nThe primary sources were exclusively teacher selected and varied in complexity, type, and orientation.<\/td>\nReading strategies required sourcing, or looking critically at the credibility of a source, as well as inductive analysis for drawing on larger historical themes.<\/td>\nAssessment included some forms of historical thinking that incorporated verified sources into a plausible historical narrative.<\/td>\n<\/tr>\n
\n

Jason<\/p>\n<\/td>\n

Inconsistent and rudimentary<\/td>\nThe primary sources used were exclusively teacher selected and were of inappropriate complexity and of a singular orientation.<\/td>\nNo reading or interpretation strategies were employed for either nonprint or print sources.<\/td>\nAssessment did not include the use of primary sources or historical thinking skills.<\/td>\n<\/tr>\n
\n

Jamie<\/p>\n<\/td>\n

Frequent and moderately sophisticated.<\/td>\nThe primary sources were mostly teacher selected and varied in type, but not orientation and complexity.<\/td>\nReading strategies included a basic evidential focus with some corroboration attempts. Sources were specific to a particular time and place and did not contribute to an ongoing narrative or structure.<\/td>\nAssessment included the occasional demonstration of discrete historical thinking skills, allowing students to acquire their own documents surrounding a historical issue\/event.<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

In almost all cases, the participants self-selected the primary sources used within the curriculum; however, there was a disparity in the types of documents the teachers chose, the way in which the teachers approached document analysis with their students, and the role of primary sources in the classroom assessment.\u00a0 For example, Larry (pseudonym) consistently assembled text-based documents that featured male authors who influenced American political history. The variety of documents was minimal, but the sources he selected were complex and allowed students to engage with multiple perspectives of a historical event.\u00a0 During many of the observations, we marked 1s or 2s for Variety <\/i>on the Content evaluation matrix, but\u00a0 3s and 4s for Complexity and Orientation.<\/p>\n

In contrast, Jamie and Jason (pseudonyms) used a myriad of nondiscursive documents (e.g. , photographs, political cartoons, maps, diary entries, and video) that were easily read and interpreted by their students.\u00a0 Although they often presented several primary sources per lesson, the sources did not contradict one another or the history textbook.\u00a0\u00a0 During these classroom observations, we marked the Content evaluation matrix with 1s and 2s for Complexity and Orientation, but 3s and 4s for Variety.<\/p>\n

Jamie and Jason had similar approaches to the types of primary sources they selected, yet they varied greatly in the ways they instructed their students to approach document analysis.\u00a0\u00a0\u00a0 Jamie trained her students to use a four-step method to unpack sources.\u00a0 This method began with determining the message of the source, the bias of the author, the purpose of the document, and the document\u2019s effectiveness in achieving its purpose.\u00a0 Often, the intention of this strategy outweighed its effectiveness in the classroom, but elements of scaffolding were evident within her instruction.<\/p>\n

Students in Larry\u2019s class effectively used the document reading strategy he called \u201cAPPARTS\u201d to analyze the documents.\u00a0 APPARTS stands for author, place, prior knowledge, audience, reason, the main idea, and significance.\u00a0 In addition to utilizing the acronym as an analytical framework for his classes, Larry incorporated a more nonlinear trajectory to his instruction, developing tentative assertions about sources, then setting them aside in order to revisit them after other sources had been examined. The degree to which Larry\u2019s students modeled their analyses after the competencies of professional historians led to these observations being generally coded higher under the Purpose<\/i> criterion.<\/p>\n

Jason, on the other hand, lacked any formal or informal strategy for document analysis, instead relying on an open ended, \u201cWhat do you guys think?\u201d We were able to use the Process evaluation matrix to characterize differences between the three teachers in terms of Fidelity, Purpose, and Activity.<\/p>\n

The participants also varied in their use of primary sources in classroom assessment.\u00a0 All three participants relied to varying degrees on traditional assessment, including multiple choice tests, objective quizzes, and chapter summaries.\u00a0 However, Jason used only traditional assessment, while Jamie and Larry included document analysis in their assessments.\u00a0 This use varied, and the Product<\/i> evaluation matrix was used to uncover these differences.\u00a0 Students in Larry\u2019s AP American History course were regularly given Document Based Questions as a way of preparing for the end-of-year exam but, more importantly, as a good teaching tool for historical inquiry.\u00a0 Jamie often used project-based assessment that required the inclusion of primary sources as a way of measuring historical understanding.\u00a0 Additionally, using primary sources, Jamie created her own multiple-choice questions to prepare her students for the state history exam.\u00a0\u00a0 We often marked 0s for Jason, 1s and 2s for Jamie, and 3s and 4s on the Product evaluation matrix.<\/p>\n

Participants\u2019 use of technology in instruction did not include attention to all of the components of effective technology use, as defined by the study\u2019s conceptual framework.\u00a0 All of the teachers used technology to acquire and display artifacts, but use of technology in instruction varied according to frequency and level of student centeredness.\u00a0\u00a0 For example, Larry rarely used technology to display primary sources, whereas Jason and Jamie used technology almost exclusively. It is important to again note that Larry\u2019s approach to teaching through these sources was less linear, with students returning to prior sources more frequently than in the other classroom settings, an instructional design that encouraged the use of hardcopy sources.\u00a0\u00a0 In terms of assessment, Jason and Larry rarely used technology, but Jamie regularly had students create Web pages, PowerPoint\u2019s, etc., that required the use of primary sources.\u00a0 Using the aggregated observations, the evaluation matrix (see Table 3) offers both a characterization and summary of technology use in supporting historical thinking practices.<\/p>\n

Table 3<\/b>
\nCharacterization and Technology Use in Supporting Historical Thinking Practices<\/i><\/p>\n

 <\/p>\n\n\n\n\n\n\n
Participant<\/strong><\/td>\n\n

Characterization of Technology Use to Support Historical Thinking Practices<\/b><\/p>\n<\/td>\n

\n

Technology Use in Acquiring Primary Sources<\/b>
\n(Content)<\/b><\/p>\n<\/td>\n

\n

Technology Use in Primary Source Delivery and Demonstration
\n<\/b>(Instruction and Assessment)<\/b><\/p>\n<\/td>\n<\/tr>\n

\n

Larry<\/p>\n<\/td>\n

Moderate use in document.<\/p>\n

Acquisition.<\/p>\n

Infrequent instructional and assessment use.<\/p>\n

Teacher directed.<\/td>\n

Acquired digital primary sources through self-directed research using search engines and other established Internet sources.<\/td>\nWith assistance of student teachers, occasionally leveraged technology in instruction and assessment as a means for creating interactive presentations and as a mechanism for viewing historical narratives.<\/td>\n<\/tr>\n
\n

Jason<\/p>\n<\/td>\n

Frequent use in document acquisition and instruction.<\/p>\n

Teacher directed.<\/td>\n

Acquired digital primary sources through self-directed research using search engines and other established Internet sources.<\/td>\nExtensively used presentation tools instructionally to view nondiscursive primary sources, but there was no evidence of technology in student assessment.<\/td>\n<\/tr>\n
\n

Jamie<\/p>\n<\/td>\n

Frequent use in document acquisition, instruction, and assessment.<\/p>\n

Teacher and student directed.<\/td>\n

Acquired digital primary sources through self-directed research using search engines and other established Internet sources.<\/td>\nExtensively used presentation software instructionally to view nondiscursive primary sources.\u00a0 Assessment was often constructed with a technology emphasis\u2014students were expected to use the Internet to generate their own digital resources and to employ presentations software to display primary sources.<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

The evaluation matrix allowed us to parse the observations consistently across participants.\u00a0 From the aggregated descriptors, we were able to make comparisons between participants and, ultimately, pursue contextual factors that might have influenced these characterizations.\u00a0 More importantly, we were able to disaggregate the data in important ways.\u00a0 All three participants used primary sources within their history classroom; however, we were able to show clearly that the teachers did not use the sources with the same degree of fidelity.\u00a0 Moreover, we argued that, although primary sources can represent an important platform for historical thinking, the sources themselves are insufficient without sound pedagogical design.\u00a0\u00a0 Additionally, we also posited that digital acquisition of primary sources could be a first step in building technology enhanced curriculum, but it was far from the inquiry-based history instruction touted in the social studies literature.<\/p>\n

Last, embedded within the conceptual framework for this study is the assumption that technology in history classrooms should not be used solely to build technology facility in students but rather as a mechanism to facilitate document-based instruction.\u00a0 As demonstrated in Table 3, although all three participants used technology, they were able to leverage technology to support historical thinking practices to varying degrees\u2014a subtle but important point emphasized within the instrument.<\/p>\n

Conclusion<\/p>\n

In a recent article by Mishra and Koehler (2006), the authors borrowed from Shulman (1986) to argue that effective technology integration requires developing sensitivity to the \u201cdynamic, transactional relationship\u201d between pedagogy, content, and technology (p. 1030).\u00a0 The instrument described here was crafted before the framework of technological pedagogical content knowledge (TPCK). Yet, it certainly imbeds the spirit of Mishra and Koehler\u2019s argument that in order to integrate technology and then to assess its effectiveness educators must take into account the complexity\u00a0and contextuality\u00a0of teaching. \u00a0As a result,\u00a0a checklist\u00a0that measured technological infusion outside of the context of the pedagogical objectives\u00a0supported by the technology was clearly insufficient.\u00a0Instead, the\u00a0best of a priori\u00a0evaluative instruments\u00a0would contain\u00a0a broad\u00a0framework of instructional\u00a0approach,\u00a0embedded\u00a0with applicable pedagogical sophistication\u00a0and set alongside descriptions of how the technology is being employed.<\/p>\n

The Evaluation Matrix described in this article, while at times unwieldy, allowed us to capture the rich, thick description called for in qualitative research (Geertz, 1973) but, more importantly, to capture the nuances of teaching practice.\u00a0\u00a0 Our hope is that other researchers, program evaluators, or school administrators could use this matrix in their own attempts to develop more integrated, or cohesive, protocols for assessing the efficacy of history instruction.<\/p>\n

References<\/p>\n

Ayers, E. (1999). History in hypertext.\u00a0 Virginia<\/i> Center for Digital History<\/i>. Retrieved September 25, 2007, from, http:\/\/www.vcdh.virginia.edu\/PastsFutures.html<\/a><\/p>\n

Barton, K. C. (2001). A picture’s worth: Analyzing historical photographs in the elementary grades. Social Education, 65<\/i>(5), 278-283.<\/p>\n

Barton, K. (2005).\u00a0 Teaching history: Primary sources in history \u2013 Breaking through the myths.\u00a0 Phi Delta Kappan<\/i>, 86<\/i>(10).<\/p>\n

Braun, J., & Risinger, F. (1999). Surfing social studies<\/i>. Washington, DC: National Council for the Social Studies.<\/p>\n

Brush, T., & Saye, J.\u00a0 (2000).\u00a0 Implementation and evaluation of a student-centered learning unit: A case study.\u00a0 Educational Technology, Research and Development, 48<\/i>(3), 79-100.<\/p>\n

Crocco, M.S. (2001). Leveraging constructivist learning in the social studies classroom: A response to Mason, Berson, Diem, Hicks, Lee, and Dralle. Contemporary\u00a0Issues in Technology and Teacher Education<\/em>, 1<\/em>(3) . Retrieved from https:\/\/citejournal.org\/vol1\/iss3\/currentissues\/socialstudies\/article2.htm<\/a><\/p>\n

Doolittle, P., & Hicks, D. (2003).\u00a0 Constructivism as a theoretical foundation for the use of technology in social studies.\u00a0 Theory and Research in Social Education<\/i>, 31<\/i>(1), 72-104.<\/p>\n

Geertz. C. (1973). The interpretation of cultures<\/i>. New York: Basic Books.<\/p>\n

Harris, J. (2005). Our agenda for technology integration: It’s time to choose. Contemporary Issues in Technology and Teacher Education, 5<\/i>(2), 116-122.<\/p>\n

Harris, J. (1997). Wetware: Why use activity structures.Learning and Leading with Technology<\/i>, 25<\/i>(4), 13-17.<\/p>\n

Hicks, D., Doolittle, P., & Lee, J. K. (2004). History and social studies teachers’ use of classroom and Web-based historical primary sources. Theory and Research in Social Education<\/i>, 32<\/i>(2), 213-247.<\/p>\n

Hofer, M., & Swan, K.O.\u00a0 (2006). Standards, firewalls, and general classroom mayhem: Implementing student-centered technology projects in the elementary classroom.\u00a0 Social Studies Research and Practice, <\/i>1<\/em>(1).\u00a0 Retrieved from http:\/\/www.socstrp.org\/issues\/viewarticle.cfm?volID=1&IssueID=1&ArticleID=13<\/a><\/p>\n

Holt, T. (1995). Thinking historically: Narrative, imagination and understanding<\/i>. New York: College Entrance Examination Board.<\/p>\n

International Society for Technology in Teacher Education. (2007).\u00a0 National educational standards and the states<\/i>.\u00a0 Retrieved from http:\/\/cnets.iste.org\/<\/a><\/p>\n

Kobrin, D. (1996).\u00a0 Beyond the textbook: Teaching history using documents and primary sources. <\/i>Portsmouth, NH: Heinemann.<\/p>\n

Lee, J. K., & Calandra, B. (2004). Can embedded annotations help high school students perform problem solving tasks using a Web-based historical document? Journal of Research on Technology in Education, 36<\/i>(4), 65-84.<\/p>\n

Leinhardt, G. (1993). Instructional explanations in history and mathematics. In\u00a0 Proceedings of the 15th Annual Conference of the Cognitive Science Society. <\/i>Hillsdale, NJ: Lawrence Erlbaum Associates.<\/p>\n

Levstik, L. S. (1996).\u00a0 Negotiating the historical landscape.\u00a0 Theory and Research in Social Education, 24<\/i>(4), 393-397.<\/p>\n

Levstik, L.S., & Barton, K. (2001).\u00a0 Doing history: Investigating with children in elementary and middle schools <\/i>(2nd ed.).\u00a0 New Jersey: Lawrence Erlbaum Associates.<\/p>\n

Mason, C., Berson, M., Diem, R., Hicks, D., Lee, J., & Dralle, T. (2000). Guidelines for using technology to prepare social studies teachers. Contemporary Issues in Technology and Teacher Education <\/em>[Online serial], 1<\/em>(1). Retrieved from https:\/\/citejournal.org\/vol1\/iss1\/currentissues\/socialstudies\/article1.htm<\/a><\/p>\n

Miles, M., & A. Huberman. (1994). An expanded sourcebook: Qualitative data analysis.<\/i> Thousand Oaks, CA: SAGE Publications.<\/p>\n

Mishra, P., & Koehler, M. J. (2006). Technological pedagogical content knowledge: A framework for integrating technology in teacher knowledge. Teachers College Record<\/i>, 108<\/i>(6), 1017-1054.<\/p>\n

National Center for History in the Schools. (Ed.). (1996). National standards for history.<\/i> Los Angeles: Author.<\/p>\n

Saye, J., & Brush, T. (1999). Student engagement with social issues in a multimedia supported learning environment. Theory and Research in Social Education<\/i>, 27<\/i>(4), 472 -504.<\/p>\n

Seixas, P. (1996). Conceptualizing growth in historical understanding. In D. Olson & N. Torrance (Eds.), Education and human development <\/i>(pp. 765-783). London: Blackwell.<\/p>\n

Shulman, L. S. (1986). Those who understand: Knowledge growth in teaching. Educational Researcher, 15<\/i>(2), 4-14.<\/p>\n

Swan, K., & Hicks, D. (2007) Through the democratic lens: The role of purpose in leveraging technology to support historical thinking in the social studies classroom. The International Journal of Social Studies Education<\/i>, 21<\/i>(2), 142-168.<\/p>\n

Swan, K., & Hofer, M. (2008). Information ecologies: Technology in the social studies.\u00a0 In L. Levstik, & C. Tyson (Eds.), Handbook of research on social studies teaching and learning<\/i> (pp. 307-326). Erlbaum Publishing.<\/p>\n

Tally, B. (1996). Up against authentic history.\u00a0 Electronic Learning<\/i>, 16<\/i>(2), 40-41.<\/p>\n

Tomlinson, C. (1995). How to differentiate instruction in mixed-ability classrooms. <\/i>Alexandria, VA: Association for Supervision and Curriculum Development.<\/p>\n

van Hover, S., Berson, M., Bolick, C., & Swan, K.. (2004). Implications of ubiquitous computing for the social studies. Journal of Computing in Teacher Education,<\/i> 20<\/i>(3), 107-112.<\/p>\n

van Hover, S.D., & Yeager, E.A. (2002).\u00a0 “Making students better people?” A case study of a beginning teacher.\u00a0 The International Studies Forum, 3<\/i>(1), 219-232.<\/p>\n

Van Sledright, B. (2001). From empathetic regard to self-understanding: Impositionality, empathy, and historical contextualization. In O.L. Davis Jr., E.A. Yeager, & S.J. Foster (Eds.), Historical empathy and perspective taking in the social studies<\/i>\u00a0(pp. 51-68). Lanham, MD: Rowan & Littlefield Publishers, Inc.<\/p>\n

Wineburg, S. S.\u00a0 (1991).\u00a0 On the reading of historical texts: Notes on the breach between school and academy.\u00a0 American Educational Research Journal, 28<\/i>(3), 495-519.<\/p>\n

Yeager, E.A., & Davis, O.L., Jr. (1996). Classroom teachers\u2019 thinking about historical texts: An exploratory study.\u00a0 Theory and Research in Social Education, 24<\/i>(2),<\/i> 146-66.<\/p>\n

Author Note:<\/p>\n

Kathleen Owings Swan
\nUniversity of Kentucky
\n343 Dickey Hall
\nLexington, KY 40506-017
\nPhone: 859-257-1893
\n
kswan@uky.edu<\/a><\/p>\n

David Locascio
\nLongwood University
\n201 High Street; Hull Room 215
\nFarmville, VA 23909
\nPhone: 434-395-2609
\n
locasciod@longwood.edu<\/a><\/p>\n

 <\/p>\n

<\/div>\n

<\/path><\/svg><\/i> \"Loading\"<\/p>\n

<\/div>\n","protected":false},"excerpt":{"rendered":"

  The chief value of technology lies, therefore, in providing the leverage so urgently needed for moving social studies instruction away from passive, teacher-dominated approaches emphasizing recall and regurgitation toward active student centered forms of learning demanding critical and conceptual thinking from all students at all levels. (Crocco, 2001, p. 2) Researchers in the teaching […]<\/p>\n

<\/div>\n

<\/path><\/svg><\/i> \"Loading\"<\/p>\n

<\/div>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":[],"meta":{"_acf_changed":false,"footnotes":""},"categories":[9],"publication":[57,28],"acf":[],"_links":{"self":[{"href":"https:\/\/citejournal.org\/wp-json\/wp\/v2\/posts\/859"}],"collection":[{"href":"https:\/\/citejournal.org\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/citejournal.org\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/citejournal.org\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/citejournal.org\/wp-json\/wp\/v2\/comments?post=859"}],"version-history":[{"count":1,"href":"https:\/\/citejournal.org\/wp-json\/wp\/v2\/posts\/859\/revisions"}],"predecessor-version":[{"id":12297,"href":"https:\/\/citejournal.org\/wp-json\/wp\/v2\/posts\/859\/revisions\/12297"}],"wp:attachment":[{"href":"https:\/\/citejournal.org\/wp-json\/wp\/v2\/media?parent=859"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/citejournal.org\/wp-json\/wp\/v2\/categories?post=859"},{"taxonomy":"publication","embeddable":true,"href":"https:\/\/citejournal.org\/wp-json\/wp\/v2\/publication?post=859"},{"taxonomy":"paper_format","embeddable":true,"href":"https:\/\/citejournal.org\/wp-json\/wp\/v2\/format?post=859"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}