{"id":6860,"date":"2016-07-14T13:53:18","date_gmt":"2016-07-14T13:53:18","guid":{"rendered":"https:\/\/citejournal.org\/\/\/"},"modified":"2016-12-19T14:38:09","modified_gmt":"2016-12-19T14:38:09","slug":"persistent-teaching-practices-after-geospatial-technology-professional-development","status":"publish","type":"post","link":"https:\/\/citejournal.org\/volume-16\/issue-3-16\/science\/persistent-teaching-practices-after-geospatial-technology-professional-development","title":{"rendered":"Persistent Teaching Practices After Geospatial Technology Professional Development"},"content":{"rendered":"

A common goal of professional development (PD) is to improve teachers\u2019 skills, understanding, and pedagogical practices in order to impact student learning (Wallace, 2009; Yoon, Duncan, Lee, Scarloss, & Shapley, 2007). However, no simple input-output model exists; there are many mediating factors between what teachers experience during PD and how it is translated into student learning experiences in the classroom (Desimone, 2009; Guskey, 2002; Whitworth & Chiu, 2015).<\/p>\n

Often, evaluation efforts of technology education PD document implementation of pedagogical practices during the life of the program, but little is known about whether these practices persist once the programmatic supports end (Baker et al., 2015; Lawless & Pellegrino, 2007). Recently, a proposed geospatial technology (GST) and learning research agenda suggested the identification of the technological, pedagogical, and content knowledge required for teachers to implement and use GST as a priority for the field moving forward (Baker et al., 2015).<\/p>\n

The current study begins to address this priority. The purpose of this research was to determine what pedagogy persisted following a PD institute with project-based instruction integrating GST and what factors promoted or hindered sustained implementation of these practices.<\/p>\n

Project Based Instruction<\/h2>\n

Project based instruction (PBI) is a teaching method designed to promote students\u2019 development of 21st<\/sup>-century competencies (critical thinking, communication, collaboration, and creativity; Partnership for 21st<\/sup> Century Learning, 2015) through a collaborative, structured inquiry of an engaging and complex question, problem, or challenge (Krajcik, Blumenfeld, Marx, & Soloway, 1994; Larmer, Ross, & Mergendoller, 2009). PBI also requires engagement in the practices of science, which translates into a deeper learning experience (National Research Council [NRC], 2012). Many GST-integrated PD programs have promoted the use of PBI integrated with GST (e.g., Bodzin, Anastsio, & Kulo, 2014; Kolvoord, Charles, & Purcell, 2014).<\/p>\n

Professional Development for Geospatial Technologies<\/h2>\n

GST is a powerful tool to support spatial thinking, scientific research, and real-world problem solving (NRC, 2006; Sinton & Lund, 2007). Teachers who utilize GST within student-centered practices in their classrooms provide opportunities for students to engage in data collection, analysis, and argumentation based on evidence (MaKinster & Trautmann, 2014).<\/p>\n

PD is a critical component in the overall success of teachers\u2019 development of practices that will lead to effective implementation of science and technology in an authentic environment. Developing science content understanding, the intellectual capabilities of their students, and specialized pedagogical knowledge requires specialized PD focusing on the core ideas in the discipline and modeling of how teachers should present the material to their students (NRC, 2007).<\/p>\n

Koehler and Mishra (2005) stressed the need for authentic, project-based PD activities to help teachers develop this knowledge of how to teach content with technology effectively. To teach effectively with GST, teachers must build their knowledge, skills, and practices before they can implement lessons with students and realize instructional changes that ultimately lead to student learning gains (Desimone, 2009; Guskey, 2000). In addition, PD must help teachers integrate knowledge of GST into their existing schema (Coulter, 2014; Kolvoord et al., 2014).<\/p>\n

As technology has been infused into most schools, and with greater accessibility of GST tools such as ArcGIS online and Google Earth, teachers can now focus on more sophisticated, student-centered technologies. In order to provide teachers with effective PD around GST and PBI, facilitators should immerse teachers in a real-life problem which involves the examination of spatial data (Borko, 2004; Loucks-Horsley, Love, Stiles, Mundry, & Hewson, 2003). As teachers grapple with spatial data to resolve a problem, they are able to experience many of the same issues and struggles students encounter.<\/p>\n

By becoming a learner of the content via immersion in inquiry, teachers broaden their own understanding and knowledge of the content they are addressing with their students (McAuliffe & Lockwood, 2014; Moore, Haviland, Whitmer, & Brady, 2014). Experiences should focus on teaching with GST and on learning more advanced tools as they become necessary for the exploration at hand (Barnett et al., 2014; McClurg & Buss, 2007).<\/p>\n

Providing lessons and datasets that can be used immediately in classrooms supports implementation, but it is important to allow for some adaptation of the teaching materials to meet teachers\u2019 needs (Kolvoord et al., 2014; Moore et al., 2014; Stylinkski & Doty, 2014). It is also imperative that teachers understand the theory behind the lesson design, so when changes are made, critical components are maintained (Singer, Marx, & Krajcik, 2000).<\/p>\n

Implementation of Geospatial Technologies in the Classroom<\/h2>\n

When teachers begin implementing GST-integrated PBI lessons they face barriers, such as finding time to implement projects, pressures of high-stakes testing, technology access, and computer glitches (Baker & Kerski, 2014; Barnett et al., 2014). Kerski (2003) said that teachers who expressed an interest in teaching with GST did not actually use it until 1 to 3 years after they received the software. Teachers require adequate support, not only in the form of technology infrastructure, administrative permission, and time to allow students to engage in authentic inquiries, but also from a community of practice and educational mentors (Blank, Crews, & Knuth, 2014; Rubino-Hare et al., 2013; McClurg & Buss, 2007).<\/p>\n

Long-term PD allowing time for practice, reflection, and discussion with others increases teacher implementation (Baker & Kerski, 2014; Desimone, 2009; Loucks-Horsley et al., 2003). When teachers see the engagement and learning gains from their students, they receive positive reinforcement and gain confidence to implement further (Guskey, 2002; Yarnall, Vahey, & Swan, 2014). Teachers who are comfortable with student-centered approaches such as PBI and those who are willing to learn alongside their students seem to be drawn to GST as a teaching tool and have had success in implementing (Baker & Kerski, 2014; Baylor & Ritchie, 2002; Coulter, 2014).<\/p>\n

Charles and Kolvoord (2003) described four stages through which teachers progress as they begin to teach with GST: entry, adopt, adapt, and innovate. Kolvoord et al. (2014) presented illustrative cases for the stages. During the entry<\/em> stage, teachers are able to use GST within PD. The next stage sees teachers adopt<\/em> and teach lessons that use GST to teach content as written, without modification. Teachers who modify lessons to meet instructional objectives and student needs are in the adapt<\/em> stage.\u00a0 When teachers begin developing their own original activities, they have reached the innovate<\/em> stage. The ultimate goal of GST PD should be to move teachers along this continuum.<\/p>\n

The Power of Data Projects<\/h2>\n

The Power of Data projects sought to increase science, technology, and 21st<\/sup>-century skills through immersive PD experiences with PBI, by requiring teachers to propose solutions to authentic problems through spatial data collection and analysis utilizing GST (Rubino-Hare et al., 2013). Following the PD, teachers were expected to implement similar GST-integrated PBI units in their classrooms. The PD team included geology faculty members, science teacher professional developers, GST experts, and science education researchers.<\/p>\n

PD institutes focused on teaching Earth science with GST. The premise for the institutes was that modeling and practicing research-based pedagogical methods through an immersion program focusing on real-life problems would improve participant science instruction (Loucks-Horsley et al., 2003; Parker, Carlson, & Na\u2019im, 2007). The expectation was that instructional modeling would elicit a deeper level of understanding of how to integrate GST into content in a PBI context.<\/p>\n

Teacher teams who demonstrated the ability to implement PBI and integrate technology in their classrooms were recruited to increase the likelihood of success during implementation (as in Blank et al., 2014; Coulter, 2014; Kerski, 2003). During the PD institutes, spatial analysis with the goal of answering a question and presentation of projects using spatial data as evidence to communicate claims was emphasized (as recommended by Bodzin, Anastasio, & Kulo, 2014; Coulter, 2014; Zalles & Pallant, 2014).<\/p>\n

Teachers experienced an Earth science unit utilizing commercially available GST lessons (as in Johnson & Schmidts, 2005; Palmer, Palmer, & Malone, 2008; Palmer, Palmer, Malone, & Voigt, 2008) organized into a PBI unit designed to build conceptual understanding (as recommended in Larmer et al., 2009; Schwartz et al., 1999). Teachers were then asked to implement the lesson with students, encouraging modifications for local relevancy (as in Coulter, 2014; Kolvoord, et al., 2014; Penuel, Fishman, Yamaguchi, & Gallagher, 2007; Stylinski & Doty, 2014). The premise was that implementing the lessons with students would enable teachers to see the benefits for\u00a0student learning and encourage continued use (Baker & Kerski, 2014; Guskey, 2002; McAuliffe & Lockwood, 2014; Trautmann & MaKinster, 2014; Yarnall et al., 2014).<\/p>\n

Although the PD content was similar, two models of PD were enacted, one that occurred over an intensive, 2-week summer institute and one that was implemented on weekends throughout the academic year (Claesgens et al., 2013; Rubino-Hare et al., 2013). After initial PD, both groups were invited to participate in an advanced 1-week summer institute to learn more about the theories behind the lesson design and to develop their own PBI units.<\/p>\n

Because technology was added to the already high demands of new student-centered and PBI pedagogies, barriers to implementation were anticipated and addressed in the design of the PD. These interventions included developing teachers\u2019 content, pedagogical, and technical knowledge, requiring support from administrators and information technology (IT) specialists to ensure technology access, and providing classroom resources, including software, books, and data collection devices (as recommended by Kerski, 2003; Mumtaz, 2000; Tamim et al., 2011).<\/p>\n

In previous studies of the Power of Data projects, teacher skills, knowledge, school support, and student learning were measured pre and post participation in order to determine overall effectiveness of the PD and the impact of the PD format on student learning (Claesgens et al., 2013; Rubino-Hare et al., 2013). Results indicated that when there was a high level of implementation of PBI integrating GST, teachers and their students improved their performance on a number of factors regardless of the PD format.<\/p>\n

Purpose<\/h2>\n

A common assumption is that in order for student learning gains to occur following teachers\u2019 participation in PD, changes to pedagogical practices must persist beyond the PD (Desimone, 2009; Guskey, 2002). Yet, ability to sustain practices in teacher participants is a challenge for high-quality PD programs (Lawless & Pellegrino, 2007).<\/p>\n

Many variables come into play that affect implementation, sustainability, and ultimately, student learning (Lawless & Pellegrino, 2007; Whitworth & Chiu, 2015). Lawless and Pellegrino urged for these variables to be systematically investigated and the need identified to determine if pedagogical change persisted after PD.\u00a0 Furthermore, identification of the support structures needed to maintain long-term pedagogical change was suggested (Lawless & Pellegrino, 2007).<\/p>\n

The challenge is to determine what critical factors in high-quality PD programs support persistence of pedagogical practices. Therefore, based on findings from the previous study (Claesgens et al., 2013), the research questions guiding the current study were as follows:<\/p>\n

    \n
  1. What pedagogical practices did teachers sustain following the PD experiences?<\/li>\n
  2. What contexts were present in schools that supported or limited the use of GST as a teaching and learning tool?<\/li>\n
  3. What characterized teachers who sustained practices?<\/li>\n<\/ol>\n

    The study presented here followed teachers 1 to 2 years post-PD to construct\u00a0a more complete picture of the aspects that affected the path from professional learning experiences to the classroom.<\/p>\n

    Methods<\/h2>\n

    This study employed a qualitative case study approach (Yin, 2014) to describe the experiences and perceptions of teachers who continued to implement their learning in the first and second years after PD ended.\u00a0 When a lack of in-depth understandings of a phenomenon exists, case study designs are appropriate (Creswell, 2009).\u00a0 The unit of analysis for the study was the teacher within the classroom.\u00a0 A variety of data, including artifacts, classroom observations, interviews, and survey results, were collected.<\/p>\n

    Context<\/h3>\n

    The Power of Data PD was offered in two formats: one through an intensive 2-week summer institute and the other via monthly or bimonthly meetings throughout the academic year. Both formats immersed teachers as learners in a GST-integrated collaborative PBI unit, with the goal of responding to a driving question related to an Earth science concept (weather and climate and mass wasting, respectively).<\/p>\n

    Global\/regional investigations and inquiry-based science labs were followed by an application of the science concept in a more local context to propose mitigation solutions. For example, teachers analyzed world and regional data to understand the differences between weather and climate (e.g., Power of Data Unit on Weather and Climate; see Appendix A<\/a>). Armed with a greater conceptual understanding of how climate change can result in extreme weather and how extreme weather might affect the Earth system, they studied a local watershed and stream system (e.g., Power of Data Unit on Climate Change Site Mitigation; see Appendix B<\/a>). The final products presented were short- and long-term recommendations to a fictional community planning commission for site modification along the stream system.<\/p>\n

    Teachers were encouraged to replicate this process in their classrooms. They received lessons and datasets that could be implemented immediately as written or adapted as necessary. They were then encouraged to develop and teach an authentic PBI lesson for their context that required students to collect and analyze local data, integrate non-GST hands-on science investigations, and present solutions. During the PD, participants spent time planning lessons and future implementation. As they taught the lessons they received peer feedback through both face-to-face and online discussions to encourage a professional learning community.<\/p>\n

    Initial analysis of data from classroom observations, teachers\u2019 self-reports, and students\u2019 work from lessons indicated three levels of initial implementation following PD: high implementers, mechanical implementers, and nonimplementers (Rubino-Hare, et al., 2013). High implementers were those who used GST, assigned students authentic projects that emphasized claims and evidence, and often required students to present project findings to stakeholders. In comparison to the high implementers, mechanical implementers were more comfortable implementing step-by-step lessons from a GST text. Lessons and student assignments tightly followed the curriculum materials presented in the PD, though occasionally teachers adapted materials and students collected data in the field. The third group, non-implementers, did not implement GST within lessons, and students did not use the software in any capacity.<\/p>\n

    Many of the teachers participated in an advanced 1-week summer institute to learn more about the theories behind the lesson design, learn and practice targeted GST skills, and develop and prepare data and base maps for their own GST-integrated PBI units (e.g., Advanced Institute Unit on Grand Canyon Ecology and Advanced Institute Unit on Local Water Resource Analysis; see Appendixes C and D<\/a>). During the advanced institute, teachers received individualized support from the pedagogical, technical, and subject matter experts.<\/p>\n

    Participants<\/h3>\n

    One year after completing the final PD project, all former Power of Data participants who were still teaching (n<\/em> = 60) were contacted and asked to complete an online survey to identify what aspects of the PD they were still implementing in their classrooms. A total of 47 participants completed this follow-up survey, representing a total response rate of 78%. Ten of the teachers who completed this survey (21% of survey respondents) were purposefully selected for this study based on two criteria: level of initial implementation and continued use of GST in the classroom.\u00a0 The 10\u00a0teachers selected for this study were previously identified as mechanical or high implementers during the initial PD and reported on the survey that they were continuing to teach with GST. These criteria for selection were used in order to determine if high levels of pedagogical practices continued 1 to 2 years following the PD experience. Descriptive characteristics of the participants are presented in Table 1.<\/p>\n

    Table 1<\/strong>
    \nDescription of Participants, n<\/em> = 10<\/p>\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n
    Demographic Category<\/strong><\/td>\nDescriptor<\/strong><\/td>\nn<\/em><\/strong> (%)<\/strong><\/td>\n<\/tr>\n
    Grade level<\/td>\nMiddle School<\/td>\n3 (30%)<\/td>\n<\/tr>\n
    High School<\/td>\n7 (70%)<\/td>\n<\/tr>\n
    School type<\/td>\nPublic<\/td>\n7 (70%)<\/td>\n<\/tr>\n
    Charter<\/td>\n3 (30%)<\/td>\n<\/tr>\n
    School location<\/td>\nRural<\/td>\n5 (50%)<\/td>\n<\/tr>\n
    Urban<\/td>\n2 (20%)<\/td>\n<\/tr>\n
    Suburban<\/td>\n3 (30%)<\/td>\n<\/tr>\n
    Subject Matter<\/td>\nScience<\/td>\n9 (90%)<\/td>\n<\/tr>\n
    CTE<\/td>\n1 (10%)<\/td>\n<\/tr>\n
    Years Post PD<\/td>\nOne<\/td>\n6 (60%)<\/td>\n<\/tr>\n
    Two<\/td>\n4 (40%)<\/td>\n<\/tr>\n
    Advanced PD<\/td>\nAttended<\/td>\n6 (60%)<\/td>\n<\/tr>\n
    Did not attend<\/td>\n4 (40%)<\/td>\n<\/tr>\n
    Initial Implementation Designation<\/td>\nMechanical<\/td>\n4 (40%)<\/td>\n<\/tr>\n
    High<\/td>\n6 (60%)<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

    Data Collection<\/h3>\n

    Multiple methods of data were collected to triangulate findings, identify patterns, and develop a rich description of the patterns of implementation and persistence of practice (as in Creswell & Miller, 2000).\u00a0 Data sources included artifacts, classroom observations, semistructured interviews, and GST performance assessments.\u00a0 Because the research focus was on persistence of pedagogical practices, authentic classroom artifacts generated by each teacher were used as data. Face and content validity for the interview protocol and GST performance assessment were established through review by a team of geospatial educators. Modifications were made to the interview protocol and GST performance assessment as suggested by the team. Validity of the Inside the Classroom Observation and Analytic Protocol has been established previously (Horizon Research, Inc., 2000).<\/p>\n

    Artifacts<\/em><\/strong>. <\/strong>Teachers submitted their lesson plans for GST-integrated, inquiry-based lessons. \u00a0When applicable, they submitted course syllabi for the courses where GST-integrated lessons or PBI units would be implemented. Teachers also submitted student work samples for GST-integrated lessons or PBI units they implemented. These artifacts provided insight into how teachers utilized GST in their lessons and if or how they designed PBI units for their curriculum.<\/p>\n

    Semi-structured interview<\/em><\/strong>.<\/strong>\u00a0 The interviews were designed to be completed in 30 minutes and were conducted by researchers external to the PD delivery team to discourage bias and to elicit honest responses from participants (see Appendix E<\/a>). The goal of the interview was to understand what, if anything, teachers were still using from the PD and why. Teachers were first asked questions about their background with technology integration in general. Other questions were asked to construct an understanding of teachers\u2019 school context, and specific questions were asked about what from the PD they were implementing and why. Participants were also asked to identify barriers to implementation and how they might have overcome these obstacles. Finally, teachers were asked about perceived or actual impacts on student learning and attitudes and plans for future instruction. Interviews were tape-recorded and transcribed for analysis.<\/p>\n

    Classroom observations.<\/em><\/strong>\u00a0 Teachers were asked to identify a GST-integrated inquiry-based lesson in order for the researchers to conduct classroom observations. Prior to the lesson teachers were asked to identify the purpose of the lesson, the context of the lesson (days prior and following lesson), and the elements of inquiry that were present in the lesson. Classroom observations were conducted using a modified instrument based on Inside the Classroom Observation and Analytic Protocol (Horizon Research, Inc., 2000). Sections of implementation from the protocol were chosen as a focus (Table 2). Observers were looking for evidence of high-quality teaching, based on the degree of student-centered teaching as opposed to direct instruction, and the degree to which inquiry was valued and encouraged.<\/p>\n

    Table 2<\/strong>
    \nDomains and Items in Observation Protocol<\/p>\n\n\n\n\n\n\n\n\n\n\n\n
    Implementation<\/td>\n<\/tr>\n
    \n
      \n
    • The instructional strategies were consistent with investigative mathematics\/science.<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n
    \n
      \n
    • The teacher appeared confident in his\/her ability to teach mathematics\/science.<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n
    \n
      \n
    • The teacher\u2019s questioning strategies were likely to enhance the development of student conceptual understanding\/problem solving (e.g., emphasized higher order questions, appropriately used “wait time,” identified prior conceptions and misconceptions).<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n
    Mathematics\/Science Content<\/td>\n<\/tr>\n
    \n
      \n
    • Students were intellectually engaged with important ideas relevant to the focus of the lesson.<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n
    \n
      \n
    • Appropriate connections were made to other areas of mathematics\/science, to other disciplines, and\/or to real-world contexts.<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n
    Classroom Culture<\/td>\n<\/tr>\n
    \n