Skip to main content

Measure Progress for Continuous Improvement

Effective technology leadership promotes the development of a balanced and inclusive technology infrastructure that examines assistive technology (AT), educational technology (EdTech), and information technology (InfoTech) as part of a technology ecosystem. Leadership guides with a collaborative team of diverse stakeholders in the development of a community-wide vision for technology use and create and measure a strategic technology implementation plan as part of a continuous improvement process.

Measuring the impact of a balanced and inclusive technology plan is critical to ensuring equitable learning opportunities for all students, particularly those with disabilities. District leaders collect, analyze, and use data gathered across a system as part of a continuous improvement cycle. Ongoing data-collection activities enable leaders to shift implementation strategies and resources to realign, to better support teaching and learning.

The Center for Inclusive Technology in Education Systems (CITES) has utilized a design-thinking process, in partnership with local districts, to refine a set of leadership practices that enhance the development of a balanced and inclusive technology infrastructure.

Actions that support continuous improvement include:

  • Create a data collection plan.
  • Analyze data.
  • Take action.
  • Communicate results of data collection and analysis.

Building an Inclusive Technology Ecosystem through Data

Tomball Independent School District (Tomball, Texas)

Tomball Independent School District (Tomball, Texas)

Photo by CommunityEditor | CC BY-SA 4.0

Tomball Independent School District serves approximately 18,000 students in Tomball, Texas. The district has grown rapidly in recent years, with shifts in district demographics and student needs. To address changing student needs, the district’s vision focuses on technology tools with built-in accessibility feature that can benefit students throughout the district, in both general and special education.

The district’s technology implementation plan began as a pilot study when a review of data found that students who were not currently identified with an IEP or a 504 plan were struggling and had limited access to resources that could support them. The AT department put together a proposal for a joint project that brings together general education, special education, instructional technology, related services and ESL teachers to conduct a needs assessment and identify primary barriers from multiple perspectives. Data collected during the pilot demonstrated improved outcomes and increased student access, so the team moved forward with district-wide implementation the following year. Goals and related data points were identified within the district strategic plan and plans for each school building to ensure that training was embedded in the professional development schedule, as well as in parent meetings, open house and personalized trainings. Data collection included requests for support, tool usage by campus, number of trainings, relationship between integration and hours of PD received, and student outcomes by tool usage. Throughout the process, the district used data to drive improvement to the implementation. Initial barriers identified during the pilot study were addressed during full implementation; data collected during full implementation were then used to identify additional needs to provide scaffolding for students.

Resources

Research, Technology, & Students With Disabilities: Assessing Progress of Your Technology Initiatives Guide for State and Local Education Leaders (AIR/Center on Technology and Disability) 

Are Your Technology Initiatives Working? (AIR/Center on Technology and Disability) 

Creating a Cycle of Continuous Improvement Through Instructional Rounds (NCPEA should be (National Council of Professors of Educational Administration (NCPEA)) 

Supporting Research

Lange, C., Range, B., & Welsh, K. (2012). Conditions for effective data use to improve schools: Recommendations for school leaders. International Journal of Educational Leadership Preparation7(3), n3.
The purpose of this paper is to apply Reeves (2004) framework concerning Antecedents of Excellence in creating a school culture that routinely uses data to inform instruction. The authors highlight shared leadership as being instrumental when creating a data-driven culture.

Berglund, T., & Tosh, K. (2020). Educator Access to and Use of Data Systems.
To effectively use a variety of student data, including — but not limited to — assessment data, teachers must possess both assessment literacy (the ability to design, select, interpret and use assessment results appropriate for educational decisions) and data literacy (the ability to understand and use data to inform decisions). Results from the RAND Corporation's web-based American Educator Panels survey provide insight into teachers' access to data and the supports they receive to use it.

Wayman, J. C., Shaw, S., & Cho, V. (2017). Longitudinal effects of teacher use of a computer data system on student achievement. AERA Open, 3(1), https://doi.org/10.1177/2332858416685534.
This study sought to address the methodological gap of direct teacher interactions with data, via data systems. A significant relationship was found between system use and elementary reading improvement. The implications of this study on how to conceptualize and measure use, as well as how to support practitioners, are discussed.

Top of Page