Getting the Most Out of Your Technology Project

Notes from:



NECC 2007 program - Getting the Most Out of Your Technology Project



Elizabeth Byrom, SERVE Center at University of North Carolina—Greensboro with Jenifer O. Corn and Beth Thrift





Saturday, 6/23/2007, 8:30am–11:30am; GWCC B405

Serve Center REL for NC, FL, GA, MS, SC



We read example of an EETT Grant proposal & discussed



Eval two different focuses: internal formative evaluation, purpose may be different than external summative evaluation;



SERVE developed Cape:





Capacity for Applying Project Evaluation CAPE



Evaluation Capacity Building - Evaluation Framework



Eval planning

• Mapping project logic
• Clarifying strategies and objectives
• Defining eval questins
• formattting benchmarks
• Selecting methods an dmeasure
• contudinting the eval
• Drawing inferences

Logic map: graphical representation of relationships among key elements

[this adds extra points to federal grant proposals]





Learning From Logic Models : An Example of a Family-School Partnership Program - Publication by Harvard Family Research Project - HFRP



Once have logic map, then use eval questions to focus on portions to be evaluated

Impact Questions (based on objectives)

Implementation Questions (based on strategies)



Eg If objective that students acquire tech skills, then need tool like ISTE/Microsoft-created Technology skills eval





Methods and measures

Quantitative or qualitatve (not easily measured with numbers)

Data dictated by eval questions;



Data steps

• collecting
• storing/organizing
• analyzing
• interpretting

Informal data--for eval to be purposeful and systematic, data must be relatively formal: collected, soted/organize, and analyzed wiht some degree of rigor





handout: tips for data steps



Instruments and protocols

School Tech needs Assessment STNA or stenna

Looking fo rtech Integration LOFTI

Technology and school-family-community partnership survey

Professional devel questionare pdq

Rubrics for Lesson plans and student products

Reflection logs



Evaluation Capacity Building - Data Sources: Examples



STNA is free and you can ask for building/district to take online by emailing:



STNA handout-

about 80 items

know hwat staff members thin and feel about

leaderhsip, planning, budget

infrastructure and resources

prof devel

classroom practices wtih tehc

impact of tech on students



Share results back with teachers for most effectiveness; frustrated with "black hole"



STNA developed from ISTE, engauge, etc common themes from literature

version 3.0 removed NCarolina specific content; v2 tested validity and reliability



LOFTI

Classroom observation protocol



Evaluation Capacity Building - Looking For Technology Integration LoFTI

LOFTI gather evidence of how tech is actually being used

This is different from what people think or feel is happening



developed on best practices, 21st Cent skills

If resistance, Make clear not on teacher performance, only on school level,; may want to give different name than observations (connotation of teacher performance), eg protocol for tech info collection instrument





Technology-Partnership Survey

Online like STNA for teachers, parents, and community members

Determines perceptions to plan decisions about using tech to suppor tfamily and community involvement efforts



Based on epstein's  Six type of involvement framework



Evaluation Capacity Building





Five Cirtical Levels fo PD Evaluation (PDF Survey)

based on Guskey



Rubric tool

http://www.ncrtec.org/tl/sgsp/lpsg.htm

http://rubistar.4teacher.org/



Teacher Reflection Log

Handout



Strongly encourage getting evaluation team of stakeholders;



SEIR*TEC Presentations

Grantwriting info

Powered by ScribeFire.