Notes from:
NECC 2007 program - Getting the Most Out of Your Technology Project
Elizabeth Byrom, SERVE Center at University of North Carolina—Greensboro with Jenifer O. Corn and Beth Thrift
Saturday, 6/23/2007, 8:30am–11:30am; GWCC B405
Serve Center REL for NC, FL, GA, MS, SC
We read example of an EETT Grant proposal & discussed
Eval two different focuses: internal formative evaluation, purpose may be different than external summative evaluation;
SERVE developed Cape:
Capacity for Applying Project Evaluation CAPE
Evaluation Capacity Building - Evaluation Framework
Eval planning
[this adds extra points to federal grant proposals]
Learning From Logic Models : An Example of a Family-School Partnership Program - Publication by Harvard Family Research Project - HFRP
Once have logic map, then use eval questions to focus on portions to be evaluated
Impact Questions (based on objectives)
Implementation Questions (based on strategies)
Eg If objective that students acquire tech skills, then need tool like ISTE/Microsoft-created Technology skills eval
Methods and measures
Quantitative or qualitatve (not easily measured with numbers)
Data dictated by eval questions;
Data steps
handout: tips for data steps
Instruments and protocols
School Tech needs Assessment STNA or stenna
Looking fo rtech Integration LOFTI
Technology and school-family-community partnership survey
Professional devel questionare pdq
Rubrics for Lesson plans and student products
Reflection logs
Evaluation Capacity Building - Data Sources: Examples
STNA is free and you can ask for building/district to take online by emailing:
STNA handout-
about 80 items
know hwat staff members thin and feel about
leaderhsip, planning, budget
infrastructure and resources
prof devel
classroom practices wtih tehc
impact of tech on students
Share results back with teachers for most effectiveness; frustrated with "black hole"
STNA developed from ISTE, engauge, etc common themes from literature
version 3.0 removed NCarolina specific content; v2 tested validity and reliability
LOFTI
Classroom observation protocol
Evaluation Capacity Building - Looking For Technology Integration LoFTI
LOFTI gather evidence of how tech is actually being used
This is different from what people think or feel is happening
developed on best practices, 21st Cent skills
If resistance, Make clear not on teacher performance, only on school level,; may want to give different name than observations (connotation of teacher performance), eg protocol for tech info collection instrument
Technology-Partnership Survey
Online like STNA for teachers, parents, and community members
Determines perceptions to plan decisions about using tech to suppor tfamily and community involvement efforts
Based on epstein's Six type of involvement framework
Evaluation Capacity Building
Five Cirtical Levels fo PD Evaluation (PDF Survey)
based on Guskey
Rubric tool
http://www.ncrtec.org/tl/sgsp/lpsg.htm
http://rubistar.4teacher.org/
Teacher Reflection Log
Handout
Strongly encourage getting evaluation team of stakeholders;
SEIR*TEC Presentations
Grantwriting info
NECC 2007 program - Getting the Most Out of Your Technology Project
Elizabeth Byrom, SERVE Center at University of North Carolina—Greensboro with Jenifer O. Corn and Beth Thrift
Saturday, 6/23/2007, 8:30am–11:30am; GWCC B405
Serve Center REL for NC, FL, GA, MS, SC
We read example of an EETT Grant proposal & discussed
Eval two different focuses: internal formative evaluation, purpose may be different than external summative evaluation;
SERVE developed Cape:
Capacity for Applying Project Evaluation CAPE
Evaluation Capacity Building - Evaluation Framework
Eval planning
- Mapping project logic
- Clarifying strategies and objectives
- Defining eval questins
- formattting benchmarks
- Selecting methods an dmeasure
- contudinting the eval
- Drawing inferences
[this adds extra points to federal grant proposals]
Learning From Logic Models : An Example of a Family-School Partnership Program - Publication by Harvard Family Research Project - HFRP
Once have logic map, then use eval questions to focus on portions to be evaluated
Impact Questions (based on objectives)
Implementation Questions (based on strategies)
Eg If objective that students acquire tech skills, then need tool like ISTE/Microsoft-created Technology skills eval
Methods and measures
Quantitative or qualitatve (not easily measured with numbers)
Data dictated by eval questions;
Data steps
- collecting
- storing/organizing
- analyzing
- interpretting
handout: tips for data steps
Instruments and protocols
School Tech needs Assessment STNA or stenna
Looking fo rtech Integration LOFTI
Technology and school-family-community partnership survey
Professional devel questionare pdq
Rubrics for Lesson plans and student products
Reflection logs
Evaluation Capacity Building - Data Sources: Examples
STNA is free and you can ask for building/district to take online by emailing:
STNA handout-
about 80 items
know hwat staff members thin and feel about
leaderhsip, planning, budget
infrastructure and resources
prof devel
classroom practices wtih tehc
impact of tech on students
Share results back with teachers for most effectiveness; frustrated with "black hole"
STNA developed from ISTE, engauge, etc common themes from literature
version 3.0 removed NCarolina specific content; v2 tested validity and reliability
LOFTI
Classroom observation protocol
Evaluation Capacity Building - Looking For Technology Integration LoFTI
LOFTI gather evidence of how tech is actually being used
This is different from what people think or feel is happening
developed on best practices, 21st Cent skills
If resistance, Make clear not on teacher performance, only on school level,; may want to give different name than observations (connotation of teacher performance), eg protocol for tech info collection instrument
Technology-Partnership Survey
Online like STNA for teachers, parents, and community members
Determines perceptions to plan decisions about using tech to suppor tfamily and community involvement efforts
Based on epstein's Six type of involvement framework
Evaluation Capacity Building
Five Cirtical Levels fo PD Evaluation (PDF Survey)
based on Guskey
Rubric tool
http://www.ncrtec.org/tl/sgsp/lpsg.htm
http://rubistar.4teacher.org/
Teacher Reflection Log
Handout
Strongly encourage getting evaluation team of stakeholders;
SEIR*TEC Presentations
Grantwriting info
Powered by ScribeFire.
