Evaluation Criteria Effectiveness: Goals
Explanation
Data Sources
Are the goals and objectives focused, concrete, and achievable? Does the content focus directly on the specified goals and objectives? Is the technology applicable and available to support the goals and objectives of the WBI? Are the goals and objectives explicit and stated clearly? Is the course content clearly presented? Are the assignment instructions clear and concise? Are students able to reach instructor in a timely manner? Are the required technology tools user-friendly and easy to understand? Is the course content relevant to the learner? Are the assignments
Extant data (syllabus, course content, scores, course exercises) Expert opinion (instructor)
Content
Technology
Expert review (instructor) User review (student)
Efficiency: Goals
Extant data (syllabus) Expert opinion (instructor) Expert opinion (instructor) User review (student) Extant data (emails, discussion boards) Survey
Content
Technology
Appeal: Goals Content
Survey Extant data
interesting? Technology Are there grammatical or spelling errors within the course? Is the course easily navigated?
(discussion boards) Observation User review (student)
Section Who are the stakeholders?
Description Primary Stakeholders: Niki Parkin, instructor Students Secondary Stakeholders: School principal Parents
What is being evaluated?
Course Modules will include the following items for evaluation: Discussion board (participation) Check your Understanding chapter exercises Instructional content based answer of essential questions Final paper Main evaluator & designer: Niki Parkin. In fall 2013, Parkin will have graduated from Boise State University with a masters degree in Educational Technology. Parkin also has a teaching degree for grades K-6. Expert reviewer & technical support: Patti Spears. Spears has been teaching in grades K-5 for 18+ years. She also has a masters degree in technology. Expert reviewer of subject matter & content: Val Harris. He taught in the schools for 15 years before moving his work to the district level.
Who are the evaluators and reviewers?
When and how should the formative evaluation take place?
What decisions need to be made as the WBI design plan and prototype are developed and revised?
Initially, the expert reviewers, Spears and Harris, will review for possible technical support or content issues. Parkin, the main evaluator, will review these notes and make necessary changes. Additionally, as data is gathered from the course, data analysis will occur as reviewers will make notes, comments, and address changes. A design document will be constructed and will hold all changes and revisions to the course. All reviewers will have access to this document. Reviewers will communicate verbally and through email or other written communication. The document will contain a template for decisions made that includes the date, phase/stage, person responsible, and rationale.
