Dimensions of Success: A Quality Improvement Observation Tool

What is DoS?

The Dimensions of Success,  or DoS, is an observation tool, that pinpoints twelve dimensions or indicators of STEM program quality in out-of-school time. Each dimension has a 4-level grading rubric with descriptions of key criteria that specify the quality of that dimension at the program.

DoS was designed to be a self-assessment observation tool for STEM program administrators and staff but it can also be used by external evaluators or funders to track program quality over time or across a city or a state. To use DoS, you must be trained and certified (see section below). After certification, you can use the tool as often as you like to measure the quality of STEM activities. When you use DoS for program quality improvement, we suggest debriefing activities and ratings with staff and having them join in the process of pinpointing strengths, weaknesses, and next steps for improving quality.

For more information, visit The PEAR Institute’s website here:

Or click here: A Guide to PEAR’s STEM Tools: Dimensions of Success & The Common Instrument Suite

The Twelve Dimensions of Success:

DoS measures twelve dimensions that fall in 4 broad domains: Features of the Learning Environment, Activity Engagement, STEM Knowledge and Practices, and Youth Development in STEM.

The first domain looks at the features of the learning afterschool environment that make it suitable for STEM programming (e.g., do kids have room to explore and move freely, are the materials exciting and appropriate for the topic, is time used wisely and is everything prepared ahead of time?).

The second domain looks at how the activity engages students in STEM;: for example, they measure whether or not do all students are have getting opportunities to participate?, whether they Aare doing activities that are engaging them students with STEM concepts, or something unrelated?, and whether or not the activities are activities hands-on, and designed to support students to in thinking for themselves, versus being given the answer or are they given the answer?.

The next STEM Knowledge and Practices domain analyzes how the informal STEM activities are helping students understand STEM concepts, make connections, and participate in the inquiry practices that STEM professionals use (e.g., collecting data, using scientific models, building explanations, etc.).

Finally, the last Youth Development domain assesses the student-facilitator and student-student interactions and . It  and looks at how they these relationships encourage or discourage participation in STEM activities,  and  whether , whether or not these  activities make STEM relevant and meaningful to students’ everyday lives, and their experiences. Together, these twelve dimensions capture the key components of a STEM activity in an informal afterschool or summer program.

The DoS tool is NOT a grading rubric for educators or afterschool facilitators. Rather, the DoS observation tool breaks down afterschool program activities to identify analyze and best identify and improve upon gaps in youth access, the program quality and accuracy quality, accuracy of STEM education content, and the preparedness of the site. It is used , and to make sure youth are engaged, learning, and have a voice in the programs they are a part of. Programs that may excel in preparedness might but find that their activities aren’t teaching conveying STEM goals and objectives as effectively as they could be, or a program with peerless STEM content might realize they are limiting their youth’s engagement or agency within the program itself.

DoS is NOT punitive new regulations or performance assessments for students and educators. Rather, DoS is an observation tool that identifies key areas of success and sets tangible quality standards for afterschool STEM programs, analyses program performance on-site and in person, and generates reports that can then be used for program quality improvement.

How Do I Use DoS?

To use DoS, a potential observer must complete a certification process. First, he/she must attend a 2-day training (in-person or online) to learn how to define and observe quality in each dimension.

Next, potential observers must trainees complete a set of video simulation exercises to practice their understanding of the tool. PEAR will then review their ratings and evidence from these exercises , and will provide customized feedback at a one-hour calibration session (phone conference). At this session, PEAR trainers will help to address any questions and to provide additional examples that might be needed to clarify use of the tool.

Finally, potential observers will then arrange to practice using DoS in the field at afterschool sites in their local area. This step allows them to use the tool in the field and to incorporate the feedback they received on the video simulations. Upon successful completion of all these requirements, observers will be DoS certified for 2 years and can use the tool as often as they would like during that period. After 2 years, observers may pursue opportunities for re-certification. if needed.

Please follow this link to begin the registration process or go to the DoS volunteer recruitment page here.

Please contact AmeriCorps Program Specialist Lily Tegner for more information about the tool and training/certification process:  ltegner@alaskachildrenstrust.org

DoS can empower afterschool and summer STEM program staff to embrace their role in inspiring the next generation to do STEM, be interested in STEM, and understand important STEM ideas that they can take with them throughout their lives. The tool helps to provide the common language that program and /state administrators, staff, and evaluators, etc. can use to describe communicate about the quality of their activities and find out where they excel and where they can improve.

For more information, visit the DoS website here:

Or click here: A Guide to PEAR’s STEM Tools: Dimensions of Success & The Common Instrument Suite