Evaluations

Evaluations

Evaluation of all Center programs, member experiences, and long-term outcomes is essential to developing responsive and effective programs. EBICS has assembled an Evaluation Team led by Dr. Lizanne DeStefano, Professor of Educational Psychology, at the University of Illinois at Urbana-Champaign administer surveys and other assessments, conduct personal interviews and focus groups, and to collect data and track outcomes related to all aspects of the Center. EBICS employs a robust evaluation method designed to provide formative information to guide program improvement as well as a summative assessment of program effectiveness and impact. The ultimate goal of the evaluation program is to validate and document the effectiveness of EBICS integrative research, education, and outreach programs. The evaluation will utilize an educative, value-engaged approach (EVEN). The EVEN approach, developed with NSF-EHR support, defines high quality STEM educational programming as that which effectively incorporates cutting-edge scientific content, strong instructional pedagogy, and sensitivity to diversity and equity issues. This evaluation involves:

  • Implementation: Are EBICS programs being implemented on schedule and as planned?
  • Effectiveness: Are key components of EBICS (e.g., leadership and management, integrative research, education, diversity, ethics, knowledge transfer etc.) operating effectively? How might they be improved?
  • Impact: What student and faculty outcomes are associated with participation in EBICS? How do these compare with baseline measures of joint publications, collaborative research projects, grant submissions and awards, career attainment, and other targeted outcomes? What is the added value of participation in EBICS?
  • Institutionalization: How and to what extent are elements of EBICS becoming institutionalized at other participating institutions? What opportunities and barriers exist to broad institutionalization?

As part of our Knowledge Transfer program EBICS will provide high-quality, easy-to-implement evaluation resources to non-profit organizations. We believe the sharing of these resources with STCs and other science/engineering education organizations will meet a major need within these communities.

We have developed evaluation processes and criteria for Management, Education, Diversity, Knowledge Transfer, and Research activities, and for identfying new activities and new machine projects for the Center.  We have also defined a Faculty Evaluation process and evaluation criteria to assess faculty contributions to the Center annually.

EBICS Evaluation Director: Lizanne DeStefano (University of Illinois at Urbana-Champaign)

  • Greene, J. C., DeStefano, L., Burgon, H., & Hall, J. (2006). An educative, values-engaged approach to evaluating STEM educational programs. In D. Huffman & F. Lawrenz (Eds.), Critical issues in STEM evaluation (special issue). New Directions for Evaluation, 109, 53-71.