Digital Resources for STEM Educators and Recommendations for Cyberlearning Initiatives: Results from the National Science Foundation Digital Library/Distributed Learning Program Evaluation
Apr 27, 2017
The National Science Foundation's (NSF) National Science Digital Library/Distributed Learning (NSDL) program turned 10 years old in 2010. This report presents results of a preliminary program evaluation carried out by RAND and is organized around three principal goals:
An interdisciplinary team directed project research efforts to: examine the state of health of the digital resource collections; assess the evidence that currently used web metrics provide about activities users undertake to find and access those resources; and identify early indicators of positive effects from the use of NSDL resources among science teachers or learners in NSDL-supported research projects.
Initial answers to these questions are supplemented by primary data collection aimed at exploring the appropriateness of metadata intended to assist users in finding, identifying, selecting and obtaining sought digital contents and at investigating the usability of available resources for accomplishing selected routine tasks in science teaching. A minicase study explored one full instantiation of the NSDL program model — a demonstration of curriculum customization to meet the needs of earth science teachers using resources from the Digital Library for Earth System Education (DLESE).
The report synthesizes the findings from these exercises to yield results and recommendations, both for what NSF and NSDL should do now as well as for the design of a full formative evaluation in the future.
Analysis of NSDL Collection Health
Web Metrics in the Evaluation of the NSDL
Teaching and Learning Effects
Usability Pilot Trials
Minicase Study of a Successful Implementation of the NSDL Model
Formative Evaluation of the NSDL: Results and Next Steps
Funded Collections Summary of Assessment Data
Pathways Summary of Assessment Data
NSDL Teaching and Learning Project Synopsis
NSDL Teaching and Learning Study Synopsis
Sample Find, Identify, Select, and Obtain Instrument