Sharing and Using NSSE Data to Drive Sustainable Improvement (Lessons from the Field–Volume 4)
In 2014, during a board of trustees meeting, Bucknell University President John C. Bravman outlined five attributes critical to the institution’s long-term sustainability: being forward looking, data driven, highly intentional, prudently bold, and student centered. Applying that vision to become highly intentional about sharing and making data as accessible as possible to administration, faculty, staff, students, and external constituents, Bucknell has developed a number of dashboards focused on specific topics.
One of these dashboards, dedicated solely to NSSE data, provides means for each of the NSSE Engagement Indicators (EI) and frequencies for the items they comprise and, further, allows users to disaggregate data by race, gender, residential college, Greek life affiliation, Pell recipient status, and first-generation status. On a number of other dashboards, NSSE data supplement the institution’s internal data as well as data from other instruments. Bucknell’s Diversity Dashboard, for example, includes items from NSSE’s Discussions with Diverse Others Engagement Indicator, among others, and allows for comparisons by various student demographic characteristics.
The university’s Student Learning Outcomes web page pairs NSSE results with data from the Hart Research Associates survey of employer priorities for college learning and success (see Figure 1; www.aacu.org/leap/public-opinion-research/2015-survey-results) and with the Higher Education Data Sharing Consortium’s HEDS Alumni Survey (see Figure 2; www.hedsconsortium.org/alumni-survey). Results are also displayed of students’ participation in High-Impact Practices (see Figure 3).
Two additional dashboards in development at Bucknell will combine data from multiple surveys. One, the Campus Climate Dashboard, will be an invaluable resource for numerous campus offices by providing a summary of findings related to campus climate issues from NSSE, the College Senior Survey (CSS), the Consortium on High Achievement and Success (CHAS) survey, and the National College Health Assessment (NCHA) survey. The other, the General Education Dashboard, will provide a mix of direct and indirect measures (from NSSE and alumni surveys) that will support the assessment efforts of faculty and administrators.
The purpose of making data more accessible is to encourage departments and units across campus to use this information more effectively to improve practice. Demonstrating this, Bucknell has used NSSE data to review the impact on student success of participating in the Residential Colleges—living-learning communities that have been a part of campus life at Bucknell for 30 years.
For this analysis, Bucknell researchers linked NSSE data with institutional retention and first-year GPA data, which served as a proxy for first-year student success. Also, Beginning College Survey of Student Engagement (BCSSE) data were used to compare the pre-college and first-year experiences of Residential College participants and nonparticipants, controlling for student background characteristics.
The researchers found Residential College participation significantly linked to positive results for the Reflective and Integrative Learning and the Discussions with Diverse Others Engagement Indicators, participation in High-Impact Practices, and retention. Based on these findings, Bucknell has prioritized Residential College participation, achieving a nearly 40% increase in that participation over the last three years.
Bucknell has also used NSSE findings to enhance diversity initiatives on campus. Specifically, researchers looked at responses by racial and ethnic group to individual items in the Discussions with Diverse Others Engagement Indicator and in High-Impact Practices participation. Informed by these findings, changes were then made to the training for both Orientation Assistants (OAs) and Resident Advisors (RAs) to include new topics and offices focused on diversity and inclusion. The revised OA training includes a session on critically examining first-year students’ experiences through a diversity lens, specifically paying attention to the needs of students with disabilities and students with different religious and political views as well as those who have experienced exclusion or discrimination on campus. The revised RA training emphasizes diversity and cultural fluency as core themes and has sessions dealing with power and privilege, campus climate, identity development, and global and world events. Additionally, the revised RA selection and interview process incorporates considerations related to cultural competency and diversity.
