Skip to main content

Mapping NSSE Items and Developing Faculty at Carlow University

Dec 8, 2026

Mapping NSSE Items and Developing Faculty (Lessons from the Field–Volume 4)

The Office of Institutional Research, Effectiveness, and Planning at Carlow University maximizes information derived from NSSE results by using data from both the core survey and the Topical Modules. In 2014, Carlow administered NSSE and participated in two modules: Learning with Technology and Experiences with Information Literacy. Analysis of these data contributed to the development of explicit guidelines for a new core curriculum and the improvement of instruction by faculty.

Mapping Carlow’s NSSE results to specific action steps was linked to the new core curriculum guidelines. For example, in one document the survey item, “worked with a faculty member on activities other than coursework” was connected to actions such as educating students about co-curricular opportunities in the “Connecting to Carlow” course and the development of a co-curricular transcript. The Office of Institutional Research, Effectiveness, and Planning developed a graphically enhanced chart that (a) identified the NSSE survey item, (b) compared Carlow’s performance with the national average (e.g., a “thumbs up/neutral sign/thumbs down” picture), and (c) listed all of the new core curriculum components intended to ameliorate the concerning findings.

By reimaging NSSE results in a single chart—or “crosswalk”—the office developed an easy-to-understand information display tool that clearly delineated connections between data and action. For example, low NSSE scores from seniors for faculty feedback on a draft or work in progress were addressed by creating various skill labs (i.e., academic support experiences to help students develop communication, writing, and quantitative reasoning skills), by implementing a writing-intensive curriculum in the critical exploration courses, and by embedding assessment checkpoints during junior year seminars.

Because NSSE results also indicated participation rates in some High-Impact Practices (HIPs) were lower at Carlow than at other institutions, an action step called for the inclusion of five HIPs in the core curriculum (writing intensive curriculum, capstone courses, service-learning experiences, internships, and research opportunities with faculty). Although several of these HIPs were already in the curriculum, a conscious decision was made to bolster and expand them in the new curriculum. Not only has the crosswalk streamlined conversations regarding interventions to enhance student engagement, the document also serves as an easy-to-reference guide for measuring the effectiveness of these interventions.

Carlow University plans to administer NSSE in 2018 and is excited to see if scores on the targeted items improve after implementing the new core curriculum, the Carlow Compass (see Figure 8). The Carlow Compass Curriculum, which went into effect for all incoming students in Fall 2016, is an innovative general education curriculum rooted in the liberal arts and the Catholic intellectual tradition. Serving as a navigational tool to guide students toward academic and professional goals, it is integrated with a student’s major course of study and aligns with the university’s mission, vision, and Mercy heritage.Carlow University also used NSSE results to support and guide strategic priorities in other areas of the academic enterprise. While excelling in many aspects of student engagement and practice, Carlow obtained results from NSSE’s Learning with Technology Topical Module indicating it lagged behind its peers in integrating technology into undergraduate education. In the module, students are asked about the degree to which technology contributed to their learning activities such as understanding course ideas and collaborating with other students. The module also includes questions regarding the types of technologies used in class and the degree to which the student’s institution emphasized various types of technologies. The module results indicated that Carlow students were less likely to use certain technologies inside the classroom (e.g., electronic textbooks, e-portfolios, social networking) compared with students at other institutions participating in the module.

As a follow-up action, Carlow organized an internal professional development institute for all faculty and staff in spring 2016. The institute’s theme—Back to the Future: Carlow’s Journey of Innovative Technology—focused on sharing faculty successes at implementing technology as a way to inform and motivate late adopters. The institute included a plenary event, three hours of multiple training sessions (topics included Interactive Software Adobe Connect and Camtasia, and Engagement and Motivation through Digital Tools), and an open-mouse session during the reception where faculty showcased their technology skills.

In both of these uses of NSSE data—the crosswalk of NSSE items with action steps for the new core curriculum and the examination of student use of technology in the classroom—Carlow University has done outstanding work using specific data points in the survey results to guide interventions. Furthermore, the Director of Assessment for Institutional Research, Effectiveness, and Planning has diligently mapped these items to specific interventions (either in changes to the core or to the professional development opportunity). These steps have been essential to understanding how to improve student engagement and to linking this understanding to actual intervention. Going forward, to evaluate the results of its interventions, Carlow can use data from their future administrations to either prove the effectiveness of these actions or to develop new strategies to enhance these measured outcomes.

Carlow University

More stories