Assessing Research Climates
Our Assessment Tools
Effectively managing the academic environment requires data. A professional, principled, inclusive and psychologically safe climate is crucial to for the facilitation of work flow and interactions between academic leaders, faculty, staff, and students. The National Center for Principled Leadership and Research Ethics has helped to develop tools which make it easier to efficiently measure work place climate. Tools include SOURCE, which measures research integrity, and KINDER, which measures interpersonal engagement. We use a purpose-built Results Analysis Engine to manage the process and present findings. Both SOURCE and KINDER comprise survey questions based on a Likert Scale as well as background questions. The Engine allows leaders to see a full summary on what areas of the environment are succeeding or failing. These tools are useful for addressing long term and short term issues within the professional academic environment, to ensure that each member of the community can thrive.
About The SOURCE
The Survey of Organizational Research Climate (SOURCE) is a validated instrument specifically designed to measure the climate of research integrity in academic organizations. It collects confidential responses from participants and provides a snapshot of program and unit microclimates through the aggregated perspectives of their members. Its use also contributes to the overall climate for research integrity by contributing de-identified data to a national comparison database. For an insight into how SOURCE results relate to institutional research integrity, please see this Nature article on the subject. For our newest white paper on developing academic leaders, see Academic Leadership Development, Critical Capabilities at the Department Level.
Results can help individual academic and research institutions:
- Characterize and compare departmental research integrity climates,
- Assess the efficacy of educational and mentoring approaches,
- Detect where research policies or practices (e.g., concerning data management, etc.) might need attention through responsible conduct of research (RCR) instruction
- Document and demonstrate for research sponsors institutional commitment to research integrity and RCR education,
- Justify enhanced efforts to foster a climate of integrity education and quality research.
Running the SOURCE at intervals of two to four years will demonstrate a commitment to improving the research integrity climate and provide data to assess its effectiveness over time.
The survey contains 32 items (5 point Likert scales) plus classification information about respondents (rank, departmental affiliation, type of highest degree). It takes 10-15 minutes to complete online.
In addition to enabling confidential institution-specific reports on units and the campus as a whole, de-identified data is compiled in a national comparison database so that the community as a whole may benefit. The norming initiative permits home institution departments to be appropriately assessed with respect to other comparable units in the same discipline.
About KINDER
KINDER was developed specifically to assess the quality of interpersonal climates in research settings. We know from the validation of this new instrument that results from the KINDER correlate with research integrity climate, organizational commitment, and a sense of integration with one’s work unit.
Although existing work has been done to develop assessments of research integrity climate (via the SOURCE, the Survey of Organizational Research Climate), up to now, no assessment tool has existed to measure interpersonal climate, particularly as it exists within academic research-focused environments. Over the past several years, as part of a project funded by the Alfred P. Sloan Foundation (Sloan Grant #2019-12294), our team has rigorously developed and validated such a tool in KINDER.
KINDER includes 24 question items (α=0.95), all asked on a Likert scale ranging from 1 to 5, with the following response categories: Not at All, Somewhat, Moderately, Very, and Completely. A “No basis for judging” option is also provided. These questions yield four means-scored summary dimensions, one tapping Institutional Practices influencing climate, and three tapping various aspects of the work-unit climate.
How can you and your university run the SOURCE or KINDER?
An organization that wishes to run the SOURCE or KINDER can make arrangements to do so with the University of Illinois’ National Center for Professional and Research Ethics (NCPRE). The license fee is based on the size of the project and the level of support desired in interpretation and analysis.
Once the license with NCPRE is in place, an institution provides emails and names of participants with departmental affiliations and status (graduate student, post-doc, faculty member). NCPRE manages the survey administration using the Results Analysis Engine (RAE)
The RAE sends emails via institutional email addresses seeking survey participation and follows up with reminders over a 4 week period. Response rates during previous studies have ranged from 15-50%.
The RAE provides analyses used to generate the summary reports for the contracting institution. As part of building a national “norming” database for providing comparative data, NCPRE retains de-identified information with limited demographics for comparison and benchmark purposes.
More detailed information on the procedures involved in implementing these instruments at your institution can be found here.
If we can answer any questions for you, please contact us at: ncpre-source@illinois.edu or 217-333-1416.
LC Pathway Index
[a-z-listing “Leadership Collection”]
KINDER Climate Survey
Civility, Interpersonal Dynamics, and Organizational Respect Climate Survey
Introduction and Background
Cultures are critical to the success of workplaces, and the resulting interpersonal climates are an important factor in research quality and integrity. We believe that cultures of excellence are those that facilitate their members’ ability to produce their best work. Members in these work climates feel welcome to engage fully and share creatively in the workplace.
Although existing work has been done to develop assessments of research integrity climate (via the SOURCE, the Survey of Organizational Research Climate), up to now, no assessment tool has existed to measure interpersonal climate, particularly as it exists within academic research-focused environments. Over the past several years, as part of a project funded by the Alfred P. Sloan Foundation (Sloan Grant #2019-12294), our team has rigorously developed and validated such a tool—the KINDER survey.
Survey Domains and Topics
Survey Features
The KINDER survey includes 24 question items (α=0.95), all asked on a Likert scale ranging from 1 to 5, with the following response categories: Not at All, Somewhat, Moderately, Very, and Completely. A “No basis for judging” option is also provided. These questions yield four means-scored summary dimensions, one tapping Institutional Practices influencing climate, and three tapping various aspects of the work-unit climate.
EAL LAS 2021
Excellence in Academic Leadership: LAS
Welcome to the College of Liberal Arts and Sciences Excellence in Academic Leadership (EAL) program cohort. This program is presented by the National Center for Principled Leadership and Research Ethics (NCPRE), housed in the Coordinated Science Lab here on campus.
General Reference Materials:
Session 6:
Session Date: Monday, May 16, 2022
*The Leadership collection videos are now available again. We apologize for any inconvenience!*
- Negotiation:
- Bullyproofing:
- Meet Professor Major (Part I)
-
- Meet Professor Major (part II)
Handouts and References:
- Negotiation
- Feedback
- Individual Development Plan
- Capstone
Session Date: Friday, February 4 at 12pm-2:00pm CT
Session Three: Vibrant Academic Units
Session Date: Friday, December 3 at 12pm-1:30pm CT
Slide Deck Reference (for Personal Use Only):
Session Date: 10/22/21 at 12pm-1:30pm CT
Slide Deck Reference (for Personal Use Only):
Session One: The Special Challenges of the Academic Environment
Session Date: 09/24/21 at 12pm-2pm CT
Prior to our meeting on Friday afternoon, we ask that you watch this short vignette that was filmed as part of our larger Leadership Collection. This particular clip features a faculty member named “Professor Major” having a conversation with a new Department Head on his first day.
As you watch the scene unfold and the behavior of the characters within it, we invite you to think about what is really happening in this interaction. Please consider the questions posed within the video and write some thoughts down in the Journal we have asked you to maintain as part of the program.
We will begin Friday’s session by discussing this scenario, after which we will take some time to explore the unique challenges our environment presents.
Pre-Session Materials:
Slide Deck Reference (for Personal Use Only):
Homework Assigned
News
The College Administrator’s Survival Guide by C.K. Gunsalus has a new edition. Click here to check it out.
EAL Duluth
Excellence in Academic Leadership: Duluth
Greetings and welcome to the Excellence in Academic Leadership (EAL) program presented by the National Center for Principled Leadership & Research Ethics (NCPRE). Our goal is to support your growth as an academic leader. The program will be offered through online group Zoom sessions augmented by outside readings and your reflections and analyses.
NCPRE creates and shares resources to support better ethical and leadership practices in academic and other professional contexts. Leadership—and particularly ethical leadership—is central to creating a culture that establishes healthy and productive professional interactions. We equip you with evidence-based tools to support intentional leadership development and institutional integrity.
Your cohort’s presenters are C. K. Gunsalus and Robert Easter. Sarah Mustered is your Cohort Coordinator and will be your main point of contact for scheduling and logistics.
We are planning 1.5 hour online meetings once a month through the academic year. There are a select few topics that require a longer period of two hours; you will receive advance notice of at least a month before those sessions. Each meeting will focus around a particular topic and include related resources available for you to pursue as your interests direct. Other than these online meetings, you will be in control of how much external time you spend; there will be ‘homework’ assignments after each session and it will always be your choice as to the time you devote.
Please feel free to contact Sarah Mustered, the Cohort Coordinator for this program, if you have any questions: mustered@illinois.edu
General Reference Materials:
Session Date Monday, May 11, 2022 at
Pre-Session Materials:
Homework Assigned:
- Use the attached capstone case study to develop a plan to address the scenario. Your task is to describe how to navigate the difficult process before you as effectively and constructively as possible. Each group of 2 people will present its approach to the full cohort in a 5-minute presentation. You are welcome to use slides, a document, or any other vehicle for making your presentation. You will be able to share your screen.
- Be prepared to field questions from the NCPRE team and your peers following your presentation.
- If you are unable to attend the final session, you are still encouraged to participate in preparing the capstone case with your colleagues.
- Use the attached guidelines to put together an Individual Development Plan (IDP)
- You are not expected to have a complete IDP ready by our meeting. We ask that you start to construct one and be prepared to informally discuss your progress with the group.
Session Date: Wednesday, February 9, 2022 at 12:30-2:30pm CT
Session Date: Wednesday, December 8 at 1:00pm-3:00pm CT
Session Three: Vibrant Academic Units
Session Date: Wednesday, November 17 at 1:00pm-2:30pm CT
Slide Deck Reference (for Personal Use Only):
Session Date: Oct 27, 1:00pm-2:30pm CT
Slide Deck Reference (for Personal Use Only):
Session One: The Special Challenges of the Academic Environment
Session Date: Oct 6, 1:00pm-2:30pm CT
Prior to our meeting, we ask that you watch this short vignette that was filmed as part of our larger Leadership Collection. This particular clip features a faculty member named “Professor Major” having a conversation with a new Department Head on his first day.
As you watch the scene unfold and the behavior of the characters within it, we invite you to think about what is really happening in this interaction. Please consider the questions posed within the video and write some thoughts down in the Journal we have asked you to maintain as part of the program.
We will begin the session by discussing this scenario, after which we will take some time to explore the unique challenges our environment presents.
Pre-Session Materials:
Slide Deck Reference (for Personal Use Only):
Homework Assigned
How to Use the Leadership Collection
How to Use the Leadership Collection
Get Started
About the Leadership Collection
The Leadership Collection was inspired by, and initiated with support and in collaboration with Nanyang Technological University in Singapore. It is a multi-media library of management and leadership materials curated for academic leaders. The Collection is accessible via the Internet, and is updated regularly. The Collection can be used on a “just in time” basis or as a platform for personal study and reflection. Categories of materials in the collection include:Just-in-Time Collection (I need to know now!)
- Quick Tips
- Checklists
- Videos: how to “do it right”
Leadership Bookcase
- Resources for the longer-term, travel, and reflection
Deep-Dive Collection (I am looking for deeper knowledge.)
- Videos: interviews with, and presentations by, experts and authorities
- Executive Briefings
- Curated Articles
- Annotated Bibliographies
- Case Studies
- Self-Assessments
Additional Material
Leadership Collection Overview (PDF) A Brief Introduction to Leadership Essentials (PDF) Leadership Essentials Part 1: Executive Briefing, part I (PDF) Leadership Essentials: Executive Briefing, part II (PDF) Tools for Leadership – Annotated Bibliography (PDF)Meet Your Leaders
Meet Our Leaders
https://youtu.be/RGVB1OPZV2w
EAL WMU
Excellence in Academic Leadership: WMU 2021
Greetings and welcome to the Excellence in Academic Leadership (EAL) program presented by the National Center for Principled Leadership & Research Ethics (NCPRE). Our goal is to support your growth as an academic leader. The program will be offered through online group Zoom sessions augmented by outside readings and your reflections and analyses. You are in a cohort with colleagues from Western Michigan University, tailored to your interests, and supported by resources in the NCPRE online Leadership Collection. NCPRE creates and shares resources to support better ethical and leadership practices in academic and other professional contexts. Leadership—and particularly ethical leadership—is central to creating a culture that establishes healthy and productive professional interactions. We equip you with evidence-based tools to support intentional leadership development and institutional integrity. Your cohort’s presenters are Ann Briggs Addo, BrandE Faupell, and C. K. Gunsalus. Jacob Ryder is your Cohort Coordinator and will be your main point of contact for scheduling and logistics. We are planning two hour online meetings, approximately once a month, throughout the academic year. Each meeting will focus around a particular topic and include related resources available for you to pursue as your interests direct. Other than these online meetings, you will be in control of how much external time you spend; there will be ‘homework’ assignments after each session and it will always be your choice as to the time you devote. Please feel free to contact Jacob Ryder, the Cohort Coordinator for this program, if you have any questions: jjryder2@illinois.edu- Session 1: September 27 at 2-4pm ET
- Session 2: October 25 at 2-4pm ET
- Session 3: November 22 at 2-4pm ET
- Session 4: December 6 at 2-4pm ET
- Session 5: January 31 at 2-4pm ET
- Session 6: February 14 at 2-4pm ET
- Session 7: February 28 at 2-4pm ET
- Session 8: March 28 at 2-4pm ET
- Session 9: April 11 at 2-4pm ET
- Session 10: April 25 at 2-4pm ET
General Reference Materials:
Session Date Monday, April 25, 2022 at 2:00-4:00pm ET
- Use the attached capstone case study to develop a plan to address the scenario. Your task is to describe how to navigate the difficult process before you as effectively and constructively as possible. Each group of 2 people will present its approach to the full cohort in a 5-minute presentation. You are welcome to use slides, a document, or any other vehicle for making your presentation. You will be able to share your screen.
- Be prepared to field questions from the NCPRE team and your peers following your presentation.
- If you are unable to attend the final session, you are still encouraged to participate in preparing the capstone case with your colleagues.
- Groups are listed here:
- Group 1: Cynthia and David
- Group 2: Megan and Heather
- Group 3: Linda and Pablo
- Group 4: Jon and Dave
- Group 5: Charles and Mike
- Group 6: Udaya and Kathleen
- Use the attached guidelines to put together an Individual Development Plan (IDP)
- You are not expected to have a complete IDP ready by our meeting. We ask that you start to construct one and be prepared to informally discuss your progress with the group.
Session Date: Monday, February 28, 2022 at 2:00-4:00 PM ET
Session Date: Monday, February 14, 2022 at
Session Date: Monday, December 6 at 2:00pm-4:00pm ET
Session Three: Vibrant Academic Units
Session Date: Monday, November 22 at 2:00pm-4:00pm ET
Slide Deck Reference (for Personal Use Only):
Session Date: Monday, October 25th at 2:00pm-4:00 PM ET
Slide Deck Reference (for Personal Use Only):
Session One: The Special Challenges of the Academic Environment
Session Date: Monday, September 27th at 2:00-4:00 PM ET
Prior to our Zoom Call on Monday afternoon, we ask that you watch this short vignette that was filmed as part of our larger Leadership Collection. This particular clip features a faculty member named “Professor Major” having a conversation with a new Department Head on his first day. As you watch the scene unfold and the behavior of the characters within it, we invite you to think about what is really happening in this interaction. Please consider the questions posed within the video and write some thoughts down in the Journal we have asked you to maintain as part of the program. We will begin Monday’s session by discussing this scenario, after which we will take some time to explore the unique challenges our environment presents.Pre-Session Materials:
Slide Deck Reference (for Personal Use Only):
Homework Assigned
These videos are part of a series of videos on Responsible Conduct of Research (RCR) produced by the Office of Research, University of Nebraska-Lincoln.