Assessment Compliance Dashboards Documentation

Overview

Welcome to the documentation supporting the Assessment Compliance Report at USF!

The Report is designed to provide Deans and other institutional leaders with one-stop information on the level to which academic programs (Majors and Certificates)* provide required annual assessment reporting and planning following commonly accepted good practice in higher education and aligned with the expectations of USF’s current institutional accreditor, the Southern Association of Colleges and Universities Commission on Colleges (SACSCOC). Compliance with the requirements of these external stakeholders is assigned via a series of rubrics detailing the USF Assessment Standards (USF Academic Assessment Handbook, page 8), designed by the Office of Decision Support - Institutional Effectiveness (ODS-IE).

Each program submits an annual Assessment Report and Assessment Plan. Once Plans/Reports are submitted, ODS-IE assigns a rating and provides specific feedback based on the rating. ODS-IE then works with the program to complete edits as needed based on rating; not all programs achieve the highest rating. Programs that struggle to achieve the highest rating might benefit from additional faculty development resources in the area of assessment.

*At a minimum, academic programs included in the assessment reporting and planning requirements are all unique Majors and Certificates (see Definitions below). Some program faculty choose to complete additional assessment Reports and Plans for Concentrations, however this is generally discouraged. These are listed on USF’s Institutional Summary Form provided to SACSCOC upon reaffirmation.

The ratings assigned to each program are as follows:

  1. Approved (2022 and beyond), Compliant (2017-2021), Developed and Highly Developed (2016-2017): All elements of the Plan/Report meet the USF Assessment Standards

  2. Reviewed with Comments (Minor Revisions) (2022 and beyond), Non-Compliant 1 (2017-2021), and Emerging (2016-2017): Minor revisions would be required to bring the document into compliance. These often include but are not limited to: including the total number of students assessed, ensuring that some form of inter-rater agreement data is collected or planned to be collected for assessment methods with a subjective scale (such as a scoring rubric for a project), and not including specific action items resulting from the use of the assessment results.

  3. Reviewed with Comments (Majors Revisions) (2022 and beyond), Non-Complaint 2 (2017-2021), and Initial (2016-2017): Components are missing from the document or are entirely outside the scope of commonly accepted good practice. Examples of major revisions needed are the use of the phrase “we will continue to monitor this outcome” in the “Use of Assessment Results” section of an Assessment Report or the exclusive use of course grades or course passing as the “Methods of Assessment” section of an Assessment Plan.

  4. On Hold/NA: There are no students available, or, there is another reason that has provided an approved delay in submission.

 

The years associted with each college are as follows:

Programs in the College of Engineering and most of the programs in the College of Behavioral & Community Sciences complete these reports based on calendar years (January 1st - December 31st), while all others (e.g., College of Arts and Sciences, Taneja College of Pharmacy) complete them based on academic years, with preceding summer terms included. The alignment of colleges with years included in assessment plans/reports can be found in the table:

Calendar Year (January 1 - December 31)

Academic Year (June 1 - May 31)

Calendar Year (January 1 - December 31)

Academic Year (June 1 - May 31)

College of Engineering

All other Academic Colleges

College of Behavioral and Community Sciences: Department of Child & Family Studies, Department of Mental Health Law & Policy, Department of Communication Sciences & Disorders, School of Aging Studies

College of Behavioral & Community Sciences: Department of Criminology, School of Social Work, Interdisciplinary Behavioral & Community Sciences Ph.D.


Report Pages

Each page in the Dashboard contains slightly different information.

Welcome Page: This page briefly describes the content of the Dashboard. There are no filters enabled on this page.

AY22-23 Status: College Level Summary is a snapshot of the number and percentage of programs' 2022 Reports and 2023 Plans with each rating. The page can be filtered by College and Program Category (Bachelor, Master, Doctoral, Graduate Certificate, Undergraduate Certificate, Specialist) to provide additional detail. Hovering over the “slice” of the pie charts will display the number of programs with a particular rating within that filtered group. The total number of Majors listed will be the same for the 2022 Assessment Reports and 2023 Assessment Plans, and any programs that have been or were in the process of termination, the process of being established, or had no enrolled students during that period will be indicated with the “On Hold” designation. To see the specific programs rated as “Non-Compliant 1,” “Non-Compliant 2,” “Major Revisions,” “Minor Revisions,” “Missing,” and “On Hold,” see the List of Non Compliant Programs page.

Longitudinal Status: College Summary includes a timeline view of the distribution of ratings for Reports from 2018 - 2022. This page contains an overview of assessment compliance from the 2017-2018 academic year (for academic year colleges)/calendar year 2018 (for calendar year colleges) to the current year. The proportion of Compliance to Non-Compliance over time is a valuable tool to help identify the extent to which faculty have been able to produce assessment materials.

List of Non Compliant Programs includes a list of the programs assigned a non-approved/non-compliant rating. It is important to note that these programs might be struggling with enrollment, so resourcing recruitment might be a valuable addition for allowing USF to continue offering the program to its students.


Glossary: Definitions

Term

Definition

Term

Definition

Major

An organized curriculum offered within a degree program.

  • A major shall be reasonably associated with the academic discipline within the degree program under which it is offered and shall share common core courses with any other majors within the same degree program.

  • The major is the student's primary field of study.

  • Although in some cases, the major and the degree program names are synonymous, only the degree program shall be assigned a CIP Code and shall be included in the State University System's Academic Degree Program Inventory.

  • The number of credit hours for a major for each degree level shall be established by the University in accordance with State regulations and SACSCOC minimum requirements.

  • The degree program majors are coded within the Student Information System.

Example:

CIP Code 45.0201:

  1. B.A. Anthropology

  2. B.S. Biomedical Anthropology

CIP Code 11.0401:

  1. M.S. Cybersecurity Intelligence & Information Security

  2. M.S. Intelligence Studies

Certififcate

  • An organized set of courses offered as a distinct area of study that leads to specific educational or occupational goals.

  • Certificates may consist of courses that are part of a major or courses that are created outside of a major.

  • The number of credit hours for a certificate shall be set by the University.

  • Certificates are coded within the Student Information System and are recorded on the transcript.

  • A certificate of completion is awarded, not a diploma.

Example:

Applied Biostatistics

 

Additional Resources

Document

Link, if Applicable

Document

Link, if Applicable

The programs included in the assessment process are also those found in the Institutional Summary Form provided by USF to SACSCOC as part of our upcoming reaffirmation

Institutional Summary Form (Access Required)

Academic Assessment Standards

Assessment Handbook (page 8)

Assessment Scoring Rubrics

Assessment Handbook (page 15)