Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

📋 Overview

Welcome to the documentation supporting the Assessment Compliance Report at USF!

The Report is designed to provide Deans and other institutional leaders with one-stop information on the level to which academic programs (Majors and Certificates)* provide required annual assessment reporting and planning in accordance following commonly accepted good practice in higher education and aligned with the expectations of the State University System of Florida Board of Governors (BOG) and USF’s current institutional accreditor, the Southern Association of Colleges and Universities Commission on Colleges (SACSCOC). Compliance with the requirements of these external stakeholders is assigned via a series of rubrics detailing the https://www.usf.edu/ods/accreditation/assessment-standards.aspx USF Assessment Standards (USF Academic Assessment Handbook, page 8), designed by the Office of Decision Support - Institutional Effectiveness (ODS-IE).

Every year, each Each program submits an annual Assessment Report for the previous year and an Assessment Plan for the upcoming year. Once Plans/Reports are submitted, ODS-IE reviews them according to the Assessment Standards and affiliated Rubrics, and assigns a rating , and provides specific feedback based on the rating. ODS-IE then works with the program to complete edits as needed based on rating; not all programs achieve the highest rating. Programs that struggle to achieve the highest rating might benefit from additional faculty development resources in the area of assessment.

*At a minimum, academic programs included in the assessment reporting and planning requirements are all unique Majors and Certificates (see Definitions below). Some program faculty choose to complete additional assessment Reports and Plans for Concentrations, however this is generally discouraged. These are listed on USF’s Institutional Summary Form provided to SACSCOC upon reaffirmation.

Panel
panelIconIdatlassian-note
panelIcon:note:
bgColor#FFF0B3

...

The ratings assigned to each program are as follows:

  1. Approved (2022 and beyond), Compliant (2017-2021), Developed and Highly Developed (2016-2017): All elements of the Plan/Report meet SACSCOC/BOG standardsthe USF Assessment Standards

  2. Reviewed with Comments (Minor Revisions) (2022 and beyond), Non-Compliant 1 (2017-2021), and Emerging (2016-2017): Minor revisions would be required to bring the document into compliance. These often include but are not limited to: including the total number of students assessed, ensuring that some form of inter-rater agreement data is collected or planned to be collected for assessment methods with a subjective scale (such as a scoring rubric for a project), and not including specific action items resulting from the use of the assessment results.

  3. Reviewed with Comments (Majors Revisions) (2022 and beyond), Non-Complaint 2 (2017-2021), and Initial (2016-2017): Components are missing from the document or are entirely outside the scope of commonly accepted good practice. Examples of major revisions needed are the use of the phrase “we will continue to monitor this outcome” in the “Use of Assessment Results” section of an Assessment Report or the exclusive use of course grades or course passing as the “Methods of Assessment” section of an Assessment Plan.

  4. On Hold/NA: There are no students available, or, there is another reason that has provided an approved delay in submission.

...

Programs in the College of Engineering and most of the programs in the College of Behavioral & Community Sciences complete these reports based on calendar years (January 1st - December 31st), while all others (e.g., College of Arts and Sciences, Taneja College of Pharmacy) complete them based on academic years, with preceding summer terms included. The alignment of colleges with years included in assessment plans/reports can be found in the table:

Calendar Year (January 1 - December 31)

Academic Year (June 1 - May 31)

College of Engineering

All other Academic Colleges

College of Behavioral and Community Sciences: Department of Child & Family Studies, Department of Mental Health Law & Policy, Department of Communication Sciences & Disorders, School of Aging Studies

College of Behavioral & Community Sciences: Department of Criminology, School of Social Work, Interdisciplinary Behavioral & Community Sciences Ph.D.

*At minimum, academic programs included in the assessment reporting and planning requirements are those identified on USF’s Institutional Summary Form provided to SACSCOC upon reaffirmation. Additional assessments may be tracked based on recommendations and requests from program faculty.

...

📖 Report Pages

Info

Each page in the Dashboard contains slightly different information.

Welcome Page: This page briefly describes the content of the Dashboard. There are no filters enabled on this page.

Majors: This page contains information related to the compliance of assessment submissions from the 2021 Report and 2022 Plan for the academic majors of USFAY22-23 Status: College Level Summary is a snapshot of the number and percentage of programs' 2022 Reports and 2023 Plans with each rating. The page can be filtered by College and Program Category (Bachelor, Master, Doctoral, Graduate Certificate, Undergraduate Certificate, Specialist) to provide additional detail. By hovering Hovering over the “slice” of the pie charts that are of interest, specific numbers of programs will be shownwill display the number of programs with a particular rating within that filtered group. The total number of Majors listed will be the same for the 2021 2022 Assessment Reports and 2022 2023 Assessment Plans, and any programs that have been or were in the process of termination during that period will be indicated with the “On Hold” designation. Certificates: This page contains information related to the compliance of assessment submissions from the 2021 Report and 2022 Plan for the credit-bearing graduate and undergraduate certificates of USF. The page can be filtered by College to provide additional detail. By hovering over the “slice” of the pie charts that are of interest, specific numbers of programs will be shown. The total number of Certificates listed will be the same for the 2021 Assessment Reports and 2022 Assessment Plans, and any programs that have been or were in the process of termination , the process of being established, or had no enrolled students during that period will be indicated with the “On Hold” designation. Another common reason that the “On Hold” designation is applied is that there are no students enrolled in the certificate or the specific component of the certificate (i.e., course) that is being assessed. If this is a frequent occurrence, it is often recommended to the program to assess achievement of a learning outcome in a course, despite certificate-enrolled students, to support that if a student does complete the course, the extent to which they will have achieved the learning outcomes.

Non Compliance List: This page contains lists of all programs assigned the Non-Compliant 1, Non-Compliant 2, or On Hold ratings for the Assessment Reports or Assessment Plans.

Longitudinal: To see the specific programs rated as “Non-Compliant 1,” “Non-Compliant 2,” “Major Revisions,” “Minor Revisions,” “Missing,” and “On Hold,” see the List of Non Compliant Programs page.

Longitudinal Status: College Summary includes a timeline view of the distribution of ratings for Reports from 2018 - 2022. This page contains an overview of assessment compliance from the 2017-2018 academic year (for academic year colleges)/calendar year 2018 (for calendar year colleges) to the current year. The proportion of Compliance to Non-Compliance over time is a valuable tool to help identify the extent to which faculty have been able to produce assessment materials.

List of Non Compliant Programs includes a list of the programs assigned a non-approved/non-compliant rating. It is important to note that these programs might be struggling with enrollment, so resourcing recruitment might be a valuable addition for allowing USF to continue offering the program to its students.

...

📊 Glossary: Definitions

Term

Definition

Where will I see this in the Dashboard?

Major

An organized curriculum offered within a degree program.

  • A major shall be reasonably associated with the academic discipline within the degree program under which it is offered and shall share common core courses with any other majors within the same degree program.

  • The major is the student's primary field of study.

  • Although in some cases, the major and the degree program names are synonymous, only the degree program shall be assigned a CIP Code and shall be included in the State University System's Academic Degree Program Inventory.

  • The number of credit hours for a major for each degree level shall be established by the University in accordance with State regulations and SACSCOC minimum requirements.

  • The degree program majors are coded within the Student Information System.

Example:

CIP Code 45.0201:

  1. B.A. Anthropology

  2. B.S. Biomedical Anthropology

CIP Code 11.0401:

  1. M.S. Cybersecurity Intelligence & Information Security

  2. M.S. Intelligence Studies

Certififcate

The “Majors” tab only includes majors that are not also Certificates
  • An organized set of courses offered as a distinct area of study that leads to specific educational or occupational goals.

  • Certificates may consist of courses that are part of a major or courses that are created outside of a major.

  • The number of credit hours for a certificate shall be set by the University.

  • Certificates are coded within the Student Information System and are recorded on the transcript.

  • A certificate of completion is awarded, not a diploma.

Example:

Applied Biostatistics

📎 Additional Resources

Panel
panelIconIdatlassian-info
panelIcon:info:
bgColor#E6FCFF

Find other sources of information that might assist in understanding more about assessment at USF.

Document

Link, if Applicable

The programs included in the assessment process are also those found in the Institutional Summary Form provided by USF to SACSCOC

upong

as part of our upcoming reaffirmation

Institutional Summary Form (Access Required)

Academic Assessment Standards

https://www.usf.edu/ods/accreditation/assessment-standards.aspx

Assessment Handbook (page 8)

Assessment Scoring Rubrics

: Assessment Handbook, pg. 19

Assessment Handbook (page 15)