2023-106 Audit Scope and Objectives
University of California—Online Program Management
The audit by the California State Auditor will provide independently developed and verified information related to the University of California's use of online program management firms (OPMs). The audit's scope will include, but not be limited to, the following activities:
- Review and evaluate the laws, rules, and regulations significant to the audit objectives.
- To the extent possible, identify, obtain, and publicly produce, to the extent allowed by law, all OPM agreements that were in effect as of January 1, 2023 between all OPM providers and a selection of five University of California campuses and the University of California's Office of the President. Based on reviewing these contracts, perform the following:
- Identify how many contracts (per campus) required OPM employees to provide direct instruction to students instead of instruction provided by university employees.
- Evaluate trends or variations among the contracts in terms of payment or revenue sharing between the campuses and the OPM providers.
- Determine how often the contracts included incentive compensation to OPM providers based on student enrollment.
- Evaluate whether the contracts require the OPM vendor to disclose its contracted relationship with the university to students, and disclose whether or not the instructor is a university employee.
- To the extent possible based on each contract, compare the actual cost of OPM-provided classes to the amount of tuition university campuses charged for enrolling in those online classes.
- At selected campuses, review those campuses' administration of OPM agreements by performing the following:
- Review campus policies and guidance from the University of California Office of the President when establishing and overseeing contracts with OPMs.
- Review each campuses process for entering into contracts and deciding the services OPMs will provide. Identify all factors considered by the campus when entering into contracts.
- For any contracts under which instruction was provided by non-university faculty or faculty selected or paid by the OPMs, and to the extent possible, determine the following:
- The roles played by the university, the instructors, and the OPM under the contract.
- How funds were divided between the university and the OPM, how much was actually received by the university and by the OPM, and how much was connected to degree and non-degree programs.
- The extent to which the university financially benefitted from the contract.
- The extent to which students benefit from OPMs.
- Determine whether the selected campuses and OPMs provide sufficient transparency to students and whether advertisements and recruiting efforts, including the use of university logos, branding, email accounts, and local area codes are potentially deceptive.
- Conduct a survey of students who received instruction from OPM-paid instructors to determine whether the students felt that marketing and recruiting efforts were transparent and appropriate; how they paid for the relevant tuition; whether they were satisfied with the instruction provided; their demographic information; whether the course was worthwhile and assisted them in their careers; and whether they believed their instruction came from the university.
- To the extent information is available from the campuses, provide demographic information about the students, as well as information about the programs they were pursuing and their individual costs, debt, and outcomes.
- For courses and instruction provided through the OPM contracts at selected campuses, perform the following:
- Determine the extent to which university faculty provided instruction or identify other individuals who provided instruction and assess their qualifications. For courses and instruction not provided by university faculty, identify the level of transparency provided to prospective students about the instructor's status as non-university faculty.
- Identify how much students are charged for the courses and programs.
- Assess the oversight provided by campuses to ensure that qualified faculty and adequate instruction are provided to students.
- Review the completion and dropout rates for relevant courses taught by OPM-hired instructors.
- To the extent possible, determine whether students use any state or federal funds to pay for any courses provided by OPM-paid instructors.
- Review select campuses to determine their compliance with relevant state and federal laws, including the Higher Education Act's ban on incentive compensation. To the extent possible, determine how the University of California can better demonstrate its compliance with the prohibition on incentive compensation to the U.S. Department of Education.
- Review and assess any other issues that are significant to the audit.
California State Auditor's Office