General Information
| Payroll Title | ANL 4 | Title Code | 007237 | Grade/Step | 10 | Working Title | Director, Evaluation and Assessment |
|---|---|---|---|---|---|---|---|
| Department Name | Undergraduate Education Dept | Supervisor | Christine A Victorino | Department Head | Steven Brint |
Special Requirements and Conditions
| Critical Position |
| Travel |
Level of Supervision Received
| General Direction |
Items Used
Position Purpose
| Reporting to the Assistant Vice Provost for Undergraduate Education, the Director provides leadership in (1) designing and implementing evaluation studies related to undergraduate education and student success, and (2) coordinating assessment plans with senior administrators, campus committees, faculty, and staff. As part of these responsibilities, the Director will prioritize and complete research and evaluation requests, perform statistical reporting, write reports, and administer surveys, in order to meet campus and organizational strategic goals. The Director trains faculty and staff on issues related to academic assessment, regional and professional accreditation processes, and best practices and tools for assessment. |
Essential Functions
| Essential Function | % Time |
|---|---|
| Evaluation (Data Collection, Analysis, and Reporting) | 50 |
| Collects, extracts, manipulates, organizes, and analyzes data including campus data (e.g., student- and course-level) and surveys, and from multiple sources including the University of California Office of the President (UCOP), state and federal agencies, and non-profit organizations. Works with and manipulates small and large datasets using various software tools. Performs statistical analysis, using descriptive and statistical methods such as t-tests, ANOVA, multivariate and logistic regression, and matching procedures. Imports/exports data into spreadsheet programs, designs and produces graphs and tables, reviews tables for accuracy, usefulness, and consistency across reports. Interprets results and provides well-written reports and oral presentations to a variety of audiences in format that is most suitable for the specific audience. Conducts analysis and completes ad hoc reports, as requested by Vice Provost or Assistant Vice Provost, senior administrators, or Undergraduate Education personnel. Administers iEval course evaluation tool and provides analysis and reporting. Disseminates results to relevant departments and colleges. Utilizes relevant data extraction methodologies and tools (e.g., Cognos), including the ability to write query languages, to effectively access and retrieve data from various sources. Participates in the data collection of the "College Portrait" to ensure appropriate reporting in conjunction with the Accountability Report mandate. |
|
| Assessment | 35 |
| Administers the development and implementation of assessment plans (including General Education and WASC Core Competencies) at program, department, college, and institutional levels. Facilitates learning outcomes-based assessment across all levels, in support of academic program review, program and policy development, academic planning, and WASC Re-Accreditation. Develops and administers assessment training, and provides guidance to faculty and staff on issues related to academic assessment, regional and professional accreditation processes, and best practices and tools. Administrators Online Assessment Tracking System (OATS). Monitors and supports campus-wide undergraduate program submissions of assessment plans. Maintains and provides assistance and resource for system access use for all faculty and staff. Oversees the annual data records rollover and archiving process and reports annual status of assessment plan submissions. Reviews annual assessment reports and generates report on meta-assessment findings. Conducts presentations to appropriate groups such as department chairs, colleges, and the academic senate. Prepares institutional data and findings for WASC annual report, interim report(s), mid-cycle review, and institutional review (i.e., re-accreditation). Collaborates with Undergraduate Education personnel and campus partners (including Strategic Academic Research and Analysis, Enrollment Management Systems, and Office of Budget Planning) to collect and report data to WASC. Works closely with Vice Provost and Assistant Vice Provost, Academic Senate, and colleges to develop and implement campus-wide assessment policy, e.g., department compliance, assessment of general education, academic program review. |
|
| Consultation, Information Dissemination, and Committee Service | 10 |
| Provides consultation and support to undergraduate education staff, organizational units (i.e., Academic Resource Center, Undergraduate Research, Educational Initiatives, University Honors Program, Writing Program, and Summer Sessions) and other campus units related to evaluation studies, program analysis, assessment, and data management. Provides support on grant proposal write-ups for the evaluation/assessment section. Consults and provides decision support to the Vice Provost and Assistant Vice Provost on policy decisions and recommendations related to undergraduate education at UC Riverside. Participates in campus-wide discussions concerning student success programs, student enrollment, outcomes assessment, and WASC accreditation standards. Serves as a member of the Campus Institutional Research (IR) Coordinating Committee and UC Assessment Working Group. Maintains close relationships with institutional research and data analysts on campus. Serves on selected committees and workgroups related to undergraduate education programs such as student success programs, diversity initiatives, and course demand. Develops, enhances, and maintains Evaluation and Assessment reports, website content, resources, and accessible materials for download. |
|
| Other Duties as Assigned | 5 |
| Other Duties as Assigned | |
Minimum Requirements
| Minimum Requirement | Display Ranking |
|---|---|
| 10 | |
| 1. Master's Degree, or an equivalent combination of education and professional experience. Graduate coursework in social science methods, education, psychology, statistics, or research and survey design. 2. Five years of increasingly responsible analytical experience for an institution in higher education, institutional research, or other research and policy areas, or equivalent. 3. Extensive knowledge of and experience in conducting evaluation and assessment studies, at various levels (e.g. student-level, course-level, program-level, and institution-level). 4. Knowledge of professional standards and techniques for technical aspects of research and evaluation studies, including research design, statistical techniques, data collection instrument development (e.g., survey and interview questions), and data collection methods. Advanced experience using statistical and database software (such as Stata, SPSS, SAS, Oracle, or equivalent), and desktop computer applications (e.g. Microsoft Office). 5. Demonstrated ability to apply qualitative and quantitative research designs and statistical techniques including theoretical knowledge of, and practical experience with, advanced statistics including multiple regression, analysis of variance (ANOVA), and matching procedures. 6. Demonstrated ability to use techniques to extract and use data report writing tools from on-line systems and databases, including ability to organize and process the data for analytical purposes. 7. Skill in preparing comprehensive and in-depth analysis and/or reports of complex, sensitive, and multi-faceted issues, with demonstrated ability to uphold ethical and confidential professional standards. 8. Superior written and oral communication skills, with high level of attention to detail. Ability to tailor written reports and oral presentations to audience (e.g., internal and external , quantitative and non-quantitative audiences). 9. Demonstrated organizational and facilitation skills in leading cooperative activities with various administrative units, such as coordinating, facilitating, and participating in meetings for the purpose of resolving differences and working towards common goals, and ability to function effectively as a member of a team. 10. Excellent interpersonal skills to interact effectively with various and diverse constituencies at UCR, and within the UC system, and to work productively and efficiently in a complex, fast-paced environment. |
|
Preferred Qualifications
| Preferred Qualification | Display Ranking |
|---|---|
| 4 | |
|
1. Doctorate Degree in a field using extensive statistical analysis and techniques. 2. Demonstrated knowledge and experience participating in or leading WASC Re-Accreditation activities. 3. Thorough working knowledge of university administrative organization, policies, procedures, and practices. 4. Demonstrated knowledge of undergraduate education issues in institutions of higher education. |
|
| Posted Position Purpose |
|---|
| Reporting to the Assistant Vice Provost for Undergraduate Education, the Director provides leadership in (1) designing and implementing evaluation studies related to undergraduate education and student success, and (2) coordinating assessment plans with senior administrators, campus committees, faculty, and staff. As part of these responsibilities, the Director will prioritize and complete research and evaluation requests, perform statistical reporting, write reports, and administer surveys, in order to meet campus and organizational strategic goals. The Director trains faculty and staff on issues related to academic assessment, regional and professional accreditation processes, and best practices and tools for assessment. |
| Posted Minimum Requirements |
| 1. Master's Degree, or an equivalent combination of education and professional experience. Graduate coursework in social science methods, education, psychology, statistics, or research and survey design. 2. Five years of increasingly responsible analytical experience for an institution in higher education, institutional research, or other research and policy areas, or equivalent. 3. Extensive knowledge of and experience in conducting evaluation and assessment studies, at various levels (e.g. student-level, course-level, program-level, and institution-level). 4. Knowledge of professional standards and techniques for technical aspects of research and evaluation studies, including research design, statistical techniques, data collection instrument development (e.g., survey and interview questions), and data collection methods. Advanced experience using statistical and database software (such as Stata, SPSS, SAS, Oracle, or equivalent), and desktop computer applications (e.g. Microsoft Office). 5. Demonstrated ability to apply qualitative and quantitative research designs and statistical techniques including theoretical knowledge of, and practical experience with, advanced statistics including multiple regression, analysis of variance (ANOVA), and matching procedures. 6. Demonstrated ability to use techniques to extract and use data report writing tools from on-line systems and databases, including ability to organize and process the data for analytical purposes. 7. Skill in preparing comprehensive and in-depth analysis and/or reports of complex, sensitive, and multi-faceted issues, with demonstrated ability to uphold ethical and confidential professional standards. 8. Superior written and oral communication skills, with high level of attention to detail. Ability to tailor written reports and oral presentations to audience (e.g., internal and external , quantitative and non-quantitative audiences). 9. Demonstrated organizational and facilitation skills in leading cooperative activities with various administrative units, such as coordinating, facilitating, and participating in meetings for the purpose of resolving differences and working towards common goals, and ability to function effectively as a member of a team. 10. Excellent interpersonal skills to interact effectively with various and diverse constituencies at UCR, and within the UC system, and to work productively and efficiently in a complex, fast-paced environment. |
| Posted Preferred Qualifications |
| 1. Doctorate Degree in a field using extensive statistical analysis and techniques. 2. Demonstrated knowledge and experience participating in or leading WASC Re-Accreditation activities. 3. Thorough working knowledge of university administrative organization, policies, procedures, and practices. 4. Demonstrated knowledge of undergraduate education issues in institutions of higher education. |