Contents
Cal Poly Pomona

P&R Responses for recommendation 105

Recommendation 105
Department ASI
Consensus Opinion NA out of NA faculty/staff : NA
Consensus Explanation
Minority Opinion NA out of NA faculty/staff : With modifications
Minority Explanation The recommendation on program quality assessment makes total sense. ODT can certainly provide the lead but other departments/auxiliaries should also be tapped on the development and implementation of program quality assessment for their areas.

The infrastructure for sharing assessment information and using these to generate program enhancements should be articulated and defined.

Recommendation 105
Department ASI PRSM
Consensus Opinion 8 out of 8 faculty/staff : Pro
Consensus Explanation We are in favor of a common measurement to benchmark, but want to draw attention to the subjective nature of things such as quality and student development. We hope the subjective nature of quality assessment and measurement will be taken into account when this recommendation is being implemented.
Minority Opinion NA out of NA faculty/staff : NA
Minority Explanation

Recommendation 105
Department Enrollment Services
Consensus Opinion 2 out of 2 faculty/staff : With modifications
Consensus Explanation We agree with the need for improvement in program assessment. Question whether ODT has the professional expertise in each area or the time to lead this initiative and suggest that departments use their professional associations and other benchmarking efforts to identify acceptable assessment tools and standards. The campus may be better served to have ODT continue its efforts in training rather than this type of assessment modeling.
Minority Opinion NA out of NA faculty/staff : With modifications
Minority Explanation

Recommendation 105
Department Learning Resource Center
Consensus Opinion 17 out of 17 faculty/staff : With modifications
Consensus Explanation PROGRAM QUALITY ASSESSMENT

The Learning Resource Center (LRC) appreciates the value of program assessment and has made formative and summative evaluations related to programs in the LRC. The five TRIO programs in the LRC serve as national models, as they have scored in the top ten percent of respective TRIO programs in the U.S. The ASI Universitywide Tutoring Program in the LRC has unique qualities that place it among the best in California. All LRC programs solicit comments from constituents on the quality of services provided. Assessment includes every aspect of each program such as tutor and program evaluations, the College Reading Skills Program quarterly Mentor Meeting, Upward Bound Saturday Academies, and the McNair Summer Program.

New synergies: The collaborative nature of the LRC creates synergies that enhance learning for students. Collaboration between the LRC and ODT has the potential to create new synergy in determining the best methods for assessing specific programs within the LRC.

Reduction in redundancies: ODT could utilize its expertise to review LRC’s current program assessment methods and provide recommendations and training for improvement in specific areas.

Savings in resources: The LRC program quality assessment surveys are available for constituents to complete online. However, ODT may be able to offer an approach that may reduce staff effort in compiling results. An opportunity for further collaboration with ODT may exist regarding more efficient methods of analyzing data, which would lead to savings in resources.

Increased opportunities for research: The LRC exists in a learning-centered environment where faculty and staff collaborate in research. Research provides credibility and recognition for programs. Research also encourages faculty and staff to use theory to guide practice, articulate a clear professional identity, and compare oneself to other institutions. Although the LRC is active in research endeavors, it welcomes the tools that Organizational Development and Training (ODT) can provide to LRC programs to enhance assessment and research mechanisms.

In addition, the LRC welcomes the support of ODT in procuring from the office of Institutional Research Assessment & Planning the statistics and data needed for TRIO programs to file their Annual Performance Reports in November and December of each academic year. Staff in CRSP, for example, had to manually ferret out persistence and graduation rates of more than 1200 of its students. This was an inefficient use of staff time. Other TRIO programs reported similar difficulties. Although cumbersome access to the Data Warehouse is available, finding necessary information is a challenge. A data dictionary identifying fields and their contents, plus table links, would allow non-I & IT users to confidently fulfill their data reporting needs.

External funding opportunities: The LRC programs must conduct research in the process of applying for external grant funds. An improved mechanism of assessing program quality and a significant change relative to improving the LRC’s access to the CPP Data Warehouse would empower the LRC to submit grants that are nationally competitive and create additional opportunities to identify and apply for external funding.
Minority Opinion NA out of NA faculty/staff : NA
Minority Explanation

Recommendation 105
Department Office of Student Life & Cultural Centers
Consensus Opinion 12 out of 12 faculty/staff : With modifications
Consensus Explanation We support enhanced support for increased training, consultation, and support for assessment. However, we are not sure that ODT is the best "home" for this charge. Should ODT be experts in assessment and evaluation? If this will be added to their charge, a separate unit should be added to ODT. IRAP may be a better home.
Minority Opinion NA out of NA faculty/staff : NA
Minority Explanation

Recommendation 105
Department Student Affairs Info & Tech Services (SAITS)
Consensus Opinion 11 out of 11 faculty/staff : Pro
Consensus Explanation
Minority Opinion NA out of NA faculty/staff : NA
Minority Explanation

Recommendation 105
Department Undergraduate Studies
Consensus Opinion 10 out of 10 faculty/staff : With modifications
Consensus Explanation Recommendation 105 – Program Quality Assessment

This recommendation seems to be redundant with the President’s call last year for each unit across the University to develop a plan to become more learning-centered, although it is conceded that not all divisions responded to his call in the same way. We do recommend, however, that while the ODT be the designated lead for organizing training to support programs, that the Faculty Center for Professional Development also play a major role in the development and delivery of such training.
Minority Opinion NA out of NA faculty/staff : NA
Minority Explanation

Recommendation 105
Department University Writing Center
Consensus Opinion 3 out of 3 faculty/staff : Con
Consensus Explanation The UWC does not agree that ODT, as a staff training organization, should provide guidance in assessing an academic program. Writing Center students currently evaluate every tutorial session on a five-question survey. We also administer quality and satisfaction surveys to the students in our tutorial groups at the end of the quarter. What we need help with is querying the university database. We can provide comma-delimited lists of the Bronco numbers of students who have used our services. We need to compare these students to a control group of similar students who have not used the UWC and ask questions about retention, GPA, time to degree, etc. At the moment we have to do all such queries student by student, and by hand. For example, if we want to know if students who attended a GWT workshop passed the GWT, we have to look at each student record. We think rather that we need help from Institutional Research in designing queries and report formats and in interpreting the data.
Minority Opinion NA out of NA faculty/staff : NA
Minority Explanation

Recommendations not submitted through the forms are available in this folder. They mainly consist of Microsoft Word or Adobe Acrobat documents. If none were submitted for this recommendation, the folder will be empty.