CIEE study center sites and programs receive on-going monitoring and evaluating. An essential mandate of the Academic Consortium Board (ACB) is to ensure that CIEE maintains our high-quality standards, particularly for academics. Student Program Evaluations and ACB Site Evaluation Reports are available to the Consortium to provide information to prospective students and sending institutions.
ACB Site Evaluation Reports
The Academic Consortium, represented by the Academic Consortium Board (ACB), oversees the quality of all CIEE locations by conducting periodic evaluations of the study centers and their programs, and reporting its findings to the Consortium. As the product of an ACB evaluation, the report provides an in-depth discussion of all elements of the site visit, and includes recommendations from the ACB evaluators on how CIEE could improve or adjust the program to better meet the needs of students.
ACB Site Evaluation Executive Summary and CIEE Action Plan
The Executive Summary provides an abbreviated version of the full ACB evaluation report and emphasizes what the ACB evaluators feel are the most important recommendations. CIEE staff prepares a formal Action Plan in response to the recommendations in the Executive Summary.
Student Program Evaluations
Student Program Evaluation reports are generated each term across all sites based upon feedback collected while students are on a CIEE program. Survey questions are designed to measure student satisfaction and to assess the overall impact of all elements of the program, in and outside the classroom. The information gleaned from these evaluations drive activities that demonstrate CIEE’s commitment to continuous improvement of our learning environments.
GENERAL PRINCIPLES OF ACB SITE EVALUATIONS
- ACB members review each program according to its mission statement.
- Reviews must be regular and systematic. Each program is internally reviewed each term by CIEE staff and monitored by the ACB. Comprehensive on-site evaluations of each study center are conducted at least every 10 years.
- Reviews must include internal and external components. We believe self-evaluation is the best guarantee of program quality and improvement. For this reason, ACB study center reviews are conducted with full participation of the staff and students, but members of review panels are not associated with the programs they review.
- The review process must not impose an undue burden on staff nor impede the normal pattern of teaching and assessment.
- Because evaluation provides opportunity for improvement, final evaluation reports should be useful for planning.
NATURE AND SCOPE OF REVIEW
All reviews are conducted in accordance with the strategic objectives of the CIEE Academic Consortium Board and the stated purpose of each program. Each review reports on the following terms of reference:
- Quality of the academic activities, including teaching, assessment, and the appropriateness of the offerings
- Quality and appropriateness of services (predeparture and on-site orientation, academic and personal/intercultural counseling, housing, field trips, internships, accommodations for students with special needs, medical, etc.)
- Quality and appropriateness of the students who participate
- Quality of the site’s facilities (office and class space, library resources, equipment)
- Plans for improving the center’s teaching and services
- Relationship of center with the host university
- Perceived satisfaction of the Consortium-member institutions
- Perceived satisfaction of the student participants
- Safety and security
- Compliance of program and center with CIEE policies
- Quality of administration and management
- Future prospects and plans
- Relationship of the evaluation to previous evaluations when applicable
Before each review, the ACB evaluations coordinator, ACB evaluation team leader, team members, members of the CIEE Study Abroad executive team, and CIEE RDO for the specific site being evaluated confer on whether more terms of reference are necessary, and if strategic issues or particular problem areas should be noted.
The size of each ACB evaluation team is determined by the size of the study center and the number of programs it offers. Each team has a leader who is a member of the ACB. Team leaders are appointed by the ACB chair and the ACB evaluations coordinator. The team leader appoints other team members from the faculty of Consortium-member institutions, and is responsible for conducting the review and overseeing the final report.
Individuals in the following positions are integral to the review process, but cannot be members of a review team:
- CIEE Vice President of Program Management
- CIEE Vice President of Academic Affairs
- CIEE Regional Director of Operations (RDO)
- CIEE Center Director of the center under review
- CIEE Manager of Program Quality
- CIEE Manager of ACB Relations and Academic Quality
- Current program student participants, faculty, and administration of host institution (where applicable)
THE REVIEW PROCESS
ACB evaluation reviews include the steps outlined below. The process may take as long as six months.
- Review information. CIEE provides each member of the review team with thorough information about the programs offered at the site.
- Gather feedback from sponsoring institutions. After reviewing materials, the team conducts an electronic canvas of the top sending institutions, the school of record, and a sample of other sending institutions. If possible, the team leader conducts interviews with faculty and staff at some institutions by telephone, particularly if email communication has not been productive. Team members review this feedback to determine the institution’s level of satisfaction with the program, identify concerns, and assess how well the institution’s needs are being met.
- Request feedback from students and program staff. Before their visit, team members invite on-site students and staff to meet during the visit and submit written reviews of the programs offered at the site to the panel.
- Conduct site visit. This is the most important step because it gives the review team direct contact with participants, staff, and professors. A typical site visit takes five days. The team arrives on Sunday in time for a welcome meeting and dinner, followed by three days of evaluation, a day to prepare the team’s report, and departure on Friday. The visit includes intensive interviews, discussions, and deliberation, followed by formulating conclusions and writing a report. Team members must be available exclusively for the review during the site visit, as well as after the visit for consultation while the report is drafted.
- Prepare team report. Team members are busy professionals with full workdays, so it’s essential that each report for the ACB be drafted on site before the team departs. The team leader oversees production of the report, which addresses each of the terms of reference, makes recommendations for change or commendations as appropriate, and includes an executive summary. Reports are submitted to the ACB chair and its evaluations coordinator and to the CIEE executive director of program development and evaluation (who then circulates it to CIEE staff) within two weeks of the completion of the site visit. The report must be detailed, complete, and frank in every respect. Although parts of the report later will be made public, the complete report will be read only by CIEE staff and ACB members.
- Prepare ACB evaluation report. The ACB reviews completed reports at its next scheduled meeting.
- Each ACB evaluation report serves as a baseline for the next evaluation of the program, as well as for the yearly monitoring that occurs between evaluations. Over several years, a dossier is created, documenting how the program measures up to CIEE's high standards for quality, service, responsibility, and efficiency.
- CIEE develops action plan. CIEE staff members create an action plan in response to recommendations in the ACB evaluation report. The plan lists steps to address the major recommendations of the evaluation’s executive summary.
- The Evaluations Team presents the final report and executive summary to the ACB with a brief presentation on the action plans from CIEE staff. The report is then voted on for approval by the ACB and then made available for circulation.
- Regional Directors follow up. To assure maximum benefit, CIEE RDOs submit term reports at the conclusion of each program, commenting on the progress of any changes made as a result of the evaluation report and recommendations.