Assessment in the Major
The campus’ Institutional Assessment Committee reviewed the Comprehensive Campus Assessment Plan and made recommendations to enhance the strategic role that assessment plays in decision-making activities at all levels on the campus. As part of this process, the committee asked for feedback on programs/majors related to 1) learning outcomes, 2) learning outcome assessment plans, and 3) how learning outcome assessment feedback is integrated into decision-making activities. The results are listed below.
LEARNING OUTCOME ASSESSMENT PLAN FEEDBACK
2006-07
Of the 34 programs/majors, 26 responded back. Looking at the current status of assessment of the majors:
- 1 program does not have a written assessment plan and has not adopted learning outcomes for the program.
- 4 programs do not have a written assessment plan but have adopted learning outcomes for the program.
- 21 programs have adopted an assessment plan that discusses the program’s learning outcomes, assessment methods, and how learning outcome assessment is integrated into their academic planning decisions.
The following is a table of how strongly the following statements describe each program’s Assessment Plan:
RESPONSE SCALE:
1 2 3 4 5
Not at all Somewhat Very N/A
Descriptive Descriptive Descriptive
Our Assessment Plan: |
1 |
2 |
3 |
4 |
5 |
N/A |
|
Contains the program’s mission statement |
N=1 |
N=2 |
N=2 |
N=6 |
N=11 |
|
|
Shows how the program’s mission statement supports the mission of UWGB. |
N=1 |
N=3 |
N=2 |
N=4 |
N=11 |
N=1 |
|
Identifies the core competencies that students should be able to demonstrate in their lives/career upon completion of the program. [Competencies relate to what the students are actually able to do. They are not the same as a learning outcome but rather reflect abilities/actions that an integration of the outcomes would help achieve.] |
|
N=1 |
N=2 |
N=5 |
N=14 |
|
|
States the program’s global learning outcomes and how they support the core competencies and the program’s mission |
|
N=1 |
N=5 |
N=4 |
N=12 |
|
|
|
|
|
|
|
|
|
|
Discusses how the broad global learning outcomes reflect the expectations of external constituents who hire program’s graduates |
N=1 |
N=3 |
N=4 |
N=3 |
N=9 |
N=2 |
|
Identifies learning outcomes unique to the major/emphasis area. |
|
N=1 |
N=1 |
|
N=18 |
N=2 |
|
Articulates how the learning outcomes for the different majors or emphasis link to the global learning outcomes for the program. |
N=2 |
N=1 |
N=5 |
|
N=4 |
N=10 |
|
Describes multiple methods of assessing how effectively students can demonstrate the learning outcomes. |
N=1 |
|
N=2 |
N=3 |
N=15 |
N=1 |
|
Contains a process to ensure that multiple sections of a course are grounded in the same global learning outcomes. |
N=1 |
N=2 |
N=1 |
N=4 |
N=5 |
N=9 |
|
Contains a process for developing criteria that will be used to develop and review the content of the methods used to evaluate how well students demonstrate the program’s broad global learning outcomes. |
N=1 |
N=5 |
N=4 |
N=4 |
N=6 |
N=2 |
|
Contains a process for separating evaluation of class assignments for a course grade from evaluation of questions, projects, performances, thesis, etc. for learning outcomes assessment purposes. |
N=1 |
N=1 |
N=3 |
N=11 |
N=3 |
N=3 |
|
Contains a process for ensuring that there are learning outcomes established for all courses related to learning expected from that course. |
N=2 |
|
N=6 |
N=5 |
N=8 |
N=1 |
|
Contains a process for ensuring that course learning outcomes are identified on course syllabi |
N=7 |
N=4 |
N=4 |
N=3 |
N=3 |
N=1 |
|
Contains a process for documenting how learning in each course will be assessed and communicated to students. |
N=6 |
N=2 |
N=5 |
N=1 |
N=6 |
N=2 |
|
Contains a process for ensuring that the relationship between course learning outcomes and the program’s global learning outcomes are communicated to students. |
N=3 |
N=6 |
N=7 |
N=2 |
N=1 |
N=3 |
|
Discusses the role that faculty are expected play in assessing their learning outcomes. |
N=1 |
N=1 |
N=3 |
N=4 |
N=11 |
N=2 |
|
Identifies how learning outcome assessment engagement is to be used by faculty as part of their annual performance reports, renewal documents, and tenure and promotion documents. |
N=9 |
N=1 |
N=2 |
N=3 |
N=4 |
N=3 |
|
Identifies learning outcomes that are clearly tied to meeting the aims of general education requirements (if the program has courses that contribute to general education.) |
N=2 |
|
N=3 |
N=2 |
N=5 |
N=10 |
|
|
|
|
|
|
|
|
|
Identifies learning outcomes that are clearly tied to meeting the aims of the writing emphasis requirement (if the program has courses that contribute to the writing requirement. |
N=2 |
N=1 |
|
N=6 |
N=10 |
N=3 |
|
Describes how the program will assess its contribution to interdisciplinary education. |
N=6 |
|
N=5 |
N=2 |
N=7 |
N=2 |
|
Identifies a process for the regular review and revision of the program’s assessment plan, learning outcomes and competencies |
N=4 |
N=3 |
N=4 |
N=4 |
N=7 |
|
|
Identifies how information gained from the evaluation of learning outcome assessment criteria, methods, and findings will be used in programmatic decisions [for example, curriculum design, course and number of sections offered, program review, strategic planning, faculty recruitment, and faculty training and development |
N=2 |
|
N=2 |
N=5 |
N=11 |
N=2 |
|
Methods currently used by each program to assess student learning:
SPAN |
x |
x |
x |
x |
x |
|
|
SOC WRK |
x |
x |
|
x |
x |
|
|
SOC |
x |
x |
x |
x |
x |
|
x |
PUB ADM |
x |
|
|
x |
|
x |
|
POL SCI |
x |
x |
x |
x |
x |
|
|
PSYCH |
|
|
x |
|
|
|
|
PHIL |
|
|
x |
|
|
|
|
NURS |
x |
|
x |
|
|
|
x |
MUSIC |
x |
x |
x |
|
x |
x |
|
MATH |
|
|
|
|
x |
|
|
INFO SCI |
|
|
x |
x |
x |
|
x |
HUM STUD |
x |
|
|
|
x |
|
x |
HUM DEV |
x |
x |
x |
x |
|
|
x |
HIST |
|
|
x |
|
x |
|
x |
GRMN |
x |
x |
x |
x |
x |
x |
|
FREN |
x |
|
x |
x |
x |
x |
|
ENV SCI |
|
|
|
|
x |
|
|
ENV P&P |
x |
|
|
x |
|
x |
|
ENGL |
|
|
x |
|
|
|
|
ERTH SCI |
x |
x |
x |
|
x |
x |
|
COMP SCI |
|
|
|
|
|
|
|
COMN ART |
x |
|
x |
|
x |
x |
|
COMM |
x |
x |
x |
|
x |
|
x |
BUS ADM |
x |
x |
x |
x |
x |
x |
x |
ART |
x |
x |
x |
x |
x |
x |
|
ACCTG |
x |
x |
x |
x |
x |
x |
x |
|
Course Grades |
GPA in the Major/Minor |
Direct Performance Measures |
Embedded Assessment Activities |
Faculty Professional Judgment |
External Critiques |
Capstone Course |
N=18, 69%__Course Grades
N=12, 46%_ GPA in the Major/Minor
N=19, 73%_ Direct Performance Measures [i.e.: comprehensive exam, portfolios, projects, presentations].
N=13, 50%_ Embedded Assessment Activities
N=18, 69%_ Faculty Professional Judgment
N=10, 39%_ External Critiques [i.e.: adjudicators, reviewers, internship Sponsors, professional certifications]
N=9, 35%_ Capstone Course
______ Other [Please identify other methods used]
SPAN- Exit interviews (assessment of program), Internship assessment forms, Study abroad: Evaluations of foreign faculty on UW-Green Bay Spanish students, Market competitiveness of Spanish grads |
GERMAN- Exit survey of program, Cultural proficiency test, Student placement in grad schools |
FRENCH- Exit survey, French program survey |
PHILOS- Exit interview with graduating students |
ENGL- survey |
SOC WRK- Field evaluation of competencies, Self evaluation of course objectives, Alumni evaluation of competencies |
MUSIC- See page 3 & 4 assessment strategies from memo |
HUM STUD- Exit survey in Capstone |
PSYCH- Exit interviews, Course exam performance, Group project grade, Alumni interviews |
HUM DEV- Graduate & Alumni surveys, Supplemental course evaluations, Graduate school acceptances, Individualized learning lists |
NURS- Program assessments (self-report student proficiency survey) at end of program & 1 yr post, Unit policy that a grade of "c" or better is required in major nursing courses, Unit is in the process of implementing a direct assessment of student work by a faculty committee to discuss/evaluate the degree to which program learning outcomes are met with individual course assignments |
POL SCI- Alumni surveys, Internship assessments |
PUB ADM- Grad Senior survey |
ENV P&P- Student survey |
ART- Student juried exhibit, Scholarship awards, Senior exhibits |
Methods currently used to assess the quality of teaching:
SPAN |
x |
|
|
|
SOC WRK |
|
x |
x |
|
SOC C D |
x |
x |
|
|
PUB ADM |
x |
x |
|
|
POL SCI |
x |
|
|
|
PSYCH |
x |
|
|
|
PHIL |
|
x |
|
|
NURS |
x |
|
|
|
MUSIC |
x |
|
|
|
MATH |
x |
|
|
|
INFO SCI |
x |
|
|
|
HUM STUD |
|
x |
|
x |
HUM DEV |
x |
|
|
|
HIST |
|
|
|
|
GRMN |
x |
|
x |
|
FREN |
|
x |
|
x |
ENV SCI |
x |
|
|
|
ENV P&P |
x |
x |
|
|
ENGL |
|
x |
|
|
ERTH SCI |
x |
|
|
|
COMP SCI |
x |
|
|
|
COMN ART |
x |
|
|
|
COMM |
x |
x |
|
x |
BUS ADM |
x |
|
|
|
ART |
x |
|
|
|
ACCTG |
x |
|
|
|
|
CCQ is administered in all or most classes |
A form other than the CCQ is used in most or all courses |
Program participates in formal teacher observation |
Faculty maintain a teaching portfolio |
N=20, 77%_ The CCQ is administered in most or all classes
N=9, 35%_ A form selected by this program that is different from the CCQ is administered in most or all classes
N=2, 8%_ The program participates in a formal program of teacher observation
N=3, 12%_ Faculty maintain a teaching portfolio
________ Other [Please identify other methods used]
COMN ART-Evidence of teaching quality includes student achievement, teaching materials, & internship assessment |
SPAN- Syllabi, faculty conversations and meetings |
GERMAN- Mid-term evaluations occasionally, senior survey results |
HIST- Some instructors use CCQ, others use SCD or HUS eval forms |
FRENCH- French program survey |
MUSIC- Student solo performances (jury, honors recital), ensemble performances, invitation of students to perform off campus, students accepted into grad programs |
COMP SCI- Periodic meetings to discuss course content in light of changing technologies |
SOC C D- Some faculty maintain a teaching portfolio |
PSYCH- Number of independent study/internships, Workshops attended, Awards for teaching course innovations |
HUM DEV- Individualized learning, course innovations, pedagogical workshop attendance, awards |
NURS- Optional peer review of teaching (highly encouraged) |
POL SCI- Each interdisp unit uses its own evaluation process. PEA handles most of Pol Sci, but so do SCD & URS |
PUB ADM- Maintain records of teaching material |
ENV P & P- Course material |
ART- Merit & retention reviews |
Programs that collect student end-of-course survey data about teaching use the results for various reasons:
N=19, 73%_ All scores are considered during the merit review process
N=2, 8%_ Scores that the instructor chooses to enter into his/her file are considered during the merit review process
N=1, 4%_ Scores are not considered during merit review
N=5, 19%_ Some or all scores are used to evaluate on-going teaching improvement efforts
_______ Other [Please identify other uses]
Comments are considered as significant as raw numbers, Raw numbers are evaluated in light of comments |
Also used in the contract renewal process for untenured faculty |
Chair reviews course comments, CCQs & discusses areas of concern with faculty, CCQ scores & comments from all courses are reviewed by the unit assessment & evaluation committee (AEC) |
Based on the recommendations from each program's most recent self-study:
N=1, 4%_ No changes were suggested as part of the self study process
N=5, 19%_ All changes have been implemented
N=9, 35%_ We are implementing the changes and expect to eventually address all changes suggested in the self study
N=9, 35%_ Important suggested changes are not being considered because of fiscal
constraints