|Additional Online Case Studies & Appendices|
Developing a Departmental Assessment Program:
North Dakota State University Mathematics
William O. Martin, Doğan Çömez
Sample report for Math 265 ( Calculus III), Spring 2002.
Preliminary Assessment Results
Mathematics 265: Calculus III
Sixty-eight students took two versions of a eight-item free-response test in Mathematics 265 (Professor Sherman) during the second week of the Spring 2002 semester. The test was designed to see the extent to which students had quantitative skills required for success in the course. Students were not allowed to use calculators while completing the assessments. Graduate students from the Department of Mathematics graded the papers, recording information about steps students had taken when solving the problems. The graders also coded the degree of success achieved on each problem using the following rubric:
Corrected papers, along with suggested solutions to the problems, were returned to students the following week. Summaries of the grader’s coding are included on the attached copy of the test. A test score was computed by awarding one point for each A or B code and zero points for each C, D, or E code. This score reflects the number of problems that each student had essentially or completely correct. The distributions of test scores are shown in these
The second pair of charts gives the distribution of partial credit scores called scoresum (each
problem was awarded 0-4 points, E=0 to A=4).
It appears that many students will need to review some mathematics covered on the test, since a majority were successful on less than half the problems. Almost two-thirds of the students (44 of the 68) achieved overall success on four or fewer of the eight problems.
The problems are ranked according the degree of success students achieved on each problem in the following table.
The problems are primarily sorted in this table by proportion of students who received a code of A or B, indicating that at least essentially correct. For reference, the second and third columns report the proportion of students who had the completely correct (A, column 2) and the proportion who made good progress (C, column 3).
The problems have been divided into three groups. At least two-thirds of the students could integrate using the Fundamental Theorem of Calculus, and solve using properties of logarithms. About three-quarters of the students successfully set up a definite integral to compute the area enclosed by a parabola and line.
Fewer then three-fifths of the students completed the square to find the center and radius of an equation, or used substitution to evaluate an integral and/or indefinite integral. Similarly they successfully used a sign table of a function and its derivative to sketch a graph of the function and estimate the derivative of a function at a point from its graph. Under a quarter of the students could solve using implicit differentiation, or calculate the area enclosed by one-loop of a four-leaved rose.
University records provided information about the mathematics courses that had been taken by students in these classes. The following tables report up to the four most recent mathematics courses recorded on each student’s transcript. Every student with available records indicate exposure to at least one mathematics course. The median for Math 166 was a B, but one should notice that almost half of the students received and A in the course. Calculus III is a retake for seven students that were tested, of these seven, two have no record of taking the prerequisite.
These histograms help to illustrate possible connections between test score and grade in the most recently completed mathematics or statistics course. On version one students with higher grades (lighter shades in divided frequency bars) in most recent course generally scored somewhat higher on this assessment test, as one might expect.
We asked the instructor five questions about the test results. Her responses are summarized below.
Reactions to these results:
Suggested responses(action plans):