Exit exam scores adjusted for standard measurement of error

Posted: Tuesday, September 05, 2000

JUNEAU (AP) -- Many students passed Alaska's new high school exit exam because the passing score was lowered to account for the unreliability of tests, state figures show.

State education officials said they wanted to be confident they didn't fail students who knew the material -- a situation that could invite lawsuits. But critics said the state dumbed down the test so parents wouldn't turn against the state's academic standards.

''To me it seems like it's dumbing down to make it politically palatable,'' Juneau School Board member Alan Schorr told the Juneau Empire.

Students must pass the three-part test in reading, writing and math to get a high school diploma. About 8,200 sophomores took the test in March, the first time it has been given. Those who fail a section can retake it several times in high school and for three years afterward.

Three committees of citizens, mostly teachers, met in Anchorage this summer to set a recommended cutoff point for the passing grade, called a cut score, for each section of the test.

But the state, following the recommendation of its testing contractor, CTB/McGraw-Hill of Monterey, Calif., lowered those cut scores before announcing student results in June. Under the lower cut scores, 75 percent of students passed the reading test, compared with 48 percent under the reading committee's cut score.

In writing, the percentage of passing students increased to 48 percent from 16 percent. In math, it went up to 33 percent from 15 percent.

The state Department of Education has recommended the state Board of Education adopt the lower cut scores by regulation when it meets in Anchorage next week. Board member Ernie Hall, an Anchorage furniture manufacturer, said everything will be on the table at those deliberations.

Richard Smiley, administrator for assessments at the state Department of Education, said the lower cut scores were derived in a standard mathematical way from the committees' cut scores, which weren't influenced by politics. The committees didn't know how many students would pass the tests under any given cut score.

Adjusting the cut scores to include standard error of measurement, which is a common practice, passes students who have mastered the material but had a bad day on test day, Smiley said. It also accounts for imperfections in the tests.

The basic issue is fairness, he said.

''We want to make sure that we're not denying a diploma to anyone that deserves one,'' Smiley said.

''States have ended up in courts over these kinds of things. Applying the standard error of measurement makes the tests much more defensible. We can stand up in court anywhere and say this test is fair,'' he said.

Richard Dobbs, vice president of marketing and sales at CTB/McGraw-Hill, said every published test includes standard error of measurement. It's similar to a poll that gives its results with a plus or minus spread to account for uncertainty in the figures' accuracy.

''What it's trying to accommodate is the fact that any one measurement is subject to the reliability of that measure,'' Dobbs said.

Including standard error of measurement doesn't alarm Mary Becker, a Juneau School Board member and retired teacher who served on the committee that set the initial reading cut score. She said she's willing to trust the education department's judgment.

The reading test was difficult, and the committee set a high cut score, higher than some committee members wanted, Becker said.

State Board of Education member Paula Pawlowski, an Anchorage parent, said the board is concerned about the way the standard error of measurement looks to the public. But the department's explanation was logical, she said. She said she doesn't see how it could lead to passing a student who isn't proficient.

Subscribe to Peninsula Clarion

Trending this week:


© 2018. All Rights Reserved. | Contact Us