ImmigrationU.S. citizenship determined by unreliable civics test
New study finds that the fate of nearly half a million immigrants hoping for U.S. citizenship may have been determined randomly, at least in part; to be awarded citizenship, immigrants must correctly answer six of ten questions on the verbally administered civics portion of the U.S. Naturalization Test, but researchers argue that the high-stakes civics test is not a reliable measure of civics knowledge
The fate of nearly half a million immigrants hoping for U.S. citizenship may have been determined randomly, at least in part, according to a new study by a Michigan State University researcher who found the high-stakes civics test is not a reliable measure of civics knowledge.
To be awarded citizenship, immigrants must correctly answer six of ten questions on the verbally administered civics portion of the U.S. Naturalization Test, said Paula Winke, assistant professor of second language studies.
Questions are randomly selected by an immigration officer from a pool of 100. Contrary to ethical high-stakes testing standards, however, U.S. Citizenship and Immigration Services (USCIS) has never released data demonstrating the 100 questions are reliable or valid, she said. More problematic, according to Winke, is that some test forms may be more difficult than others.
“If your citizenship status hangs upon this one test as it does for many, the award of citizenship or noncitizenship may be arbitrarily made, based on the form that’s pulled out of the drawer from the immigration officer,” Winke said.
A Michigan State University release reports that Winke’s study, which is published in the winter edition of the journal Language Assessment Quarterly, is the first to measure the reliability of the test. She found that despite immigration services spending six years and $6.5 million to make the test more standardized and fair, it is not.
USCIS rolled out a new test in 2008, and that’s the last time it was updated. That same year, immigration services received $375 million in fees from naturalization applicants and administered 1.65 million interviews, approving 1.05 million people for citizenship, Winke said.
Applicants spend $675 each to take the test and sometimes wait years to meet with an immigration officer. This is why it is baffling that the immigration service does not keep or publish data on the reliability of the test, Winke said.
To be reliable, the test should measure what Americans know and what noncitizens who haven’t studied for the test do not know, Winke said. In her research, Winke found 77 of the 100 possible questions were equally difficult for both groups.
Winke also found thirteen questions were easier for noncitizens to answer. One such question: “Name one war fought by the United States in the 1900s.”
USCIS should collect data to determine which questions are hard and which are easy for Americans and noncitizens alike, Winke said, to ensure that only those questions that reliably assess Americans’ core civics knowledge are on the test.
For most high-stakes tests — such as SAT or ACT — testing companies collect and publish test data demonstrating the test is reliable. The U.S. immigration service does not, Winke said.
“There’s a lot about accountability in testing and education these days. I think the same applies to our government,” Winke said. “As educators, we have to prove that every test under No Child Left Behind is reliable and valid, so why isn’t the government doing this for the civics test?”
— Read more in Paula Winkea, “Investigating the Reliability of the Civics Component of the U.S. Naturalization Test,” Language Assessment Quarterly 8, no. 4 (1 December 2011): 317-41 (DOI: 10.1080/15434303.2011.614031)
