The Swedish Scholastic Aptitude Test – Umeå University's assignment since its beginning

Visitors to the Department of Applied Educational Science (TUV) are greeted by extra thick entrance doors and have to patiently wait to be let in for their pre-arranged visit.

"Umeå University generally has high security, but there are a couple of extra steps here regarding doors, networks, and the like. We live like in our own little world," says Christina Wikström, who is an Associate Professor in Educational measurement and the project manager for the Swedish Scholastic Aptitude Test at Umeå University.

Many people may not know that Umeå University has been tasked with designing the Swedish Scholastic Aptitude Test since its inception. A new type of knowledge test began to be investigated in 1965, and Umeå was officially given the assignment in 1971 by the then National Agency for Higher Education (Högskoleverket), via the government. The idea then, as now, is to provide an alternative path to higher education beyond high school grades.

Christina Wikström, project manager for the Swedish Scholastic Aptitude Test. 

ImageHans Karlsson

"Sweden is unique in using the Swedish Scholastic Aptitude Test (Högskoleprovet) as a separate track. In other countries, test results like this are combined with high school grades. There is a socio-political goal with the test in Sweden that is special; we believe in second chances and alternative paths," says Christina, and continues:

"It is a good way to capture those who may not have had a traditional study background, who have not received high grades but have absorbed and acquired knowledge in other ways."

The person often referred to as the father of the test is Sten Henrysson, who began working at Umeå University and the Teacher Training College (Lärarhögskolan) in 1968 and became the newly established university's first professor of practical pedagogy. He led the scientific work that eventually resulted in the Swedish Scholastic Aptitude Test.

First test in 1977

In 1977, the test was administered for the first time in Sweden, as a small-scale trial. Today, it is a knowledge test that almost all Swedes are familiar with, and which has been taken by over 1.8 million unique individuals who together have recorded over 3.6 million results. The test plays an important role in academic studies and is many people's path to their dream education.

"We know that more and more people are getting top grades from high school, and that high school grades are not comparable from one year to another due to the problem of grade inflation. It can also be that you feel you did not get fair grades because you were sick, unmotivated, or did not get along well with the teacher. You may realize that you want to study later in life, or had children early and postponed your studies. There is something beautiful about the Swedish Scholastic Aptitude Test in Sweden; it makes it possible to start studying at the university whenever you want in life," says Christina Wikström.

Two tests are taken per year, and since the pandemic a test result is valid for eight years.

ImageMattias Pettersson

15 people work on the test in Umeå

At TUV, 15 people work, to various extents, on the Swedish Scholastic Aptitude Test. In Umeå, all parts of the test are developed except for the English reading comprehension section, which is handled by the University of Gothenburg.

In addition, the test is designed and graded in Umeå. The written tests are also transported to Umeå and scanned by the Department of IT Support and Systems Development (ITS) under high security. Once the test is designed, the Swedish Council for Higher Education (UHR) takes overall responsibility for the logistics and practical administration of the test.

An unexpectedly large part of the workload at TUV is the handling of test results, as these are public records. Employees spend a considerable amount of time providing information to the public. This can range from test participants wanting to know their current or previous results to inquiries from journalists.

"They can call and want to know what a particular minister or famous person scored on the test, but it can also be private individuals who want to know others' results. There have also emerged many coaching companies that help people achieve good results on the test, and they can contact us to obtain statistics, results, and other information. The principle of public access to official records is fundamentally good but can be challenging in such contexts," notes Christina.

She emphasizes that it is somewhat unique to Sweden that all test assignments are released publicly after each test.

"It is unusual. But then it is possible to practice on them, and it becomes a way to make it a bit more transparent. It is an extensive test, where it is important to use the time effectively, and then it is important to be able to prepare in a good way. Then it can be an advantage to access previous tests and get an idea of how they look."

New test format since 2011

In 2011, the test was revised to include more quick math tasks and a reduced word section. Previously, vocabulary comprehension constituted about one-third of the test. Vocabulary comprehension is a skill that improves with age, so younger individuals, who might be seeking university admission after high school, are at a disadvantage.

Per-Erik Lyrén

ImageHans Karlsson

"There was criticism that the word test weighed very heavily. Which, quite logically, was considered to be perhaps a somewhat too large part. Some engineering programs expressed criticism that the mathematical subtests had too little weight compared to the verbal subtests overall. The fact that the word test constituted such a large part also sparked internal criticism, which was also expressed by the international council for the Swedish Scholastic Aptitude Test," says Per-Erik Lyrén, former project manager and now investigator at TUV (Department of Applied Educational Science).

One item – two years to develop

At TUV, there are also three researchers who study the Swedish Scholastic Aptitude Test, as well as doctoral students involved from the department, or other external departments, that use the test data to develop, for example, statistical methods. The test includes a so-called trial section, which is not an official part of the test result but is used to collect statistics.

"The data generated by the test is a unique measure for researchers to use. We have no equivalent measure of knowledge in Sweden that has existed for so long and where the results are on the same scale," says Christina.

The Swedish Scholastic Aptitude Test is administered twice a year, and since the pandemic, a test result is valid for eight years. Two tests are designed each year, which over time should be entirely equivalent. At the department, it is said that it takes an average of two years to develop a test item, from idea to print. The items are, of course, developed in parallel and there are always items in a sort of queue system.

"What takes the most time is not the design or development of an idea, but all the review steps. Each task must also be tested empirically to get data that can show if it works as intended," says Christina.

"We have review meetings where we really scrutinize the items. Some items we can sit with for a long time to discuss formulations and word choices," says Per-Erik Lyrén.

How is it to work with the Swedish Scholastic Aptitude Test?

"It is an honorary assignment. It is a test that should be taken very seriously because it has such great significance for so many people. When I started as a project manager, I was also surprised by how exciting it is," says Christina.

Per-Erik has worked at the department since 2002 in various roles, including test developer, in leadership positions, and as a researcher.

"All roles have their charm, and now I do quite a few different things. Everything has been fun and interesting in its own way, but just sitting and nerding out on different tasks, constructing or reviewing them, is incredibly fun," he says.

What is the most common reaction you get when you say that you work with the Swedish Scholastic Aptitude Test?

"It is a great advantage that everyone knows what it is. The only thing they ask is what do you do the rest of the time," says Christina with a laugh.

"Same for me, it is a bit grateful in that way that everyone has a relation to it," agrees Per-Erik.

"A test as important as the Swedish Scholastic Aptitude Test requires a lot of analysis, preparation, research, and much more around the actual construction, which we have received good support for."

Nervous during exam day

Even though the test assignments are designed well in advance when the test is finally administered, it is still a bit nerve-wracking at the department as the exam day approaches.

"There is a bit of tension. Not for myself, but it's like sending off your child in some way. You almost don't want to think about everything that has to go right. The printing, all the schedules, the transports, that the right person receives the tests and that they are handled with the required confidentiality," says Christina.

"There are so many things that can go wrong, but thankfully it usually goes well," says Per-Erik.

Both highlight the good cooperation with the Swedish Council for Higher Education (UHR) and the University of Gothenburg as a key factor in maintaining the high quality and reputation of the test.

"A test as important as the Swedish Scholastic Aptitude Test requires a lot of analysis, preparation, research, and much more around the actual construction, which we have received good support for. This makes us all feel very satisfied and proud of the result we can present," says Christina Wikström.