News
Mandatory Tests & Mutants Released
Written on 15.09.2026 14:34 by Tobias Dick
Dear participants,
From now on, we run the set of mandatory tests on your implementation, as well as your tests on our reference implementation (using the function registerSystemTestsForReferenceImplementation in the SystemTestRegistration.kt file). You can find the test results in the results branch of your group's repository. Please note that we only test changes that you have pushed to your main branch.
There are a total of 100 mandatory tests, divided into 3 categories: 25 validation tests, 60 component tests, and 15 full tests. The validation tests check how you handle correct and incorrect configuration files, component tests check the behavior of your implementation for specific parts of the simulation, and full tests check the behavior of your implementation for the whole simulation.
There are a total of 40 mutants, divided into 5 validation mutants and 35 simulation mutants. The validation mutants have bugs regarding the validation of either of the three input files. The simulation itself is unaffected by these bugs. To run tests against validation mutants, register tests in the function registerSystemTestsMutantValidation. The simulation mutants have bugs regarding the simulation logic. To register tests to run against these mutants, you have to register them in the function registerSystemTestsMutantSimulation.
Please make sure that all tests registered for the mutants pass against the reference implementation, as the mutants will only be executed if none of the tests in registerSystemTestsMutantValidation / registerSystemTestsMutantSimulation fail.
Important: To be able to pass the group phase, you need to pass 97/100 mandatory tests and find at least 35/40 mutants.
You can find two lists with short descriptions of all mandatory tests and mutants on the materials' page of the CMS.
Best,
the SE-Lab team