News
Mandatory Test Set Released
Written on 23.09.2025 11:16 by Tobias Dick
Dear participants,
From now on, we run the set of tests that are mandatory to pass on your implementation as well as your tests on our reference implementation (using the function called registerSystemTestsForReferenceImplementation in the SystemTestRegistration.kt file). You can find test results in the results branch of your group’s repository.
There are a total of 100 mandatory tests, divided into 3 categories: 30 validation tests, 55 component tests, and 15 full tests.
The validation tests check how you handle correct and incorrect configuration files, component tests check the behavior of your implementation for specific parts of the simulation, and full tests check the behavior of your implementation for the whole simulation. Please note that we only test changes that you have pushed to your main branch.
We will soon release a second set of tests to the three categories that will be optional for passing the course but help to debug your simulation. In the upcoming days, we will also start running your tests (registered in the function registerSystemTestsMutantSimulation in the SystemTestRegistration.kt file) against mutants of the reference implementation to check whether your tests are able to detect the introduced faults. However, we will only run your tests on our mutants if all tests registered in this function succeed on our reference implementation.
Important: Passing 97/100 mandatory tests is sufficient to be able to pass the group phase. Additionally, you will have to find a certain number of mutants. Details on the mutants will be released in the coming days.
You can find a document with all the mandatory tests in the Materials (CMS) under "Implementation Phase" with a short description of the test scenarios.
Best,
the SE-Lab team