Pytest reports errorif an assert fails in an initialization fixture, and failif a test fails after the initialization fixture has run.
To make the test suite stop on errors or failures, the following flags can be used:
-x, --exitfirst       exit instantly on first error or failed test.
How can I make the test suite stop after the first error but keep going if there are failures?
Replacing all assert's with pytest.exit("some_message") in the initialization fixture does the trick.
Stop pytest on errors but not on fails