Assume pyproject.toml:

[tool.pytest.ini_options]
addopts = "--reruns 2"

Current behavior

Right now, passing --exitfirst / -x will rerun twice.

Better: --reruns-on-exitfirst 0

This way, the user can set the reruns with exitfirst is used so it instantly errors. It preserves the default behavior.

--exitfirst's docs:

  -x, --exitfirst       Exit instantly on first error or failed test