Option to exclude passing FIXTURE tests from Console runner
When using the NCrunch Console 4.3.0.13 with NUnit 3 and Team City we are seeing an extra "Fixture" unit test added to every class that has individual unit tests. This can significantly increase the number of tests reported by TeamCity compared to NCrunch in Visual Studio.
To be able to leverage NCrunch in a Continuous Delivery environment it is important that the build system test results & code coverage metrics match those in the development environment, and due to this reporting difference they currently do not.
I do understand the reason for the "Fixture" test appearing for diagnostic resolution, and forcing a [OneTimeSetup] failure clearly illustrates the value compared to the standard NUnit runner. However I would equally argue the value is only relevant when an error occurs.
Can I therefore request an option in the Console tool to exclude all PASSING Fixture tests from both the NCrunch HTML report and the Team City ## stdout messages. That way if a fixture test fails it will be reported with the required diagnostic resolution, whereas if it passes the test count would match that in Visual Studio.
Implemented in v4.4
-
Carlos Platoni commented
Agree