Feature Requests
-
Add engine mode condition "Test is included in coverage filter"
Related to https://forum.ncrunch.net/yafpostst2665-Impacted-test--ignoring-coverage-filter.aspx
I would like to create an engine mode which runs condition ("impacted tests" AND "included in coverage filter"). Where "included in coverage filter" is true if no UI coverage filter is used, or the tests is covered by such a filter.
Scenario: I have a lot of pinned tests and want to focus on say 3 tests to quickly verify a fix in a part of code so I filter on those tests. I would then like to have an engine mode only running these tests in filter, but still execute impacted tests (so I…
1 vote -
Add overlay icon in Tests window indicating if test is included in UI coverage filter
I would like to easy spot which tests in my test are included in current UI coverage filter.
Given I have a coverage filter set, I would like an icon on the test (e.g. red X with some small overlay icon for a failing test) so I easily can see which tests that are currently used in coverage filter (e.g. when have 20 pinned tests and showing coverage for only 5 of them).1 vote -
Add count of pinned tests in Tests window summary
Today the tests window states e.g. "No tests are queued for execution. Monitoring 150 tests (10 failing), with 20 tests ignored."
I would like that text to include how many tests I have pinned (easy to tell if a new one gets pinned or not for example via engine mode).1 vote -
Add "Test sessions"/workspaces for test window
I would like, similar to ReSharper, to be able to save a collection of tests in a session/tab in order to work on it later on.
Scenario: I have 20 pinned failing tests which I am currently have in my worklog to fix. At one point in time I want to focus on a few other tests. I would like to save the 20 pinned tests in a tab, and pin 4 other tests in order to focus on those, and then later get back to the 20 pinned tests I was originally working on
Note: It might as well…
1 vote -
Filter on test category
I would like the "Search" window in NCrunch Tests also match test categories (and maybe other columns as well?).
(going "all in" the grid component could maybe be replaced with a component with filter-per-column possibilities)
2 votes -
Possibility to check code coverage on Pull Request with VSTS
I'd like to be able to check the code coverage on new code when one of my developper do a pull request using VSTS and Git.
2 votes -
"Pin tests" link in "coverage has been set to show X test only" window
Similar to https://ncrunch.uservoice.com/forums/245203-feature-requests/suggestions/6363545-when-showing-coverage-for-specific-tests-show-icon , I have X pinned tests, and currently only show coverage for 1 test.
The code I am looking indicates uncovered (or filtered due to coverage filter).
I would like a link similar "Click to return to normal" that reveals the tests currently showing coverage for (easiest way I guess is to pin them).
This way I can easily navigate to the tests currently used in coverage filter, without currently having covered code under cursor.1 vote -
Add RMB menu "Run starting test on all enabled servers"
I have an explicit test which resets database to a clean state. If for whatever reason the db state becomes invalid, I would like to run this test on all connected/enabled "servers" (local and grid nodes).
Today I must select one by one ("Run starting test on server>X ") to ensure db is reset within each grid node.
1 vote -
Option to always show compile warnings
[v3.23.0.10]
Today compile warnings are hidden with NCrunch for successfully built projects, I must select to "show all tests" and then select each project to see them.I would like a toolbar button or similar which toggles compile warnings, so I can always spot those before committing even if project builds without errors.
1 vote -
Incremental build for console tool
From https://forum.ncrunch.net/yafpostst2644Incremental-build-with-NCrunch-console.aspx
I run NCrunch console on TeamCity with engine mode "run impacted tests only" (with switch -NCrunchCacheStoragePath) but the build/analyze phase is always restarting from scratch instead of utilizing "incremental build" functionality, which causes the session to run longer than needed even if no source files have been modified.
I would want, in some way, to have the console tool session behave as an "incremental build" with MsBuild would do, granted nothing has changed in source files and NCrunch cache folder is kept between sessions.
1 vote -
Allow to run in memory only
It would be nice if I could run ncrunch in memory only. That would extend the lifetime of SSDs and would be much faster. At the moment this is only possible with a ram drive.
6 votes -
Pin tests matching engine mode
Before selecting an engine mode (e.g. "Performance Tests") I would like to see which tests that would be executed for this mode, e.g. by pinning them. This way I can choose only to test run a single matching test for triage.
Ideas for implementation:
A) Create a sub menu on each engine mode "Pin matching tests" or similar, while the top menu item (engine mode name) still behaves as today.B) Add a NCrunch tests window toolbar button "Do not run tests automatically", then add a menu item "Pin test matching current engine mode". Then one can disable auto-execution, select…
1 vote -
Support Install Directory Outside of AppData
Due to security restrictions on programs executing out of AppData at my company, they whitelist another directory where we can install development software. Because NCrunch does not allow an install directory outside of AppData, I am unable to get it to work under this security policy.
It is pretty common to allow custom install paths, so I am requesting that you support this feature for NCrunch as well.
1 vote -
Add "Configure selected component" RMB menu on NCrunch project warnings
[v3.22]
Today I can select a project in NCrunch Tests window and RMB and choose "Configure selected component" to easily find it in the NCrunch Configuration pane.
However for project warnings I cannot do this (e.g. for warning "NCrunch detected unusual behaviour around the resolution of referenced assemblies required by this project in its test environment"). and must manually navigate to the project in the configuration pane, which is tedious for large solutions.1 vote -
Add "/VS" switch (vstudio version) to grid node server configuration
I have some tests requiring vs2013, these work fine with ncrunch.exe since I can use the /VS version.
However when I use vs2017 for local development the tests are failing (since the grid node uses vs2017 if that is available).
I would like the grid node configuration to be able to specifiy a vs version to use, so I can dedicate 1 grid node to run in vs2013 environment (in combination with capabilities to ensure such tests are run on that)1 vote -
Option to suppress TC service msg "NCrunch result: TestFailure" in console tool
From https://forum.ncrunch.net/yafpostst2618NCrunch-Console-and-TeamCity-muted-tests.aspx
I want to be able to utilize TeamCity Test Muting (see https://confluence.jetbrains.com/display/TCD18/Muting+Test+Failures ) and therefore I need NCrunch to not report build failure via TC service message if a test fails.
1 vote -
Option to enter debugger when churn mode makes a test fail
I would like to use churn mode for a single test and make NCrunch enter the debugger as soon as churn mode was able to fail the test.
5 votes -
Visual Studio (Mac)
Now that Visual Studio is available on the Mac, it would be nice for tools like this to be available for Mac users too.
8 votes -
VSTS Plugin to show the Code Coverage over time
The console tool is cool to generate a report. If there would be a VSTS plugin to show the coverage absolut or over time this would be a great feature.
3 votes -
Support Expecto
It would be great if NCrunch could integrate with Expecto (https://github.com/haf/expecto).
10 votes
- Don't see your idea?