Feature Requests
288 results found
-
Possibility to turn off 'Churn...' when 'Show coverage on selected test only' is on
When you activate 'Show coverage on selected test only' while at the same time having 'Churn selected test until it fails' on, there is only a popup dialogue for turning off the 'Show coverage on selected test only'. It's probably more relevant to stop churning than to show coverage of all the tests in that particular situation, so It would be nice if the dialogue [also] offered the possibility to cancel the churning session.
1 vote -
Allow to exclude/include files for "Autodetect Nuget build dependencies"
The documentation (https://www.ncrunch.net/documentation/reference_project-configuration_autodetect-nuget-build-dependencies) describes that NCrunch is able to auto-detect NuGet package references.
It also states that it may happen that NCrunch workspaces might bloat significantly.
At least to work around some limitations it would be nice to have a filter that either excludes or includes specific files.
For example, I would like to exclude the .nupkg files and the .xml (documentation) files. In my specific scenario that would reduce the "bloat" from 16MB to 4MB as now I only include the DLLs I actually need.
1 vote -
Detect impacted tests when assembly attributes change that impact test running
With NUnit 3 I added [assembly:Apartment(ApartmentState.STA)] as an assembly-level attribute, thus applying to all tests in that assembly. Yet, NCrunch doesn't consider that for impacted tests. There are possibly also other assembly attributes that could impact all tests.
1 vote -
Support Xamarin in Visual Studio 2017
Official Visual Studio 2017 with Xamarin support would be nice. In the moment it does only work the you edit Xamarin.forms.Targets file, what is annoying.
25 votes -
Provide option to only run tests on a Grid Node and not on the local machine
Provide the ability to specify that certain tests should never run on the local machine and should always run on applicable Grid Node clients (e.g. if the Grid Node client meets whatever capabilities are specified, etc.).
1 vote -
Add overlay icon in Tests window indicating if test is included in UI coverage filter
I would like to easy spot which tests in my test are included in current UI coverage filter.
Given I have a coverage filter set, I would like an icon on the test (e.g. red X with some small overlay icon for a failing test) so I easily can see which tests that are currently used in coverage filter (e.g. when have 20 pinned tests and showing coverage for only 5 of them).2 votes -
Add toolbar button for filtering running/queued tests in Tests window
I have a large amount of tests but would like to see which tests are currently being executed or pending execution (without showing all passed tests/projects), even if test was previously passing.
This so I can get an overview of the "backlog" of the current work queue and easily utilize the Search filter/sorting etc.
The Processing Queue Window is good to know what is "happening" but I would like to have similar info in the Tests window (more focused on test itself versus all other info build/analyze/servers etc.)
2 votes -
Keyboard shortcut for running covering tests matching current engine mode settings.
Similar to keyboard shortcuts "Run covering test in existing/new test process" I would like similar running covering tests, but using the engine mode filter settings for "tests to execute automatically".
Scenario: I have NUnit fixtures which generate tests with different categories, e.g.
[TextFixture(TypeArgs=new[]{typeof(SqlServerTest)}, Category="SqlServer")]
[TextFixture(TypeArgs=new[]{typeof(SQLiteTest)}, Category="SQLite")]I have 2 engine modes for running "sql server" and "SQLite" categories. Now, when I am at some covering code, I want to run the tests covering it, but only using the current selected engine mode (e.g. "SQLite").
In same way, when having cursor on a test, which both above categories uses, I easily…1 vote -
Include "Download full log" link in AllResults.html
I want to be able to download entire test output data in a file in order to search for keyword in any of the tests.
Scenario: I use NCrunch on TeamCity and have AllResults.html in a tab, since I also use "run impacted tests only" the TeamCity build log itself does not contain all test output so I have to resort to AllResults.html. I there want to find all tests with log output containing a substring, but have no way of searching output of all tests in one go.
1 vote -
Abort grid node processing in NCrunch Console if no more tests are to be executed
If I have 1 slow grid node connected to NCrunch Console, and NCrunch engine has completed all tests for the engine mode, I want the slow grid node to abort its build/analyze processing since there are no more tests to execute anyhow.
Background: My NCrunchConsole runs on a fast server, one grid node might be very slow. So even though the console tool is completed building/analyzing/running tests within 3 minutes, it sits and wait for the slow grid node to complete building for another e.g. 15 minutes (see forum post for a timeline example).
2 votes -
Option to always show compile warnings
[v3.23.0.10]
Today compile warnings are hidden with NCrunch for successfully built projects, I must select to "show all tests" and then select each project to see them.I would like a toolbar button or similar which toggles compile warnings, so I can always spot those before committing even if project builds without errors.
1 vote -
Add engine mode condition "Test is included in coverage filter"
Related to https://forum.ncrunch.net/yaf_postst2665_-Impacted-test--ignoring-coverage-filter.aspx
I would like to create an engine mode which runs condition ("impacted tests" AND "included in coverage filter"). Where "included in coverage filter" is true if no UI coverage filter is used, or the tests is covered by such a filter.
Scenario: I have a lot of pinned tests and want to focus on say 3 tests to quickly verify a fix in a part of code so I filter on those tests. I would then like to have an engine mode only running these tests in filter, but still execute impacted tests (so I don't manually…
1 vote -
Add count of pinned tests in Tests window summary
Today the tests window states e.g. "No tests are queued for execution. Monitoring 150 tests (10 failing), with 20 tests ignored."
I would like that text to include how many tests I have pinned (easy to tell if a new one gets pinned or not for example via engine mode).1 vote -
Add "Test sessions"/workspaces for test window
I would like, similar to ReSharper, to be able to save a collection of tests in a session/tab in order to work on it later on.
Scenario: I have 20 pinned failing tests which I am currently have in my worklog to fix. At one point in time I want to focus on a few other tests. I would like to save the 20 pinned tests in a tab, and pin 4 other tests in order to focus on those, and then later get back to the 20 pinned tests I was originally working on
Note: It might as well…
1 vote -
Filter on test category
I would like the "Search" window in NCrunch Tests also match test categories (and maybe other columns as well?).
(going "all in" the grid component could maybe be replaced with a component with filter-per-column possibilities)
2 votes -
Possibility to check code coverage on Pull Request with VSTS
I'd like to be able to check the code coverage on new code when one of my developper do a pull request using VSTS and Git.
2 votes -
Option to enter debugger when churn mode makes a test fail
I would like to use churn mode for a single test and make NCrunch enter the debugger as soon as churn mode was able to fail the test.
9 votes -
"Pin tests" link in "coverage has been set to show X test only" window
Similar to https://ncrunch.uservoice.com/forums/245203-feature-requests/suggestions/6363545-when-showing-coverage-for-specific-tests-show-icon , I have X pinned tests, and currently only show coverage for 1 test.
The code I am looking indicates uncovered (or filtered due to coverage filter).
I would like a link similar "Click to return to normal" that reveals the tests currently showing coverage for (easiest way I guess is to pin them).
This way I can easily navigate to the tests currently used in coverage filter, without currently having covered code under cursor.1 vote -
Add RMB menu "Run starting test on all enabled servers"
I have an explicit test which resets database to a clean state. If for whatever reason the db state becomes invalid, I would like to run this test on all connected/enabled "servers" (local and grid nodes).
Today I must select one by one ("Run starting test on server>X ") to ensure db is reset within each grid node.
1 vote -
Incremental build for console tool
From https://forum.ncrunch.net/yaf_postst2644_Incremental-build-with-NCrunch-console.aspx
I run NCrunch console on TeamCity with engine mode "run impacted tests only" (with switch -NCrunchCacheStoragePath) but the build/analyze phase is always restarting from scratch instead of utilizing "incremental build" functionality, which causes the session to run longer than needed even if no source files have been modified.
I would want, in some way, to have the console tool session behave as an "incremental build" with MsBuild would do, granted nothing has changed in source files and NCrunch cache folder is kept between sessions.
1 vote
- Don't see your idea?