Feature Requests

I suggest you ...

You've used all your votes and won't be able to post a new idea, but you can still search and comment on existing ideas.

There are two ways to get more votes:

  • When an admin closes an idea you've voted on, you'll get your votes back from that idea.
  • You can remove your votes from an open idea you support.
  • To see ideas you have already voted on, select the "My feedback" filter and select "My open ideas".
(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  1. Allow metrics to show method/function level coverage

    Currently the metrics allow the drilling down of coverage to the class level, but I'd like to be able to drill down into individual functions, and perhaps even properties.

    3 votes
    Vote
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      I agree to the terms of service
      Signed in as (Sign out)
      You have left! (?) (thinking…)
    • Support MoeIDE regards code coverage icon rendering

      After installing MoeIDE (
      https://marketplace.visualstudio.com/items?itemName=vs-publisher-593793.MoeIDE), for VS 2017, and configuring a background image, I noticed that NCrunch's code coverage icons are no longer visible.

      It seems that MoeIDE might be displaying the background image over the NCrunch icons. It would be awesome if NCrunch's icons could be adjusted in order to render on top of any images MoeIDE displays.

      1 vote
      Vote
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        I agree to the terms of service
        Signed in as (Sign out)
        You have left! (?) (thinking…)
      • Keyword highlight in test output window

        I have tons of log output during tests, however often I'm most interested in log output from test itself I am currently working with. Thus it would be helpful if I could highlights lines containing specific keyword (e.g. "*Test" to highlight test related log lines from test loggers).

        1 vote
        Vote
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          I agree to the terms of service
          Signed in as (Sign out)
          You have left! (?) (thinking…)
        • Do not automatically perform a build if tests are set to run manually

          We have some projects that are very expensive to build. Since I would like to see the output of the last test, I do not want to disable NCrunch completely, but the build engine keeps building the projects even when the tests are all set to run manually and I haven't yet started a test. I would like the option to defer the build until a test is scheduled for execution.

          7 votes
          Vote
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            I agree to the terms of service
            Signed in as (Sign out)
            You have left! (?) (thinking…)
            1 comment  ·  Admin →
          • Use project loaded in VS

            Hi.

            I want to be able to mark that nCrunch only use/load the projects that are loaded in VS.
            Since our solution are becoming big, I use Funnel to load only the projects I need for my current task. But nCrunch still load all projects in my solution file.

            4 votes
            Vote
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              I agree to the terms of service
              Signed in as (Sign out)
              You have left! (?) (thinking…)
            • Command line argument for excluded test visibility in report

              User can hide excluded items in Visual Studio by setting MetricsTreeShowExcludedMetrics value to false. But if you use command line tool for CI it outputs all test and sets html class to "excluded childNode".
              It would be nice to have setting ShowExcludedMetrics argument in command line tool

              1 vote
              Vote
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                I agree to the terms of service
                Signed in as (Sign out)
                You have left! (?) (thinking…)
              • Add option to run test until failure

                For tests with randomly generated inputs (e.g., FsCheck for F#), it would be great to have an NCrunch option that continues to run a single test until it fails, in order to catch rare edge cases.

                Currently, the alternatives with NCrunch aren't so great:

                1) If you set the maximum number of test runs to a large number, then when a failing case is found, it is necessary to run ALL the tests preceding the failing test in order to reproduce the failure, in order for the underlying random number generator to end up in the same state which generated…

                6 votes
                Vote
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  I agree to the terms of service
                  Signed in as (Sign out)
                  You have left! (?) (thinking…)
                • to support custom Xunit test cases

                  As discussed on Twitter (https://twitter.com/remcomulder/status/782892104485703681), I'd like NCrunch to support custom test cases.

                  xUnit has the support for custom test cases, as the STAExamples of the xUnit Samples demonstrate (https://github.com/xunit/samples.xunit/tree/master/STAExamples). That relies on using your own test discoverer, and specifying a custom test case. When you run that in NCrunch, it fails with a cast exception (https://gist.github.com/tiesmaster/5ecb8bf76aab6ee3cb2bfcc9d4f08e72#file-stacktrace-of-staexamples-on-stable-xunit-packages-downgraded-to-2-1-0).

                  I think this is a niche feature, since this something that won't be used that often, but still a powerful feature, so it would be really nice to have this.

                  21 votes
                  Vote
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    I agree to the terms of service
                    Signed in as (Sign out)
                    You have left! (?) (thinking…)
                    1 comment  ·  Admin →
                  • Show source code in code coverage report

                    In the code coverage report, we would like to be able to navigate into the source code files and see which lines are covered, much like OpenCover does. Here is a screenshot of that feature in OpenCover:

                    https://www.dropbox.com/s/38kj2wr5bczbtls/OpenCover%20Source%20Code%20Coverage%20Example.PNG?dl=0

                    Our developers love using NCrunch. We would like to use NCrunch for our CI process, especially because it would unify the development and CI environments. The organization is hesitant to use NCrunch for CI without the ability to drill down into the source code in the report to see what lines of code were covered when the CI job ran.

                    3 votes
                    Vote
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      I agree to the terms of service
                      Signed in as (Sign out)
                      You have left! (?) (thinking…)
                    • Integrate with the upcoming project rider, similar to what WallabyJS does

                      Integrate with the upcoming IDE from jetbrains to support project rider. Project rider is already available for download. Based on intellij. NCrunch couldn't do exactly what WallabyJS is doing and providing a number of IDE integrations.

                      353 votes
                      Vote
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        I agree to the terms of service
                        Signed in as (Sign out)
                        You have left! (?) (thinking…)
                      • Support [TestProperty]

                        MSTest allows us to tag tests with [TestProperty] attributes and their values are then available as this.TestContext.Properties.
                        However, ncrunch is not populating this dictionary, so a test using these attributes works in mstest/resharper, but fails in ncrunch.

                        6 votes
                        Vote
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          I agree to the terms of service
                          Signed in as (Sign out)
                          You have left! (?) (thinking…)
                        • 1 vote
                          Vote
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            I agree to the terms of service
                            Signed in as (Sign out)
                            You have left! (?) (thinking…)
                          • Rerun flaky test

                            I'm using NCrunch for more than 2 years.
                            IMHO it's must-have extension.
                            When I come to new company that do not use NCrunch I need to fix/stabilize some test to run with NCruch engine.
                            But still I stay with few flaky test.
                            I need to rerun them few times to filter trully failing test.

                            It would be nice introduce option for my case with flanky test.
                            It could be rerun count before test is treated as failed
                            Other option to introduce 3rd test state: flanky.

                            9 votes
                            Vote
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              I agree to the terms of service
                              Signed in as (Sign out)
                              You have left! (?) (thinking…)
                              1 comment  ·  Admin →
                            • Display Reason for ignored tests

                              I use Nunit, with ExplicitAttribute(string reason) on TestFixture class.
                              The tests are correctly ignored but there no reason visible in NCrunch Tests window.

                              It would be nice to have the reason, when I select an ignored test. Perhaps in Trace Output (which is empty for ignored tests).

                              9 votes
                              Vote
                              Sign in
                              Check!
                              (thinking…)
                              Reset
                              or sign in with
                              • facebook
                              • google
                                Password icon
                                I agree to the terms of service
                                Signed in as (Sign out)
                                You have left! (?) (thinking…)
                              • Mutation Testing

                                Perform Mutation Testing on the test cases to identify incorrect test cases.

                                12 votes
                                Vote
                                Sign in
                                Check!
                                (thinking…)
                                Reset
                                or sign in with
                                • facebook
                                • google
                                  Password icon
                                  I agree to the terms of service
                                  Signed in as (Sign out)
                                  You have left! (?) (thinking…)
                                • Provide parallelized execution time on Performance markers

                                  Today, NCrunch shows the execution time across all threads on its performance markers.

                                  If code is run in parallel, e.g.

                                  Parallel.For(0, 100000, DoSomething);

                                  the execution time is somehow misleading as it is not the real execution time (eg. 5 seconds) but instead the overall time (eg. 1 minute).

                                  It would be nice if NCrunch would show both times, the actual time needed for the loop as well as the overall time accross all threads.

                                  4 votes
                                  Vote
                                  Sign in
                                  Check!
                                  (thinking…)
                                  Reset
                                  or sign in with
                                  • facebook
                                  • google
                                    Password icon
                                    I agree to the terms of service
                                    Signed in as (Sign out)
                                    You have left! (?) (thinking…)
                                  • Enable "hotspots" indicators also for awaited asynchronous method calls.

                                    I would like NCrunch to display the actual time taken for an async method to have been called, when using await, instead of showing 0ms, just like they do for ordinary synchronous calls.
                                    See http://screencast.com/t/1mwMqiK0bi

                                    Example code:
                                    [TestFixture]
                                    internal class TestFixture
                                    {
                                    private async Task FooAsync()
                                    {
                                    await Task.Delay(1000);
                                    }
                                    [Test]
                                    public async Task AsyncTest()
                                    {
                                    await FooAsync(); //Coverage marker indicates 0ms duration.
                                    }
                                    [Test]
                                    public void NonAsyncTest()
                                    {
                                    FooAsync().Wait(); //Coverage marker indicates 1s duration.
                                    }

                                    }

                                    1 vote
                                    Vote
                                    Sign in
                                    Check!
                                    (thinking…)
                                    Reset
                                    or sign in with
                                    • facebook
                                    • google
                                      Password icon
                                      I agree to the terms of service
                                      Signed in as (Sign out)
                                      You have left! (?) (thinking…)
                                    • Fix up layout of custom engine modes test filter builder screen

                                      Currently the "Test Filter Builder" screen in custom engine modes renders very badly. (This is on my 4K laptop screen). See http://imgur.com/Vw5Q1qZ.

                                      This makes the feature barely usable - would be great (and hopefully simple) to fix it.

                                      1 vote
                                      Vote
                                      Sign in
                                      Check!
                                      (thinking…)
                                      Reset
                                      or sign in with
                                      • facebook
                                      • google
                                        Password icon
                                        I agree to the terms of service
                                        Signed in as (Sign out)
                                        You have left! (?) (thinking…)
                                      • Expose MSpec's [Subject] details in the tests window

                                        MSpec uses a [Subject] attribute to nominate the unit-under-test and optionally allows a "concern" to be specified.

                                        In R# these items appear in the test runner window as part of the test name, however in NCrunch there doesn't seem to be any way to get at this information, which is unfortunate.

                                        There just seems to be a level of organization missing when working with MSpec tests. It would be really helpful to be able to group the tests either by the [Subject] attribute, or by the file name that the test is defined in.

                                        6 votes
                                        Vote
                                        Sign in
                                        Check!
                                        (thinking…)
                                        Reset
                                        or sign in with
                                        • facebook
                                        • google
                                          Password icon
                                          I agree to the terms of service
                                          Signed in as (Sign out)
                                          You have left! (?) (thinking…)
                                        • Be able to specify which class(es) a test is covering

                                          I've noticed that in our test suite, various classes are showing as having code coverage through implict usage i.e. I'm testing class A, which is using class B within a tested method, and so lines of class B show as covered, when there's no dedicated tests for class B.

                                          Technically class B is getting tested there, but it would be nice if we had an attribute we could optionally use (multiple times per class/method), which specifies which class(es) the class/method is testing.

                                          [Tests<A>]

                                          Then the code analysis will only calculate the LoC coverage for classes specified by the attribute(s) on…

                                          6 votes
                                          Vote
                                          Sign in
                                          Check!
                                          (thinking…)
                                          Reset
                                          or sign in with
                                          • facebook
                                          • google
                                            Password icon
                                            I agree to the terms of service
                                            Signed in as (Sign out)
                                            You have left! (?) (thinking…)
                                          • Don't see your idea?

                                          Feature Requests

                                          Feedback and Knowledge Base