Tests run twice on windows

[cschneid]

I'm new to developing on windows, so I'm unsure if this is particularly windows related, or what, but I am seeing tests run twice on every save of a test file.

Windows 10, ConEmu + cmd.exe, Atom, Elixir 1.4.4, Phoenix 1.3.0pre2 (brand new app).

set MIX_ENV=test

> iex -S mix
Eshell V8.3  (abort with ^G)
Interactive Elixir (1.4.4) - press Ctrl+C to exit (type h() ENTER for help)
iex(1)> .iex(1)>

### A SINGLE SAVE of test/myapp/web/controllers/page_controller_test.exs

iex(1)> Finished in 0.06 seconds
iex(1)> 1 test, 0 failures
iex(1)>
Randomized with seed 278000
iex(1)> .iex(1)>

iex(1)> Finished in 0.00 seconds
iex(1)> 1 test, 0 failures
iex(1)>
Randomized with seed 396000

[OvermindDL1]

Confirmed here on Windows 10 as well, 2 tests are being run. It looks like a debounce should probably be done on some file listener I'd guess.

[rschmukler]

Thanks for the confirmation.

This is likely a bug with exfswatch which is what Cortex uses for file watching. I'd suggest an issue be opened there / perhaps a PR submitted for the debouncing mentioned.

[OvermindDL1]

I'd suggest an issue be opened there / perhaps a PR submitted for the debouncing mentioned.

I'm not sure the debouncing should exist in it, it should just report the events. Windows submits more events due to the way that NTFS works and sometimes each is useful in its own way.

[jeffdeville]

I'm getting the same issue for an umbrella project on osx. I put a log statement in FileWatcher though, and there was only 1 file change event.

[rschmukler]

@jeffdeville that's quite peculiar. Our primary env for Cortex is an umbrella project on OSX machines. Did you debug any further? Any insights you could share?

[jeffdeville]

Yeah, it's only on 1 of my projects that this has been happening. I'll keep an eye on it and try and get more info for you.

[jeffdeville]

@rschmukler Ok, working on the affected project. When cortex triggers the run of a test, it runs all of the test twice, but it does so in an unexpected manner:

If I run a test with just mix test PATH, it'll execute 10 tests. But when cortex runs the same file, exunit tells me it has executed 20 tests.

I dropped some logging in the test_runner.ex just to see what files are being loaded, and it all looks normal.

:run_tests_for_file - /PATH/apps/search/test/lib/repo_test.exs
Files Loaded: ["test/test_helper.exs", "/PATH/apps/search/test/lib/repo_test.exs"]

So in my case, I think the problem is somewhere in here:

task = Task.async(ExUnit, :run, [])
ExUnit.Server.cases_loaded()

Does that help?

[rschmukler]

@jeffdeville I suspect that this will be fixed by #21. Can you let us know (once it lands) if it is resolved?

[mmport80]

On Win10 with

{:cortex, "~> 0.4.2", only: [:dev, :test]}

my tests run x4.

Any thoughts? Anything I can help with?

[OvermindDL1]

my tests run x4.

I even get this on linux now that I'm deving exclusively there now too... >.>

[glittershark]

@OvermindDL1 I'm on Linux too, so I feel the pain. I haven't had the proper time in the last couple of months to finish up #21, but am hoping to get around to it over the holidays