How to measure test coverage?

1

Is there a good way to measure how much test coverage test/run_test.py provides?

It seems someone asked something similar and got no response here: How to get a full coverage report of tests?

2

@ptrblck, you seem to be the go-to person for this – do you know where I can start?

3

I don’t know a good answer right now, but the idea sounds interesting.
Could you point me to some references, how the coverage is tested in other projects?
I know, that torchvision uses codecov for the PRs, but I’m unsure if you are looking for this approach or another one.

4

I tried to use coverage tool to get test coverage for torch source. And got 19% coverage which seems to be very low. Just asked question: PyTorch low test coverage

5

@ptrblck Do you know who might be able to help with this?

6

Let’s add @ezyang to it, as he might be able to give more insight or knows whom to ping.

1 Like