Katello test coverage report

Thanks to Andrew we’re now generating a test coverage report in Jenkins for
the katello on every PR and when code gets merged to master. We should be
able to track our code coverage over time using these reports and hopefully
it’ll improve our test coverage.

To view the coverage report for a PR, if you go to the test_katello_pr_core
job page, you should see a new icon on the left with the caption “Rcov
report”. If you click on that you should see a coverage report like this:

<http://ci.theforeman.org/job/test_katello_pr_core/2908/database=postgresql,ruby=2.2/rcov/>
http://ci.theforeman.org/job/test_katello_pr_core/2908/database=postgresql,ruby=2.2/rcov/

We’re still tweaking the settings—like right now it seems to only show
coverage for foreman files.

One thing to note is that if you see the following error when your job runs
in Jenkins, you may need to rebase against master:

<https://gist.github.com/daviddavis/17e7b09588180e121502cbe1cb63fdd7>
https://gist.github.com/daviddavis/17e7b09588180e121502cbe1cb63fdd7

tl;dr - rebase your katello PRs!

David

> Thanks to Andrew we’re now generating a test coverage report in Jenkins for
> the katello on every PR and when code gets merged to master. We should be
> able to track our code coverage over time using these reports and hopefully
> it’ll improve our test coverage.
>
> To view the coverage report for a PR, if you go to the test_katello_pr_core
> job page, you should see a new icon on the left with the caption “Rcov
> report”. If you click on that you should see a coverage report like this:
>
> <http://ci.theforeman.org/job/test_katello_pr_core/2908/database=postgresql,ruby=2.2/rcov/&gt;
> http://ci.theforeman.org/job/test_katello_pr_core/2908/database=postgresql,ruby=2.2/rcov/
>
> We’re still tweaking the settings—like right now it seems to only show
> coverage for foreman files.
>
> One thing to note is that if you see the following error when your job runs
> in Jenkins, you may need to rebase against master:
>
> <https://gist.github.com/daviddavis/17e7b09588180e121502cbe1cb63fdd7&gt;
> gist:17e7b09588180e121502cbe1cb63fdd7 · GitHub

Just an addendum - we have http://codeclimate.com/ checking out our PRs
in Foreman core to provide stats about code 'cleanliness' - you can hook
it up to a test reporting tool so it automatically tells you on every PR

It'd free up some Jenkins resources & lists it separately in the PR so
you might want to consider it

··· On 08/05, David Davis wrote:

tl;dr - rebase your katello PRs!

David


You received this message because you are subscribed to the Google Groups “foreman-dev” group.
To unsubscribe from this group and stop receiving emails from it, send an email to foreman-dev+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Daniel Lobato Garcia

@dLobatog

GPG: http://keys.gnupg.net/pks/lookup?op=get&search=0x7A92D6DD38D6DE30
Keybase: elobato (Daniel Lobato Garcia) | Keybase

The document you linked to sounds like they only integrate directly with a
handful of CI services but not Jenkins. It looks like they have a gem [1]
that would upload test coverage results but that won’t offload resources
from our Jenkins environment.

We have had code climate set up for a while for katello [2] and I’d love to
consider having it start checking PRs like we do on Foreman.

[1] https://github.com/codeclimate/ruby-test-reporter
[2] https://codeclimate.com/github/Katello/katello

David

··· On Mon, Aug 8, 2016 at 5:05 AM, Daniel Lobato Garcia wrote:

On 08/05, David Davis wrote:

Thanks to Andrew we’re now generating a test coverage report in Jenkins
for
the katello on every PR and when code gets merged to master. We should be
able to track our code coverage over time using these reports and
hopefully
it’ll improve our test coverage.

To view the coverage report for a PR, if you go to the
test_katello_pr_core
job page, you should see a new icon on the left with the caption “Rcov
report”. If you click on that you should see a coverage report like this:

<http://ci.theforeman.org/job/test_katello_pr_core/2908/data
base=postgresql,ruby=2.2/rcov/>
http://ci.theforeman.org/job/test_katello_pr_core/2908/datab
ase=postgresql,ruby=2.2/rcov/

We’re still tweaking the settings—like right now it seems to only show
coverage for foreman files.

One thing to note is that if you see the following error when your job
runs
in Jenkins, you may need to rebase against master:

https://gist.github.com/daviddavis/17e7b09588180e121502cbe1cb63fdd7
https://gist.github.com/daviddavis/17e7b09588180e121502cbe1cb63fdd7

Just an addendum - we have http://codeclimate.com/ checking out our PRs
in Foreman core to provide stats about code ‘cleanliness’ - you can hook
it up to a test reporting tool so it automatically tells you on every PR

https://docs.codeclimate.com/docs/setting-up-test-coverage

It’d free up some Jenkins resources & lists it separately in the PR so
you might want to consider it

tl;dr - rebase your katello PRs!

David


You received this message because you are subscribed to the Google
Groups “foreman-dev” group.
To unsubscribe from this group and stop receiving emails from it, send
an email to foreman-dev+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Daniel Lobato Garcia

@dLobatog
blog.daniellobato.me
daniellobato.me

GPG: http://keys.gnupg.net/pks/lookup?op=get&search=0x7A92D6DD38D6DE30
Keybase: https://keybase.io/elobato


You received this message because you are subscribed to the Google Groups
"foreman-dev" group.
To unsubscribe from this group and stop receiving emails from it, send an
email to foreman-dev+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.