Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wait until CodeClimate supports SimpleCov 0.18+, then re-add badge & code coverage collection #1139

Closed
olleolleolle opened this issue Apr 1, 2020 · 5 comments
Projects

Comments

@olleolleolle
Copy link
Member

olleolleolle commented Apr 1, 2020

Basic Info

  • Faraday Version: master
  • Ruby Version: 2.6

Issue description

Our reporting of code coverage to Codeclimate always fails. That's due to them not supporting the 0.18+ format of SimpleCov output (branch coverage etc).

I recognized the error output in the codeclimate reporter's 2nd step: a Go failure to parse the newer SimpleCov format.

Error: json: cannot unmarshal object into Go struct field input.coverage of type []formatters.NullInt
Usage:
  cc-test-reporter after-build [flags]

Proposal: Downgrade simplecov to a codeclimate-supported version, and keep a code comment there to remind us of that.

Proposal, update: Disable coverage reporting and badge until Codeclimate supports all of SimpleCov. This Issue can be kept open as a tracking issue for this.

Steps to reproduce

See this GH Actions failure: https://github.com/lostisland/faraday/runs/543272466?check_suite_focus=true#step:9:8

When CI runs past that step, only in Ruby 2.6 that program is run. Exit code is 255 on failure, and the output looks like the above.

@olleolleolle
Copy link
Member Author

olleolleolle commented Apr 1, 2020

Thinking harder about this, I kind of want not to have CodeClimate's Go program hold SimpleCov back. I will opt to remove their coverage badge from the README instead. We can put the badge back when they support SimpleCov 0.18+.

Reporter issue here:
codeclimate/test-reporter#413

https://github.com/colszowka/simplecov/releases have a lot of action going on.

@olleolleolle
Copy link
Member Author

With any such removal would come "drop the CI stuff that transmits the coverage data as well".

@iMacTia
Copy link
Member

iMacTia commented Apr 2, 2020

Indeed we should not downgrade SimpleCov just because it's not supported by CodeClimate's test-reporter. Agree with disabling the test-reporter until a fix is pushed

@olleolleolle olleolleolle changed the title Downgrade SimpleCov to a version supported by CodeClimate Wait until CodeClimate supports SimpleCov 0.18+, then re-add badge & code coverage collection Apr 3, 2020
@iMacTia
Copy link
Member

iMacTia commented Dec 22, 2020

Great news!
codeclimate/test-reporter#413 (comment)

@iMacTia
Copy link
Member

iMacTia commented Aug 21, 2021

We've removed codeclimate, closing this

@iMacTia iMacTia closed this as completed Aug 21, 2021
v2.0 automation moved this from To do to Done Aug 21, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
v2.0
  
Done
Development

Successfully merging a pull request may close this issue.

2 participants