Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

improve the log configuration with using RotatingFileHandler #4840

Closed
wants to merge 2 commits into from

Conversation

PyCatFish
Copy link

@PyCatFish PyCatFish commented Oct 9, 2020

Current log configuration makes only one log file that will become very big, i think its necessary to offer more options about this.

Resolves #3628

@codecov
Copy link

codecov bot commented Oct 9, 2020

Codecov Report

Merging #4840 into master will decrease coverage by 0.03%.
The diff coverage is 33.33%.

@@            Coverage Diff             @@
##           master    #4840      +/-   ##
==========================================
- Coverage   87.85%   87.82%   -0.04%     
==========================================
  Files         160      160              
  Lines        9735     9740       +5     
  Branches     1437     1438       +1     
==========================================
+ Hits         8553     8554       +1     
- Misses        925      928       +3     
- Partials      257      258       +1     
Impacted Files Coverage Δ
scrapy/utils/log.py 85.71% <33.33%> (-3.54%) ⬇️

@Gallaecio
Copy link
Member

Gallaecio commented Oct 11, 2020

Could you make this optional, so the current behavior continues to be the default behavior?

Also, please update the documentation and tests accordingly.

@PyCatFish PyCatFish closed this Oct 15, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Crawler logs are cut by day
2 participants