Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: restore loglevel in TestBase.withoutLogging #1899

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

BrendanWalsh
Copy link
Collaborator

sc.setLogLevel is a thin wrapper around log4j, so we can retrieve the current loglevel from log4j instead of resetting to "WARN"
https://github.com/apache/spark/blob/4be566062defa249435c4d72eb106fe7b933e023/core/src/main/scala/org/apache/spark/util/Utils.scala#L2330

@github-actions
Copy link

Hey @BrendanWalsh 👋!
Thank you so much for contributing to our repository 🙌.
Someone from SynapseML Team will be reviewing this pull request soon.

We use semantic commit messages to streamline the release process.
Before your pull request can be merged, you should make sure your first commit and PR title start with a semantic prefix.
This helps us to create release messages and credit you for your hard work!

Examples of commit messages with semantic prefixes:

  • fix: Fix LightGBM crashes with empty partitions
  • feat: Make HTTP on Spark back-offs configurable
  • docs: Update Spark Serving usage
  • build: Add codecov support
  • perf: improve LightGBM memory usage
  • refactor: make python code generation rely on classes
  • style: Remove nulls from CNTKModel
  • test: Add test coverage for CNTKModel

To test your commit locally, please follow our guild on building from source.
Check out the developer guide for additional guidance on testing your change.

// Spark doesn't expose a getLogLevel, but setLogLevel is a thin wrapper around log4j
// so get the current logLevel directly from log4j
// https://github.com/apache/spark/blob/4be566062defa249435c4d72eb106fe7b933e023/core/src/main/scala/org/apache/spark/util/Utils.scala#L2330
val currentLevel = org.apache.log4j.Logger.getRootLogger().getLevel
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What log level is this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants