Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Druid Tasks failing with IllegalStateException in 29.0.1 version #16435

Open
laxmikantbpandhare opened this issue May 10, 2024 · 5 comments
Open

Comments

@laxmikantbpandhare
Copy link

laxmikantbpandhare commented May 10, 2024

Please provide a detailed title (e.g. "Broker crashes when using TopN query with Bound filter" instead of just "Broker crashes").

Affected Version

29.0.1

Description

Please include as much detailed information about the problem as possible.
Tasks were running in the 27.0.0 version and I upgraded it to 29.0.1 and it started failing.

The exact Error is:
1 error
at [Source: (File) line:1, column, 1085] (through reference chain: org.apache.druid.indexing.kafka.KafkaIndexTask["dataSchema"] -> org.apache.druid.segment.indexing.DataSchema["transformSpec"]

while locating org.apache.druid.server.metrics.DataSourceTaskIdHolder

  1. Problem parsing object at prefic[druid.lookup]: Cannot construct instance of 'org.apache.druid.query.LookupListeningAnnouncerConfig'. problem: unable to provision, see the following errors:
  2. Error in custom provider, java.lang.IllegalStateException: This is a proxy used to support circular reference. The object we're proxying is not constructed yet. Please wait until after injection has completed to use this object.

I got these error messages from middlemanager logs.

@laxmikantbpandhare
Copy link
Author

Same error happened with one more job

1 error
at [Source: (File) line:1, column, 2535] (through reference chain: org.apache.druid.msq.indexing.MSQCOntrollerTask["spec"] -> org.apache.druid.query.scan.ScanQuery["virtualColumns"]

@gianm
Copy link
Contributor

gianm commented May 14, 2024

Thank you for the report.

I wonder if you have the ServiceStatusMonitor enabled? There is an issue with it which will be fixed in the next release: #16140

@laxmikantbpandhare
Copy link
Author

Exactly @gianm. ServiceStatusMonitor is enabled in our Druid services. For time being, I reverted it back to 27.0.0

May I know in which Druid release we can expect this change 29.0.2?

@acherla
Copy link

acherla commented May 15, 2024

Will be merged in 30.0

@laxmikantbpandhare
Copy link
Author

laxmikantbpandhare commented May 15, 2024 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants