Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Capture "job graph is too large" and provide suggestions #4939

Open
kellen opened this issue Jul 28, 2023 · 0 comments
Open

Capture "job graph is too large" and provide suggestions #4939

kellen opened this issue Jul 28, 2023 · 0 comments
Labels
enhancement New feature or request

Comments

@kellen
Copy link
Contributor

kellen commented Jul 28, 2023

When users experience "job graph too large" issues, the problem is typically implicitly-derived coders or parquet config. We could potentially capture this exception and analyze the graph to automatically suggest a resolution. Alternatively, we can provide a standard set of potential resolutions in an improved error message.

Exception in thread "main" java.lang.RuntimeException: Failed to create a workflow job: (3d8bf2a262152664): The job graph is too large. Please try again with a smaller job graph, or split your job into two or more smaller jobs.
	at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:1363)
	at org.apache.beam.runners.dataflow.DataflowRunner.run(DataflowRunner.java:198)
	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:321)
	at org.apache.beam.sdk.Pipeline.run(Pipeline.java:307)
	at com.spotify.scio.ScioContext.execute(ScioContext.scala:586)
	at com.spotify.scio.ScioContext$$anonfun$run$1.apply(ScioContext.scala:573)
	at com.spotify.scio.ScioContext$$anonfun$run$1.apply(ScioContext.scala:561)
	at com.spotify.scio.ScioContext.requireNotClosed(ScioContext.scala:652)
	at com.spotify.scio.ScioContext.run(ScioContext.scala:561)
	at com.spotify.data.counters.package$DataCountersPublisherContext.runAndPublishMetrics(package.scala:105)
	at com.spotify.data.counters.package$DataCountersPublisherContext.runAndPublishMetrics(package.scala:110)
	at com.spotify.audience.promo.jobs.PromsToAdPlatformMappingsGCS$.main(PromsToAdPlatformMappingsGCS.scala:75)
	at com.spotify.audience.promo.jobs.PromsToAdPlatformMappingsGCS.main(PromsToAdPlatformMappingsGCS.scala)
Caused by: com.google.api.client.googleapis.json.GoogleJsonResponseException: 400 Bad Request"
@kellen kellen added the enhancement New feature or request label Jul 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant