Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate trace_exporter error logs #1523

Open
zackattack01 opened this issue Dec 19, 2023 · 1 comment
Open

Investigate trace_exporter error logs #1523

zackattack01 opened this issue Dec 19, 2023 · 1 comment

Comments

@zackattack01
Copy link
Contributor

While validating trace shipping in the 1.3.2 release we found the following error log:

{"caller":"launcher.go:208","component":"trace_exporter","err":"failed to build resolver: passthrough: received empty target in Build()","level":"debug","msg":"could not create new exporter","session_pid":16021,"ts":"2023-12-19T21:57:31.347327917Z"}

This did not appear to cause issues (traces were eventually shipped) as long as it was followed by:

{"caller":":0","component":"trace_exporter","level":"debug","msg":"successfully replaced global provider after adding osquery attributes","session_pid":16021,"ts":"2023-12-19T21:58:02.026116048Z"}

Verifying the timeline for exactly when shipping starts working was difficult due to the sampling rate, and frequent restarts/re-enrollments throughout the release validation - but @RebeccaMahany also suspected there may have been one window where traces were not shipping until launcher was reloaded.

We will likely want to investigate this error at some point, especially if we continue to see large gaps in shipping windows.

@James-Pickett
Copy link
Contributor

I believe that anytime we have a fresh install with a branch new launcher.db, we'll see the failed to build resolver message at least once. This is happening because we don't have a trace_ingest_url until we get the first batch of control server data. Should probably make apparent some how that we expect this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants