Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

change the filter query #17575

Open
wants to merge 4 commits into
base: master
Choose a base branch
from
Open

Conversation

steveny91
Copy link
Contributor

@steveny91 steveny91 commented May 15, 2024

What does this PR do?

container short image name that is automatically assigned as the source.

urseberry
urseberry previously approved these changes May 15, 2024
@steveny91
Copy link
Contributor Author

Staging screenshots:
Screenshot 2024-05-16 at 9 27 47 AM
Screenshot 2024-05-16 at 8 41 10 AM

Kyle-Neale
Kyle-Neale previously approved these changes May 16, 2024
iliakur
iliakur previously approved these changes May 16, 2024
vivek-datadog
vivek-datadog previously approved these changes May 16, 2024
@nhinsch
Copy link
Contributor

nhinsch commented May 17, 2024

Hi @steveny91, unfortunately I don't think we can support changing the source filter query for this integration as it is already used in production. This would be a breaking change that would cause all logs sent with the current source to suddenly no longer be parsed by the pipeline.

Can you elaborate a bit more on the goal you are trying to achieve here, etc.?

@steveny91
Copy link
Contributor Author

steveny91 commented May 17, 2024

@nhinsch So the problem is this. When I first made this pipeline, I had manually set the source on my pod to collect the logs with source:argo_rollouts, because I was using a demo image that was called argo-demo. But recently I was testing it out with the official argo rollouts image, the short image name there is argo-rollouts. In kubernetes when collecting logs with container_collect_all, we automatically tag the logs source from each pod based on their short_image name. In the normal case it will be source:argo-rollouts.

I wanted to change the source here because I think a large majority of our customers can just collect logs from their argo rollouts instances without needing to manually configure the log source in a containerzied environment (which it's almost exclusively kubernetes based).

My other approach was to add in a OR source:argo-rollouts to the filter, but it didn't pass the validations. Any good ways to work around this? This is more of a QoL type of change.

Thanks for looking into this!

@nhinsch
Copy link
Contributor

nhinsch commented May 17, 2024

For the second source, did you use the syntax source:(thing OR other_thing)?
I think adding a second source would be a better way to go here.

@steveny91
Copy link
Contributor Author

steveny91 commented May 20, 2024

@nhinsch I did that here with failing validations:
58f40d6

I gave your syntax a try and the validations have the same failure.

@steveny91
Copy link
Contributor Author

@nhinsch Friendly bump on this to see if you have any suggestions here. 🙇

@steveny91
Copy link
Contributor Author

@nhinsch Just wanted to give this a bump again. Feel free to contact me over slack if it's easier/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants