Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add emitterMemBufLimit and emitterStorageType to rewriteTag #1072

Open
chrono2002 opened this issue Feb 28, 2024 · 0 comments
Open

add emitterMemBufLimit and emitterStorageType to rewriteTag #1072

chrono2002 opened this issue Feb 28, 2024 · 0 comments

Comments

@chrono2002
Copy link

chrono2002 commented Feb 28, 2024

Input pauses on high pressure in complicated configs (using rewriteTag).

"If the destination for the new records generated might face backpressure due to latency or slow network, we strongly recommend enabling the filesystem mode." (https://docs.fluentbit.io/manual/pipeline/filters/rewrite-tag)

It's better to have an ability to change emitter parameters to safe ones.

Add emitter parameters to rewriteTAg and multiline, eg:

  - rewriteTag:
      emitterName: rewrite_em
      emitterStorageType: filesystem
      emitterMemBufLimit: 128MB
 
  - multiline:
      emitterName: multiline_em
      emitterStorageType: filesystem
      emitterMemBufLimit: 128MB

See this PR for a possible solution:
#1069

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant