Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using kafkajs library in Kafka transporter #1226

Merged
merged 2 commits into from
Jul 16, 2023
Merged

Using kafkajs library in Kafka transporter #1226

merged 2 commits into from
Jul 16, 2023

Conversation

icebob
Copy link
Member

@icebob icebob commented Jul 16, 2023

馃摑 Description

Kafka transporter rewritten from kafka-node to kafkajs library.

馃幆 Relevant issues

#1200

馃拵 Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

馃摐 Example options

module.exports = {
    transporter: {
        type: "Kafka",
        options: {
            // KafkaClient options. More info: https://kafka.js.org/docs/configuration
            client: {
                brokers: [/*...*/],
                logLevel: 1
            },

            // KafkaProducer options. More info: https://kafka.js.org/docs/producing#options
            producer: {},

            // ConsumerGroup options. More info: https://kafka.js.org/docs/consuming#a-name-options-a-options
            consumer: {},

            // Advanced options for `send`. More info: https://kafka.js.org/docs/producing#producing-messages
            publish: {},

            // Advanced message options for `send`. More info: https://kafka.js.org/docs/producing#message-structure
            publishMessage: {
                partition: 0
            }            
        }
    }
}

馃殾 How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

  • Test A
  • Test B

馃弫 Checklist:

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have added tests that prove my fix is effective or that my feature works
  • New and existing unit tests pass locally with my changes
  • I have commented my code, particularly in hard-to-understand areas

@icebob icebob changed the title Kafkajs Using kafkajs library in Kafka transporter Jul 16, 2023
@icebob icebob linked an issue Jul 16, 2023 that may be closed by this pull request
@icebob icebob merged commit f11f772 into next Jul 16, 2023
127 of 128 checks passed
@icebob icebob deleted the kafkajs branch July 16, 2023 19:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Need replacement for kafka transporter
1 participant