Skip to content

Example GitHub Actions for Apache Kafka client application development for local and Confluent Cloud

Notifications You must be signed in to change notification settings

ybyzek/kafka-github-actions

Repository files navigation

README

Overview

This demo uses GitHub Actions for developing and valiating Apache Kafka client application, focusing on a Python producer and consumer using Kafka Python Client, plus examples for testing schema compatibility using both Python and Java.

The code defines an GitHub Actions workflow kafka-app with jobs to demonstrate a few capabilities:

image

Instructions

  1. Provision a Kafka cluster, enable Schema Registry and create an API key and secret on Confluent Cloud. Use the quickstart, Confluent Terraform Provider, or ccloud-stack.

  2. In your GitHub account, create Encrypted Secrets for your Confluent Cloud cluster and credentials:

# Confluent Cloud Kafka cluster
CONFLUENT_BOOTSTRAP_SERVERS
CONFLUENT_API_KEY
CONFLUENT_API_SECRET
# Confluent Cloud Schema Registry
CONFLUENT_SCHEMA_REGISTRY_URL
CONFLUENT_BASIC_AUTH_USER_INFO
  1. Fork this repository and push a change to trigger the workflow.

image

Resources