Kafka in Kubernetes: The Strimzi Operator Explained

Learn about Strimzi, the Kubernetes operator for Apache Kafka! In this video, we'll explore how Strimzi simplifies Kafka deployment, management, and scaling on K8s. Topics covered: Strimzi architecture, Installing Strimzi, Creating Kafka clusters, Topic management, and more!. The key components supported by strimzi operator are kafka cluster, zookeeper cluster, kafka KRaft, Kafka connect, Kafka bridge, Kafka metrics exporter, MirrorMaker.
‪@configjavatech‬
#Strimzi #ApacheKafka #Kubernetes #KafkaOnK8s
Commands
-------------------
steps for deploying the strimzi operator
----------------------------------------
kubectl create namespace kafka
kubectl create -f "strimzi.io/ins..." -n kafka
Utility To verify kafka cluster
----------------------------------------------
github.com/sch...
Command to execute port-forward specific to kafka cluster in namespace kafka with kekspose pod, started with port 50000
------------------------------------------------------------------------------------------------------
kekspose-0.2.0-windows-amd64.exe -c kafka-cluster-2 -n kafka -k kekspose -p 50000
Kafka Raft Empemeral Yaml Fiile
-----------------------------------------------
apiVersion: kafka.strimzi.io/v1beta2
kind: KafkaNodePool
metadata:
name: kafka-cluster-2-node-pool
labels:
strimzi.io/cluster: kafka-cluster-2
spec:
replicas: 3
roles:
- broker
- controller
storage:
type: ephemeral
---
apiVersion: kafka.strimzi.io/v1beta2
kind: Kafka
metadata:
name: kafka-cluster-2
annotations:
strimzi.io/node-pools: enabled
strimzi.io/kraft: enabled
spec:
kafka:
version: 3.7.0
metadataVersion: 3.7-IV4
listeners:
- name: plain
port: 9092
type: internal
tls: false
- name: tls
port: 9093
type: internal
tls: true
- name: external
port: 9199
type: nodeport
tls: false
config:
offsets.topic.replication.factor: 3
transaction.state.log.replication.factor: 3
transaction.state.log.min.isr: 2
default.replication.factor: 3
min.insync.replicas: 2
entityOperator:
topicOperator: {}
userOperator: {}

[@ogunniransiji2686]

Can you try an ETL with msk ?

[@configjavatech]

I will try