Kafka Developer

Role Overview: We are seeking a skilled Kafka Developer with deep expertise in Apache Kafka and Confluent Kafka platforms. The ideal candidate will have hands-on experience in designing, developing, and troubleshooting Kafka-based data pipelines, along with strong programming skills in Java or Scala. You will work closely with cross-functional teams to ensure reliable and scalable messaging systems across distributed environments. Key Responsibilities: Troubleshoot Kafka messaging issues across producers, consumers, and brokers. Analyze Kafka logs to identify errors, warnings, and performance bottlenecks. Monitor Kafka clusters using tools to track metrics such as consumer lag, throughput, and partition health. Design and implement scalable Kafka-based data pipelines for real-time and batch processing. Collaborate with DevOps and data engineering teams to optimize Kafka configurations and deployments. Ensure high availability and fault tolerance through proper replication and partitioning strategies. Maintain and enhance Kafka topics, consumer groups, and broker configurations. Document Kafka architecture, data flow, and operational procedures.

Created: 2026-03-04