Kafka Developer

About the role

Watershed Consulting is looking for a skilled Kafka Developer to design, build, and maintain real‑time data streaming solutions. You will work closely with software engineering, data science, and DevOps teams to deliver high‑throughput, low‑latency pipelines using Apache Kafka.

Key responsibilities

• Design, develop, and deploy robust Kafka producers, consumers, and streaming applications.
• Build and maintain scalable pipelines with Kafka Connect, Kafka Streams, or ksqlDB.
• Configure, monitor, and tune Kafka clusters for performance, high availability, and scalability.
• Integrate Kafka with microservices, enterprise systems, SQL/NoSQL databases, and cloud storage platforms.
• Implement security controls (SSL/TLS, SASL, ACLs) and manage schemas via Schema Registry.
• Monitor system health, diagnose bottlenecks, and resolve production issues in distributed environments.
• Collaborate with cross‑functional teams to promote event‑driven architecture best practices.

Required profile

• Bachelor’s degree in Computer Science, Engineering or equivalent experience.
• Proven production experience with Java and Spring Boot.
• Hands‑on experience with Apache Kafka, Kafka Connect, Kafka Streams or ksqlDB, and Schema Registry.
• Experience securing Kafka clusters (SSL/TLS, SASL, ACLs) and managing schemas.
• Ability to design and operate high‑throughput, low‑latency distributed systems.
• Experience integrating Kafka with SQL/NoSQL databases and cloud storage (e.g., Amazon S3).
• Strong troubleshooting, performance tuning, and monitoring skills.

Required skills

• Apache Kafka
• Kafka Connect
• Kafka Streams
• ksqlDB
• Schema Registry
• Java
• Spring Boot
• Microservices
• Docker
• Kubernetes
• AWS
• Amazon S3
• SQL
• NoSQL
• PostgreSQL
• MongoDB
• Git
• CI/CD
• SSL/TLS
• SASL
• ACLs