Apache Kafka Administrator

Kafka Admin • Primary skills:Technology->Cloud Platform->AWS Data Analytics->Amazon Managed Streaming for Apache Kafka Minimum Qualifications: • Bachelor’s degree (or equivalent) in Engineering/Computer Science/IT (BTech/BE/MCA/MSc or similar). • 3–5 years of overall experience with at least 3 years in Kafka administration and operations. • Hands-on exerience administering Apache Kafka clusters, including configuration, scaling, and upgrades. • Working knowledge of Confluent platform components and operational practices. • Strong troubleshooting skills in distributed systems and experience handling production support and incident management. • Familiarity with Linux fundamentals, networking basics, and log/metric-based monitoring for platform health. Preferred Qualifications: • Experience operating Confluent Platform in enterprise environments, including Schema Registry and Kafka Connect administration. • Proven ability to tune Kafka performance (broker configs, partition strategy, replication, retention) for high-throughput workloads. • Experience implementing security best practices (ACLs, authentication/authorization) and aligning with governance requirements. • Exposure to automation and scripting to streamline Kafka operations and reduce manual effort. • Strong collaboration skills to guide producer/consumer teams on onboarding, standards, and operational readiness. Good to have skills: Kafka Connect, Schema Registry, Prometheus, Grafana Key Responsibilities: • Administer and support Kafka clusters, ensuring high availability, reliability, and performance across environments. • Perform Kafka broker provisioning, configuration, upgrades, patching, and capacity planning aligned to platform standards. • Manage topics, partitions, replication factors, retention policies, quotas, and ACLs based on application needs and governance guidelines. • Monitor cluster health and performance, analyze metrics/logs, and proactively address bottlenecks (latency, throughput, ISR issues). • Troubleshoot production incidents, perform root cause analysis, and drive corrective and preventive actions. • Support Confluent components as applicable (e.g., Schema Registry, Kafka Connect) and ensure smooth integration with client teams. • Implement and maintain security controls including authentication/authorization and secure configurations for data-in-motion. • Automate operational tasks and standardize runbooks, alerts, and operational procedures to improve platform efficiency. • Collaborate with application teams on onboarding, best practices, and performance tuning for producers/consumers. • Maintain documentation for architecture, configurations, operational processes, and change management activities.