Senior Data Platform Engineer – AWS & Streaming (f/m/x)

Join a modern software company operating a cloud-based data platform and take responsibility for administering, monitoring, and optimizing a big data environment in AWS. You will work with cutting-edge technologies like Kafka, Flink, NiFi, and DynamoDB while ensuring high availability through 3rd-level support and on-call duty.

Your responsibilities:

• Administer, monitor, and optimize a big data platform in the AWS cloud
• Manage and maintain Cloudera on-cloud PaaS services and AWS-native technologies (e.g., Kafka, Flink, NiFi, Iceberg Tables, DynamoDB)
• Deploy and automate infrastructure in AWS using Terraform and ArgoCD
• Perform updates, upgrades, and incident management for platform components
• Advise developers on selecting suitable services for business use cases
• Provide 3rd-level support, including error analysis, troubleshooting, and on-call duty to ensure system availability
• Optimize workloads (e.g., Flink job memory management, Impala/Trino query tuning)
• Evaluate and implement cloud-native services in line with system architecture

Your profile:

• Strong Linux and Hadoop ecosystem knowledge (HDFS, Zookeeper, Yarn, Impala, Spark, Kafka)
• Experience with automation tools like Terraform
• Programming skills in Spark, Python, and ideally knowledge of Cloudera services (e.g., Hue, Knox, Ranger RAZ, Streams Messaging Manager, NiFi, Kudu)
• Experience with on-call duty, troubleshooting, and rolling restarts is beneficial
• Kubernetes experience is a strong advantage
• Team-player mindset

What to expect:

• Hybrid working model with flexible working hours
• Personal training and development opportunities
• Work with modern cloud and big data technologies in a collaborative environment
• Meal allowance, free drinks, and fruit
• Health initiatives and company pension benefits
• Team events and professional exchange in engineering communities
• Good transport connections, parking options, and relocation support where applicable