Platform Engineer

Cloudera, Elastic Stack & DataikuPosition OverviewWe are looking for an experienced Platform Engineer to support, maintain and further develop our Cloudera, Elastic Stack and Dataiku platform environment. The role combines platform operations, solution development, automation and user support. You will work closely with data engineers, data scientists, analysts and business stakeholders to deliver stable, scalable and efficient data and analytics solutions.

Key Responsibilities• Support, maintain and optimise Cloudera, Elastic Stack and Dataiku platforms • Design and develop data pipelines, workflows, dashboards and platform integrations • Build and support real-time streaming solutions using Apache Kafka • Develop custom scripts, plugins and integrations using Python, Scala and REST APIs • Design and automate ETL and data ingestion processes using tools such as Apache NiFi and Logstash • Create Kibana dashboards, reports, queries and search solutions • Support the deployment and operationalisation of machine learning models in Dataiku • Automate platform deployments and operations using Ansible, Terraform or similar tools • Implement CI/CD pipelines using GitHub Actions, Jenkins or comparable technologies • Troubleshoot platform, workflow and integration issues • Create reusable scripts, templates, libraries and technical documentation • Provide guidance, training and platform support to users and internal teams • Support occasional weekend or public holiday activities related to system changes or testing