The Maffia and mediabedrijf are looking for a freelance Data Engineer.

Your Role

Take ownership of the Elasticsearch environment, ensuring it remains healthy, performant and correctly scaled
Own the real-time data pipeline feeding the Traffic Dashboard and safeguard data quality, latency and completeness
Proactively monitor the platform and investigate performance degradation, data gaps and production incidents before they impact users
Design and implement reliable changes with appropriate testing, monitoring and rollback strategies
Further develop the real-time data architecture and APIs, including the integration between Elasticsearch, Databricks and Traffic Dashboard
Build and productionise data workloads in Databricks and Apache Spark
Work with streaming technologies such as Kafka or Azure Event Hubs
Work with the existing TypeScript / JavaScript / Node.js backend where required to troubleshoot and deliver solutions end to end
Improve observability, scalability and maintainability while reducing the operational complexity of the platform

Your Profile

Be a senior engineer comfortable taking independent responsibility for critical production systems
Have strong experience with Elasticsearch, including architecture, performance, scaling and production troubleshooting
Have strong experience with Databricks and Apache Spark
Understand streaming and event-driven data architectures
Have experience with technologies such as Kafka or Azure Event Hubs
Possess an engineering mindset that includes observability, debugging, performance optimisation, failure handling and incident analysis
Be comfortable enough with JavaScript/Node.js to understand, debug and modify an existing backend
Speak Fluently Dutch & English