Want to be a Hero? - Join one of the leading global online food ordering and delivery platforms!
We are looking for a Senior Data Engineer (f/m/d) to help us deliver an amazing search experience in more than 45 countries and 25 languages. We power 50M+ searches per day across 4 continents, with local Elasticsearch clusters on top of Kubernetes. You will be helping the team deliver high-quality results by using state of the art technology in Information Retrieval and Machine Learning.
If you’re an experienced Data Engineer, a creative problem solver who is eager to deliver solutions and hungry for a new adventure, an international workplace is waiting for you in the heart of Berlin!
Your mission:
Develop scalable solutions which power the Delivery Hero Search engine
Design and maintain fault-tolerant ETL pipelines with BigQuery and Spark
Stay up to date with latest developments in data processing, and implement novel approaches
Work with structured and semi-structured data from different data sources (BigQuery, PostgreSQL, Spark and many more)
Contribute and make an impact in a global, fast-moving tech organization
Your heroic skills
Manipulating dataframes using pandas, Spark, or similar libraries
Writing SQL in BigQuery, Redshift, or other data warehouses
Java, Scala, or Python
Writing clean & readable code that follows best practices in software engineering
Creating testable & idempotent ETL jobs that can be relied on
Improving upon the batch and streaming architectures
A great team player and a pragmatic thinker
Fluency in English
Nice to have
Apache Airflow, Luigi, or other DAG schedulers
Terraform, Docker, Kubernetes, Helm, or other Infrastructure-as-Code technologies
Jupyter, Zeppelin, or other notebook interfaces
Elasticsearch, Solr, Lucene, or other search engines