We’re looking for a motivated and driven (Senior) Data Engineer (m/f/d) who will help us shape our team, drive the company to the next level, and have the most direct influence on our success.
Your Tasks – Paint the world green
- You will be responsible for building a data platform for running big data workloads at scale, collecting and combining data from various sources and help data consumers to consume data in our data lake.
- Work on location-based data to support our existing products and departments in delivering customer-centered services and solutions
- You manage the Customer Journey: Full data integration of webtracking-data with master data to understand customer and user behavior
- You are responsible for establishing a Data Catalogue: registering and documenting ingested, stored and processed data
- You improve the Tool-Layer on top of existing Messaging and Ingesting Service (e.g. generic data on/offloading in/from Kafka; Kafka topic admin-tools)
Your Profile – Ready to hop on board
- 5+ years of experience as Data Engineer or Backend Developer
- Solid expertise in at least one programming language (preferably Scala, Java or Python)
- Excellent SQL and data management knowledge
- Experience with big data technologies (Spark, Redshift, Hadoop)
- Practical experience with Amazon Web Services
- Experience with Kafka or similar technologies
- Nice to have:
- Previous experience in the design and implementation of complex data pipelines (Luigi, Airflow, AWS Data Pipeline)
- Knowledge of Python data science stack (Pandas, Scikit-learn, Numpy, Keras, etc)
- Familiarity with machine learning
- Experience with Docker