Your Mission
We are looking for a talented data engineer to helps us improve our data platform. You will be part of an international team that operates data pipelines which process tens of TBs of data and develops distributed systems that ingest and structure billions of events per day in real-time.You will work closely with our backend developers and ML scientists to facilitate access to our datasets in an efficient and simple manner. If you understand how databases and data processing engines work and like to optimize your services for throughput and latency, you will fit right in.
Your Role
- Build and maintain scalable data pipelines that can deal with tens of TBs of data
- Build and maintain low-latency distributed systems that can deal with several billion of events per day with peaks over 100k events per second
- You will be accountable for what you build, you get to choose your technology for your services but have to maintain it and monitor it
- You continuously research and choose the best tech stack for our data solutions
- You can work independently and take a user story to fruition with minimal guidance
Technologies we are using
Cassandra, HDFS, Hive, Presto, Apache Spark, Druid, Zookeeper, Kafka, Redis, Java, Python, Go
Benefits
- Competitive salary (above industry standards) and a relocation package when required
- Fast-learning environment – whether you are self-taught or have completed your PhD, it does not matter to us, as long as you are driven by curiosity and want to get things done
- Opportunity to work with the state of the art technologies and learning from talented peers by sharing your expertise through our DevFriday events
- Excellent career development opportunities – we want to strengthen your strengths and grow with us (and we mean it)
- Flat hierarchies, open communication and easy-going personal interaction
- Multitude of ways to relax during work, may it be playing ping pong or console gaming, we make sure you’re not just stuck to your machines
- Daily breakfast, almost unlimited supply of fruits and beverages, whether it be coffees, mate or a drink of your choice ;)
- Young, dynamic and international team
- Nice designer office in Prenzlauer Berg