Bloomon · Jul 14th 2017
As a Data engineer you are in a unique position of enabling the entire company to make insightful, data-driven decisions. Thanks to your ETL infrastructure, pipelines that write data from any input to a centralized data warehouse can easily be developed and maintained. This data is then used to create analysis by your fellow colleagues in the business intelligence team. Next to that you would be responsible for identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
We support our software developers, data analysts and data scientists on data initiatives aiming to ensure consistent optimal data delivery architecture throughout bloomon's ongoing projects. We are a team of self-directed data lovers and are proud of being able to support the data needs of multiple teams, systems and products within all five countries bloomon operates. Our team constantly looks into opportunities for optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives. Best part of it for you - joining us would mean that you will be playing the main role into deciding on the data architecture.
What do we expect from you?
Experience with Apache beam or other frameworks for data processing workflows
Experience with Google Dataflow or other cloud data processing services (e.g. on AWS)
Experience with unit and behavioral testing
Experience visualizing and documenting architectures, e.g. a flow diagram describing how data flows from an input to ETL pipelines to a data warehouse
Great understanding of CI/CD flows, containerization, and related best practices
Understanding of horizontal scalability and throughput of databases
Proactive and “can-do” mentality
Bonuses but not required:
Experience with BI visualization tools such as Superset
Experience with micro-services and kubernetes