Data Engineer

TXODDS · Feb 2nd 2018

Apply on StackOverflow Careers

TXODDS

TXODDS is a dynamic player in the Sports data business looking to grow aggressively in the next 18 months. It is seeking a number of developers and engineers to join a team responsible for the operation, development and maintenance of our current and future systems.

The technology platform is currently undergoing a period of reinvestment and the selected candidates will contribute to this. You will be able to work independently on distributed platforms, contribute effectively to team discussions/decisions and clearly communicate impediments when they arise.

Data Engineer

We are looking for an experienced Data Engineer to work on collecting, storing, processing, and analysing our huge sets of data.

Alongside the on-going maintenance of our existing data storage systems, you’ll be developing and implementing upgrades and enhancements to the data and the supporting systems architecture.

We require a candidate who genuinely cares about data, in particular, about its security, safety, availability, quality and consistency.

The candidate should be able to have good time management skills, track their tasks in JIRA, be dependable and reliable in their job, and be a good communicator.

Responsibilities

  • Consolidating, securing and optimising our existing data storage solutions, including data designs and architectures.

  • Monitoring performance and determining suitable application / infrastructure enhancements.

  • Working with operations to ensure the 24/7 availability of data services.

  • Designing and developing resources and frameworks as required by application and business demand.

Required Skills.

  • Expert / DBA level skills with a variety of RDMS including MySQL, Postgres, MSSQL, Oracle etc.

  • Experience of managing Hadoop cluster(s) and associated services.

  • Experience with building stream-processing systems.

  • Strong and low-level Linux (Centos) skills.

  • Experience working with configuration management systems such as Puppet and Ansible.

Bonus Skills

  • Experience with the Cloudera service stack, in particular, Impala, Sqoop and Oozie.

  • Knowledge of public cloud ( AWS, Azure, GCP) technologies and capabilities.

  • Experience with NoSQL databases, such as Cassandra or MongoDB.

  • Knowledge of various ETL techniques and frameworks, such as Flume.

  • Experience with various messaging systems, such as Kafka, ActiveMQ or RabbitMQ.

Apply on StackOverflow Careers