Data Engineer

ActiveState Software · Aug 16th 2019

Apply on StackOverflow Careers

Please note that we have currently filled these positions however we will continue to review applications. If we feel you might be a fit for a different opening we will reach out to discuss with you.

ActiveState Platform - made by developers for developers! We are reinventing build engineering with an on-demand SaaS Platform and CLI tool that lets developers automate the building of any runtime environment using any open source language ecosystem on any platform. In Beta right now, we support Python and Perl and we're hiring to add more languages and packages! We’re building an ambitious language distribution platform so that no engineer ever has to suffer dependency hell again, and we need your help to do it!

This position is open to full-time telecommuters anywhere in North America. You can also choose to work from our headquarters in beautiful Vancouver, BC.

This position is open to both junior (including fresh out of school) and senior applicants. The salary for this position will be commensurate with your experience.

What You’ll be Doing

As a Data Engineer, you will create and maintain a data processing pipeline to feed our automated build systems with information about various open source languages and package updates. This work includes automating processing of open source package update feeds from language repositories including PyPI (Python), CPAN (Perl), Maven (Java), NPM (JavaScript), RubyGems. You will also be creating web crawlers for eco-systems without well defined APIs.

Our day to day work practices are centered around GitHub, pull requests, code review, CI for testing, and agile development with Pivotal Tracker as our project management tool. We’re always looking to improve our practices and we expect you to help us to do so.

We’re a polyglot company building our system using Golang, Python, Elm, Javascript, Perl, Docker, Kubernetes, DCOS, CircleCI, and other modern tools. Quality is as important as speed. We’re building for the long run, so you’ll need to enjoy writing tests and documentation too.

Our team is scattered around the US and Canada, so we coordinate with each other and the rest of the company using Slack for chat, Highfive for video calls and screen sharing, Pivotal Tracker, and Google Drive.

We like to use open source software whenever possible, and we also like to contribute back to the open source ecosystem. We embrace open sourcing both libraries and tools developed in-house as long as those are not mission-critical code.

What’s in it for You

  • Working for a stable and growing company that offers the environment and personal growth potential of a start-up.

  • The chance to work with a smart, passionate team of people.

  • The chance to work on a project that will change the work lives of developers around the world.

  • Competitive salary, bonus, and stock option plan.

  • Comprehensive benefits package and health/wellness credit program.


  • Experience creating and maintaining complex software systems along with the ability to design non-trivial applications and components from scratch.

  • The ability to write clean, well-tested code with clear documentation.

  • Deep experience with at least one programming language, and shallow experience with several.

  • Excellent written and spoken skills, both technical and non-technical. You’ll need to work closely with your developer teammates, as well as be able to have coherent conversations with people from QA, sales, marketing, and other parts of the company.

  • A willingness to engage in the process of defining our work through conversations with product management, other engineering teams, and the rest of the company.

  • The ability to help others on the team become better at their jobs through mentoring, thoughtful code reviews, and generally being a team player.


If you have experience with any of the following please make sure to highlight it in your cover letter:

  • Data processing technologies, including but not limited to Kafka, Hadoop, Hive, Presto, Luigi, Airflow, Storm, etc.

  • Agile processes, including breaking large projects up into smaller stories, estimation, working in branches (GitHub Flow), code review, and CI.

  • Golang code, especially large code bases.

  • Microservices and message queues.

  • Docker and Kubernetes.

  • Perl, Python, Tcl, or Ruby, especially an understanding of their respective language communities and toolchains.

Working at ActiveState

ActiveState has a collaborative, respectful, and professional culture. We’re all about working together to find the best solutions, and making sure that the experience of doing so is positive for everyone involved. There is a commitment from the CEO on down to making work at ActiveState a great experience for all of us.

Our company is a team of 40+ and growing, with 2/3rds of the positions in technical roles including software development and QA. We maintain a set of core, overlapping hours, but we’re flexible with specific start and end times and are understanding about appointments and life events.

Our vision is to have an ActiveState solution on every device on every planet, so we certainly don’t lack for ambition! But even though we’re ambitious we don’t expect work to become your life. We know you will do your best work in a positive environment free from death marches.

Try out our Platform for free and see for yourself what we are doing!

Apply on StackOverflow Careers