What you’ll be doing

As a Data Engineer you'll work closely with machine learning engineers and data scientists, designing and building new data pipelines and processes to enable re:infer to expand its natural language processing platform to as many sources of data as possible. With new kinds of data streams coming in all the time, you’ll be working all the way from the initial manual processing and upload to the fully automated, distributed, productionised pipeline.

We’re looking for someone who’s really into programming, who can learn quickly and adapt to changing requirements. Beyond that you need to be kind, courteous, motivated, self-starting, honest and responsible.

Skills and experience with (sorted from “important” to “nice-to-have”):

  • Python data processing

  • Linux

  • Interfacing with third-party REST APIs

  • Understanding of different database systems

  • Pandas, numpy, scipy, sklearn

  • Git

Our Stack

The backend is a mixture of Python and Rust and consists of many containerized stateless microservices (and a few stateful ones), some interactive, some batch, with many running heavy numerical loads. Everything gets deployed on Kubernetes in Google Cloud Platform. We use RethinkDB and Elasticsearch for storage and indexing.

The team

re:infer was founded by Machine Learning researchers, engineers and entrepreneurs from UCL and Google. We’re a small team of technologists (~ 10 people) motivated by solving the very hard problem of getting machines to understand conversations.

We work in two-week sprints following the best bits of the Agile approach to software development. Our employees benefit from a relaxed, social atmosphere in which they’re free to make use of our open-plan office to discuss ideas, or put their headphones in and find a quiet corner as and when they require. We support flexible working hours and have a generous holiday policy and company pension. Everyone gets their own top-spec laptop and whatever office hardware works for them.

The business

re:infer makes human conversations understood and actionable to machines. We allow our (often non-technical) users to create, manage and deploy state-of-the-art machine learning algorithms against high volume streams of conversational data. Our mission is to make all natural language communication structured, measurable and easily actionable.

re:infer is a B2B SaaS machine learning and analytics platform controlled and monitored via a web UI. We are an early stage startup with significant funding and growing very fast. It is an opportunity to make a major impact at an early stage, to tackle big problems and work towards artificial intelligence with a true grasp of human language.

re:infer’s offices are at Mindspace Aldgate, in the heart of East London.

Salary range £40,000 — 55,000

Dependent on experience