We’re in the process of deploying the NStack PaaS on top of
Kubernetes and many Google Cloud services, and are looking for a DevOps
engineer to join us in our London office to help primarily on the data
engineering and deployment side.
This will be a flexible role with a lot of potential. You might be
orchestrating our CI/CD system to run large sample data processing
workflows; optimising container build and distribution workflows;
designing advanced service routing between NStack’s modular components;
or writing new plugins to integrate NStack with different data-stores.
You’ll also be helping to improve our automated deployment, management,
and monitoring of customer workloads on the NStack hosted platform.
The core NStack platform runs on the JVM using many tools from the
Apache Big Data stack, along with large amounts of Python. We’re also
heavy users of Linux containerisation, and NStack workflows are
distributed on Kubernetes. On the infrastructure side, we try to stay as
cloud-agnostic as possible, and can run on any IaaS, but are focusing
on our own hosted PaaS on GCloud.
Prior Kubernetes experience is desirable but not required; however,
you need to be ready and willing to learn Kubernetes as an administrator
and operator. Ideally you’re also interested in big data, including
data engineering and deployment, and familiar with tools in that space,
e.g. Hadoop, Spark, Kafka, NiFi, etc.. Knowledge of the JVM and
deploying it to run big data workloads is highly advantageous. No matter
your experience, you should definitely be interesting in developing
best practices for running highly available and highly performant data
services, and excited to pick up the new technologies and skills to do
so.
You should like the idea of releasing to real customers regularly,
and prioritise getting a great product into users’ hands for feedback
and iteration. This is an ambitious project, and you will be working
with a talented team of domain experts, data scientists, and backend
engineers, and will have extensive scope to build and architect the
deployment yourself, and grow the team in the future.
Please note, the role is onsite in our Central London office or possibly remote within the EU for the right candidate.