We’re in the process of deploying the NStack PaaS on top of Kubernetes and many Google Cloud services, and are looking for a DevOps engineer to join us in our London office to help primarily on the data engineering and deployment side.
This will be a flexible role with a lot of potential. You might be orchestrating our CI/CD system to run large sample data processing workflows; optimising container build and distribution workflows; designing advanced service routing between NStack’s modular components; or writing new plugins to integrate NStack with different data-stores. You’ll also be helping to improve our automated deployment, management, and monitoring of customer workloads on the NStack hosted platform.
The core NStack platform runs on the JVM using many tools from the Apache Big Data stack, along with large amounts of Python. We’re also heavy users of Linux containerisation, and NStack workflows are distributed on Kubernetes. On the infrastructure side, we try to stay as cloud-agnostic as possible, and can run on any IaaS, but are focusing on our own hosted PaaS on GCloud.
Prior Kubernetes experience is desirable but not required; however, you need to be ready and willing to learn Kubernetes as an administrator and operator. Ideally you’re also interested in big data, including data engineering and deployment, and familiar with tools in that space, e.g. Hadoop, Spark, Kafka, NiFi, etc.. Knowledge of the JVM and deploying it to run big data workloads is highly advantageous. No matter your experience, you should definitely be interesting in developing best practices for running highly available and highly performant data services, and excited to pick up the new technologies and skills to do so.
You should like the idea of releasing to real customers regularly, and prioritise getting a great product into users’ hands for feedback and iteration. This is an ambitious project, and you will be working with a talented team of domain experts, data scientists, and backend engineers, and will have extensive scope to build and architect the deployment yourself, and grow the team in the future.
Please note, the role is onsite in our Central London office or possibly remote within the EU for the right candidate.