Audiense enriches 2 billion contacts a day generating more than 200TB of data. It’s a major challenge to optimize the collection, storage and accessibility of all the data to allow our customers to base their business decisions on consumer insights.
You will join a multi-skilled team that knows how to deliver a great user experience, based on scalable architecture. We need fearless innovators who are able to understand complex challenges and provide quality integrated solutions.
We use a mixture of agile methodologies that allows us to iterate very quickly. We deploy to production many times a day thanks to a totally automated workflow. This allows us to quickly see the fruits of our labour in production.
The ideal Data Engineer will design scalable architectures that can cope with the collection and storage of our heterogeneous datasets. He/She will determine the best technologies and formats for our derived data, and will work with our analysts/data scientists to ease their data mining needs. The right person for this role will enjoy developing robust code that scales on live data.
Responsibilities
- Work within a multidisciplinary team, helping with the definition and implementation of the Audiense data pipeline, to retrieve, preprocess and store large amounts of data, in a scalable manner.
- Design and manage large databases and data lake solutions that will help us to extract insights from our datasets.
- Be proactive in identifying interesting alternative datasets or new data applications to consider.
Requirements
- Eager to learn new things, good attitude towards solving complex problems. Good team player.
- Good understanding of distributed systems design and common pitfalls.
- Extensive experience with Big Data application development using dynamic languages (like Python) or JVM static languages (like Java or Scala).
- Several years of experience designing and developing applications that interact with relational databases (Mysql, Postgresql), NoSQL databases (MongoDB) and/or search technologies (Lucene, Solr, Elasticsearch)
- Strong SQL skills and relational database design.
- Has used big data batch processing tools in production (Spark, Mapreduce)
- Good knowledge of big data SQL technologies (Hive, SparkSQL, Presto)
Additionally, we expect you to have a certain level of experience with some of the following topics:
- Streaming systems (Kafka, Kinesis)
- Definition and implementation of batch ETL workflows that extract data from different origins, transform it and insert it into a Data Warehouse.
- Business Intelligence and reporting
- Stream processing/real time analytics tools (Spark Streaming, Apache Storm)
- Graph analytics tools (Giraph, GraphX, networkx)
- Data collection and aggregation tools (Flume, Logstash, Fluentd…)
- Data formats such as Avro, Parquet, ORC.
- Data cleansing and preprocessing
Nice to Have
The following points are not required, but are a plus:
- Experience working with git. Typical Github development workflow (Issues, PRs, etc)
- AWS Cloud ecosystem
- Machine Learning and statistical methods for data analysis.
- Microservice based architectures (Docker, Mesos, Kubernetes)
- Graph oriented databases (Titan, Neo4J)
- Functional programming
- Adequate communication skills in English
We offer:
- Competitive salary
- Safari books (elearning)
- 30 calendar days holiday, plus usual public holidays and a free day for your birthday
- Great office in Cordova with free drinks/tea/coffee and fresh fruit
- Co-working voucher
- Choice of whether to use Mac or PC
- Frequent team lunches and events
- Quarterly dev meetups in Cordova
Remote work welcome:
Communication technologies are pretty good nowadays. There’s no reason you should have to uproot your personal life when you can do your job from home. We’ll set you up wherever you are so long as you’ve got a quiet place to work, a good Internet connection, and we can legally pay you where you live.
If you have rejected offers from great companies because they don’t believe in the power of Remote Teams then Audiense is the place for you.
That said, if you come to Cordova you will live in a beautiful, mid-sized city with a competitive salary and will enjoy free soft drinks, daily fresh fruit, coffee, regular staff nights out and #juevesdepizza. It’s a very exciting time here and we’d love for you to join us!
