You will be joining the Data Intelligence department within the Ratescreener team composed of 7 people. Among them: Audrey Galli (Product Manager), Hamza Akiour ( Software Engineer), Alba Borilo (Junior Software Engineer).
You will be reporting to Pau Gomez, Engineering Team Lead.
The team focuses on developing and maintaining several applications whose sources are our main crawling system, Rate Screener. We are organized in two subteams, one focused on the scraping process, and the other one focused on the core services and the rest of the applications in our scope.
💻 YOUR SCOPE:
In a context of fast growth, you are a member of the Data Intelligence department, joining the scraping team using specialised software and web crawling tools to extract data from websites to obtain the rates of our clients competitors in different channels. You are in charge of maintaining and managing evolutions of our SaaS solutions to improve our crawling process and being able to react faster to changes in the security of the scraped sites. Your scope covers all stages of development of these web services, functions and standalone services, and involves working together with multiple teams.
🎯 WHAT YOU’LL BE DOING:
Architecture and Implementation
Improve our crawling process providing different tools to adapt fast to the site changes
Analyse and understand the anti-bot systems to improve the scraping results
Participate in the design of software architecture and technical choices.
Maintain the right balance between technical innovation and the need for mature solutions.
Ensure the proper documentation is written and maintained, and provided to the relevant teams.
Demonstrate autonomy in the organization and delivery of the project.
Quality and performance
Ensure high standards in development and quality are met and consistent.
Ensure the right metrics are provided and use the right logging tools to have a good observability of the scraping process
Ensure that technical choices are consistent with the general architecture principles, mature, and will be maintainable in the long term.
Ensure that the technical debt is managed and under control.
Ensure consistency and reusability of the components used.
Ensure optimal results in a high-performance environment
Development & Innovation
Ensure a streamlined, high-quality code delivery (code reviews, pair programming).
Initiate and evaluate technical experimentation and innovation.
Follow up the evolution of crawling technologies.
Participate in the creation of an intelligent process by using innovation and creativity with the help of AI or ML
⭐WHAT YOU’VE GOT:
The job has been tailored for you if: 🦄
You have proven experience working with antibot systems (+2 years)
You have professional experience in the scraping process (+2 years)
You ideally have a proven experience in .NET and C# (+5 years)
You have experience with other technologies used for scrapping purposes (Python, Ruby…)
You are familiar with a distributed microservice architecture and its possible problems
You have previous experience with cloud computing, especially Azure or AWS
You are familiar with the project and software engineering past and present popular agile methodologies: SCRUM.
You have a collaborative way of working
You are demonstrating an ability to adapt and be flexible
You have excellent organizational and time management skills, and you can work independently.
You have the ability to present complex things in a simple manner
You are a problem solver and have sharp analytical skills
You are fluent writing and speaking in English
The icing on the cake: 🍰
You speak French
💜 WHY YOU’LL LOVE US:
Hybrid remote Policy : 2 days in our beautiful offices
Meal Allowance (Endenred : 10€/day, )
Accor Employee Card : Discount on hotel bookings
Health Insurance
Noos & Vendredi, to get involved in civic and committed actions
D-Convention : This is THE event that D-EDGERS are looking forward to
D-Summer Party: Annual meeting to spend a fun and friendly moment with all D-EDGER
🤝 RECRUITMENT PROCESS:
1- Telephone interview with Talent Acquisition Manager
Let’s get to know each other (~45 minutes)
2- First interview with Team Leader and other team member
An opportunity to talk about your background and motivations and to introduce you to the position, our technical ecosystem, and our ambitions. (~60 minutes)
3- Online Technical Test
Test your knowledge/code skills (90 minutes)
4- Technical "pair programming" interview with team members
and welcome to D-EDGE ! :)
Please be aware that we will be asking for work references.
*Please be aware that we will be asking for work references. D-EDGE is an equal-opportunity employer. We do not discriminate based on : race, color, ethnicity, ancestry, national origin, religion, sex, gender, gender identity, gender expression, sexual orientation, age, disability, veteran status, genetic information, marital status, or any legally protected status.
