Job offer Software Engineer - Data Crawler en Remoto

Frontiers en España

Software Engineer - Data Crawler

Frontiers España

$50,000 - $60,000

Remote Full-time

Engineering 2-5 años Docker Azure Python

¡I want this Job!

Partnership con Talent Hackers

Job description

Proyecto

This company in the scientific publishing sector, dedicated to developing an open-source platform, is looking for a Senior Python Engineer that helps us to design and build a new generation of tools that will transform open-access publishing.

Rol

You will be responsible for optimizing or even re-designing our own state-of-the-art Artificial Intelligence Assistant.

Additionally, you will work in our content acquisition pipeline and our new solution for data ingestion and web scraping, defining the architecture and implementing the solution in Python following the best practices.

The ideal candidate is an experienced Python developer that enjoys defining an architecture and building solutions from the ground up, and ideally with some background working in Web Scraping.

You develop small, well-crafted components that plug into our data processing pipeline.
You write scalable queries that impact millions of rows while keeping execution time low.
You make improvements to our testing procedure that allow us to move faster and with more confidence.
You collaborate with data scientists and machine learning experts in order to tackle challenging problems in a scalable way.
You work with cutting edge technologies like delta lake to help us provide our users with innovative tools.
You build distributed systems for web scraping, data processing

..

Requisitos

......

Minimum of 3 years in a similar role.
Proficient in Python
Awareness of software design patterns, clean code principles, and the importance of testing.
Experience with web APIs.
Understanding of cloud services like Azure, Google Cloud or similar.
Experience in Docker or similar container technologies.
Comfortable working with Agile methodology.
Experience in design and develop of scalable data crawlers to extract large volumes of data from the Web.
Experience with data crawling techniques and tools (Scrapy, Selenium, Requests, Beautiful Soup)
Experience with large-scale systems, software for automation and data-driven apps.
Good English skills.
Nice to have: Experience with Data mining and Text mining techniques.
Nice to have: Experience with big data processing frameworks (Spark).

Qué ofrece

......

Really senior colleagues in all fields of IT, you will learn new things every single day.
Exciting projects, you’ll work on different applications and features throughout the year.
25 annual leave days + 4 well-being days.
Participation in the annual company bonus scheme.
Flexible working framework.
Remote working across Spain.
On-off bonus to set up your workspace at home.
If you ever come to the office, we have top-notch facilities.
Extensive learning opportunities.
A monthly social Happy Hour to share beers and tapas with colleagues.