Crawl Engineer

Graft is delighted to announce our new partnership with the leader in enterprise collaboration data based out of London and the USA. With a unique mission they are now on the lookout for their first Grafter…

About the client

Our client is passionate about pushing the boundaries of what’s possible and are dedicated to changing how Compliance, eDiscovery, and Investigations organizations interact with the web. They have created and implemented the technology stack required to capture and archive the modern web with a sophisticated crawler at its core.

To achieve their vision, their mission is to continually develop and evolve the platform to enable companies to discover the truth in what’s happening in their workplace. Their applications integrate with the next generation of data sources allowing companies to understand and control their dynamic data and respond to incidents such as litigation, investigations, and audits effectively.

The role

Our client is looking for a talented Web Crawl Engineer to join their expanding team. This role is at the heart of crawler operations: to create, configure and manage crawls, process archived data, and interact with customers.

The successful candidate will be responsible for developing and maintaining web crawling tools to gather and analyse data from various websites. The candidate will work closely with the Crawl Quality team to ensure that the data collected is accurate and complete, remediating any issues that are identified.

You will develop frameworks for automating and maintaining the constant flow of data from multiple sources. You will have exposure to many different web technologies to reverse engineer the design and implementation to support efficient and effective web archiving. As a Crawl Engineer, you will be expected to support customers operational requirements and have good interpersonal skills.

Benefits

• Competitive basic salary DOE
• Flexible working hours – This isn’t your typical 9-to-5 job. Most employees work remotely, so you can spend less time commuting and more time doing what you love.
• Sick leave- Your compensation package includes paid sick leave, so you can keep yourself happy and healthy.

• 25 days holiday (Plus 4 ‘summer Friday’ afternoons off) Flexible paid time off and massive respect for a proper life-giving vacation, so you can take time off and refuel.
• Auto enrolment onto the company pension etc

• City Centre Office facilities at ‘Spaces’ in Leeds where the (local) team collaborates regularly.

Day to Day/Responsibilities

• Develop and maintain web crawling tools to collect data from various websites.
• Work with our customers to understand their requirements and issues
• Collaborate with the Crawl QA team to ensure accuracy and completeness.
• Monitor and remediate any issues with the web crawling process.
• Stay up-to-date with the latest web crawling technologies and techniques.
• Maintain documentation of web crawling processes and data sources.
• Maintaining and enhancing existing software (both internal products and our open source projects).
• Daily operation and fulfilment of time sensitive requests from customers.
• Attend and contribute to regular customer calls.

Must have skills/experience

• 1 year of professional experience in a software development or production environment.
• Experience in Python and Javascript or other programming/scripting languages (Selenium).
• Demonstrated ability to write quality code.
• Demonstrated ability to understand and work with other people’s code.
• Demonstrated ability to solve technical problems.
• Knowledge of web technologies such as HTML, CSS, and JavaScript.
• Ability to diagnose technical problems effectively.
• Ability to work in a start-up environment.
• Ability to document software rigorously.
• Excellent communication and collaboration skills.
• Ability to work remotely and with a geographically dispersed team.

Personal bits

• The ideal candidate will be self-motivated, have strong problem-solving skills, and a passion for data.
• Strong interpersonal skills.

**You must have the right to work in the UK

Find out more –

sophie@grafttalent.co.uk

melanie@grafttalent.co.uk

Photograph by Christopher Gower on Unsplash.