பணி விளக்கம்

Role overview

Mindrift is seeking experienced Python data scraping engineers to contribute to the Tendem project, where specialist human input is combined with AI-driven support to build dependable data extraction workflows. In this position, you will act as an AI Pilot: Tendem Agents take care of repetitive steps, while you apply judgment, technical expertise, and quality checks to produce accurate, useful outputs.

This is a part-time, remote freelance opportunity suited to technical professionals who already have practical experience in web scraping, information extraction, and data processing.

About the platform

Mindrift’s platform brings together domain experts and AI projects from leading technology innovators. Its goal is to expand the possibilities of generative AI by connecting it with real-world expertise from around the world.

Project and work style

This freelance assignment is tied to a Tendem project. As a Python Data Scraping Engineer, your focus will be on technically demanding extraction and processing tasks. You will use tools provided by the team, including Apify and OpenRouter, and may also rely on your own practical approaches to complete the work effectively.

Key responsibilities

Manage complete data extraction processes for complicated websites, making sure the resulting datasets are thorough, accurate, and reliably delivered in structured form.
Use internal tools such as Apify and OpenRouter, together with custom-built workflows, to speed up collection, validation, and execution while still meeting the project’s requirements.
Work successfully with dynamic and interactive websites, adjusting methods for JavaScript-rendered pages and sites whose behavior changes over time.
Apply strict quality controls through validation, cross-checking across sources, formatting compliance, and systematic review before final delivery.
Handle larger scraping jobs through batching or parallel processing, track failures, and keep workflows stable even when site structures change slightly.

Compensation

For this project, contributors may earn up to 37 USD per hour equivalent, depending on contribution level and pace. Pay can differ across projects on the platform based on scope, complexity, and the expertise required.

How to get started

Interested candidates can apply, complete the qualification process, and then take on projects that fit their technical strengths and schedule. The work may range from coding and automation to improving AI outputs, with the opportunity to support real-world AI applications.

Requirements

At least 3 years of relevant experience in data engineering, web scraping, automation, or software development is required.
A bachelor’s or master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical discipline is considered an advantage.
Strong practical experience with Python scraping tools such as BeautifulSoup, Selenium, or similar, including dynamic content, AJAX, infinite scroll, and API access through proxies.
Ability to extract information from complex page structures, including nested hierarchies, archived pages, and inconsistent HTML.
Strong capability in cleaning, standardizing, and validating data, with experience delivering outputs such as CSV, JSON, or Google Sheets.
Hands-on familiarity with LLMs and AI frameworks for automation support and problem solving.
High attention to detail and a strong commitment to data accuracy.
Independent, self-managed work style with the ability to troubleshoot issues on your own.
A GitHub profile link is a plus.
English proficiency at upper-intermediate level (B2) or higher is required.

Benefits

Work remotely and manage your own schedule, needing only a laptop and a stable internet connection.
Build experience in a hybrid environment where human expertise works alongside AI agents, developing a valuable skill set in a fast-growing field.
Be eligible for performance-based bonus programs that recognize strong quality and consistent delivery.

Freelance Data Scraping Engineer (Python)