Intern - Data Scraping Engineer
Location: Mumbai
Employment Type: Full-Time
Experience Required: 0–1 year (freshers welcome)
⸻
Job Summary
We are looking for a motivated and detail-oriented Junior Data Scraping Engineer to join our data engineering team. The ideal candidate should have a strong foundation in Python and an interest in web scraping and automation. You will work on building automated scripts to extract structured and unstructured data from websites using Selenium and other scraping tools. This role is an excellent opportunity to learn and grow in real-world data engineering pipelines and large-scale data systems.
⸻
Key Responsibilities
• Develop, maintain, and optimize Selenium-based web scrapers to extract data from websites.
• Work with multiple scraping strategies (selectors, XPaths, headless browsers).
• Handle challenges like pagination, dynamic content, CAPTCHAs, and request throttling.
• Clean and transform extracted data into structured formats (CSV/JSON/Data Frames).
• Store scraped data into databases or cloud storage systems as required.
• Monitor scraping jobs, identify failures, and troubleshoot issues.
• Collaborate with the Data Engineering team to integrate scraped data into internal pipelines.
• Maintain detailed documentation for scripts, processes, and data sources.
• Continuously learn and adopt new tools and techniques in web automation and scraping.
⸻
Required Skills
• Strong understanding of Python programming.
• Practical experience with Selenium (Chromed River, Firefox Driver, or headless mode).
• Knowledge of HTML, CSS selectors, and XPath for locating elements.
• Basic understanding of REST API requests, JSON, and HTTP methods.
• Ability to write clean, reusable, and well-structured code.
• Familiarity with Git for version control.
• Basic understanding of Linux commands and Python virtual environments.
⸻
Good To Have (Not Mandatory)
• Experience handling CAPTCHAs (e.g., 2Captcha, Anti-Captcha).
• Knowledge of Requests or Scrapy.
• Understanding of SQL (MySQL / PostgreSQL).
• Familiarity with Jenkins / Cron for scheduled automation.
• Exposure to cloud platforms (AWS / GCP / Azure).
⸻
Soft Skills
• Strong problem-solving attitude.
• Curiosity to experiment, test, and improve solutions.
• Ability to work collaboratively with engineers and data teams.
• Clear communication and willingness to learn.
⸻
Who Should Apply?
• Fresh graduates or candidates with up to 1 year experience.
• Anyone passionate about automation, crawling, and data extraction.
• Individuals excited about scaling from scripting to full data engineering workflows.