Case study · Web Scraping

Image Scraper

Extract unique image URLs from static and JavaScript-rendered websites with configurable crawling, filtering, and proxy support.

Overview

A configurable image extraction crawler that scans one or multiple webpages, discovers images from common page elements, metadata, responsive image sets, and page styles, and stores unique image URLs as structured dataset results. It supports optional link following, extension filtering, JavaScript rendering, concurrent processing, and proxy connections.

Problem

Images on modern websites can appear across HTML elements, metadata, responsive image sources, CSS styles, and JavaScript-rendered content, making reliable extraction difficult with simple HTML parsing alone.

Solution

Built a configurable crawler that extracts image URLs from multiple page sources, follows links to a defined depth when needed, filters results by image extension, and can switch between fast HTML loading and full browser rendering for JavaScript-powered websites.

How it works

- Scan multiple start URLs in one run - Extract images from common HTML elements - Extract images from page metadata - Extract responsive image sources - Discover images referenced in page styles - Configurable recursive crawl depth - Image extension filtering - Static HTML and JavaScript-rendered page support - Automatic unique image URL output - Configurable concurrency - Apify Proxy and custom proxy support - JSON, CSV, Excel, XML, RSS, and JSONL exports