Infinite Scroll
Many modern websites load content dynamically as you scroll down — social media feeds, image galleries, and product catalogs. The infinite scroll mode handles this automatically by scrolling the page and waiting for new content to appear.
How to set it up
1
Create your recipe
Set up your fields using the element picker or auto detection, just like any other scrape.
2
Enable pagination
Open the Pagination tab and select Infinite Scroll as the pagination type.
3
Configure limits
Set the max number of scroll cycles and the delay between each scroll to give the page time to load new content.
4
Start scraping
Click scrape and the extension handles the rest — scrolling, waiting, extracting, and deduplicating.
How it works under the hood
- The extension scrolls to the bottom of the page
- Waits for new content to load (based on your configured delay)
- Extracts newly appeared elements that match your selectors
- Deduplicates rows automatically to avoid capturing the same data twice
- Repeats until the max scroll limit is reached or no new content appears
Best practices
- Set a reasonable delay — 2–3 seconds works for most sites. Slower sites may need more time.
- Start with a small limit — test with 3–5 scroll cycles first to make sure your selectors work correctly.
- Check for duplicates — the extension deduplicates automatically, but verify in the preview table.
Works great with
- Social media feeds (Twitter/X, LinkedIn, etc.)
- Image galleries and portfolio sites
- E-commerce product pages with "Load More" behavior
- News sites and blog listing pages
If the page uses traditional pagination with "Next" buttons or page numbers, use Multi-Page Scraping instead for more reliable results.