DevelopmentPayment protectionDetails
- Revisions within the package are free.
- If you do not respond within 3 days of delivery, the work is accepted automatically.
The money is reserved when you pay and released only once you accept the work.

Example result
Parser of a garden tools supplier's catalog into Excel
What the result looks like
| Article | Name | Price | In stock | Weight | Photo |
|---|---|---|---|---|---|
| GT-1042 | Pruning shears, 20 mm | 18.90 | Yes | 0.24 kg | …/gt-1042.jpg |
| GT-1187 | Folding saw, 210 mm | 24.50 | Yes | 0.31 kg | …/gt-1187.jpg |
| GT-2210 | Hedge shears, wavy blade | 39.00 | No | 1.10 kg | …/gt-2210.jpg |
| GT-3305 | Hand trowel, stainless | 9.80 | Yes | 0.18 kg | …/gt-3305.jpg |
| GT-4120 | Garden hose 25 m, 1/2" | 42.00 | Yes | 2.90 kg | …/gt-4120.jpg |
The file in the example has 1,236 products from 52 list pages.
A part of the code
def product_links(list_url: str) -> Iterator[str]:
"""Product page links from every page of the list, following 'Next'."""
url: str | None = list_url
while url:
page = fetch(url)
for card in page.select("div.product-card a.title"):
yield urljoin(url, card["href"])
next_link = page.select_one("a.pagination-next")
url = urljoin(url, next_link["href"]) if next_link else None
def fetch(url: str) -> BeautifulSoup:
"""One open page, at a polite pace: a pause between requests and a few tries on errors."""
for attempt in range(3):
time.sleep(settings.delay_seconds)
response = session.get(url, timeout=30)
if response.status_code == 200:
return BeautifulSoup(response.text, "html.parser")
log.warning("%s answered %s, try %d of 3", url, response.status_code, attempt + 1)
raise ScraperError(f"{url} did not open after 3 tries")
Files: a ZIP archive with scraper.py, settings.ini (the start page, the pause between requests, the file name), requirements.txt and a README on installing and running it. It reads only open pages, one every 2 seconds, and checks the site's robots.txt first. The client runs it on their own computer.
Client: an online garden shop that resells a supplier's tools; the supplier has an open catalog on its website but no price list file. Task: go through the catalog's list pages, open every product page and save the article number, name, price, stock, weight and main photo link to Excel, to compare prices once a week.
The client and all details are made up.
About this service
A ready-made news headlines parser: a typical Python parser already worked out for news pages, fitted to the open news site or section you name. It saves headline, date and time, section, tags, the short lead the site shows and link: enough to follow your industry, see how often a topic comes up or keep a reading list for a newsletter. It does not copy full articles, which belong to their publishers; the table points to them by link. If the site has an RSS feed, the parser can read it, which is gentler for the site. You send links to a section page and to one article, saved copies of them and the fields you need. You run it yourself on your computer. It reads only open pages at a polite pace, skips anything behind a paywall or sign-in and does not save comments or anything with readers' names.
What is included
- What you getA ZIP archive with the ready news headlines parser in Python, a settings file with the addresses and the pause between pages, and a README; the code is also shown on the order page.
- Headline fields readyHeadline, date, section, tags, lead, link
- Links, not full textsArticles stay with their publishers
- Several sites togetherUp to 3 in one table, in Premium
- Polite paceA pause between pages, set in the settings
- A plain guideInstalling Python and running it, step by step
How it works
- 1PagesYou give the site, the section, the fields and saved pages
- 2SetupWe fit the ready parser to those pages and write the guide
- 3RunYou run it and check the first rows of the table
- 4ChangesYou ask for changes within your package and send any error message
What we need from you
The open news site and the exact pages: a link to a section or tag page and to one article. The fields you need in the order of your table, for example headline, date, section, lead and link. One or two of those pages saved from your browser (File > Save page as) or screenshots, and the RSS link if the site has one. The results file: CSV, Excel or, in Premium, JSON. For Premium, the other sites and how often to run it.
We will ask you:
- Which site and section?
- The fields you need
- Keywords to keep
- Results file and how often
Compare packages
| Packages | Basic$16 | Standard$31 | Premium$56 |
|---|---|---|---|
| What is included | Headlines from one page | Section and articles | Up to 3 news sites |
| Deadline | 1 day | 2 days | 3 days |
| Revisions | 1 | 2 | 3 |
| Sites | 1 | 1 | up to 3 |
| Kinds of page | 1 | 2 (list and item) | up to 3 |
| Fields | up to 10 | up to 25 | up to 25 on each |
| Goes through the pages of a list | No | Yes | Yes |
| Results file | CSV | Excel or CSV | Excel, CSV or JSON |
| Duplicates removed, resumes where it stopped | No | No | Yes |
| Ready-made version | News headlines | News headlines | News headlines |
| Order Basic | Order Standard | Order Premium |
Payment protection
You pay when you order, but the money is released only for accepted work.
- Fixed priceThe package price does not change after you pay.
- The money is reservedWhen you pay, the amount is only reserved. It is released to the service once you accept the work.
- Checked before deliveryEvery result goes through a quality check before it reaches you, and you see it on the order page before accepting it.
- Free revisionsAsk for changes within your brief as many times as the package allows.
- Acceptance after 3 daysIf within 3 days of delivery you neither accept the work nor ask for changes, it is accepted automatically. If you write in the order chat after delivery, the order waits; once we answer, we may start the 3 days again and will say so in the chat.
- Redo or a full refundIf the result does not match your brief and the revisions did not fix it, or the work takes more than twice its deadline, write in the order chat: we will redo the work or refund the payment in full.
Questions and answers
Can it save the full text of articles?
No. Articles are the publishers' work. The parser saves the headline, the short lead the site shows and the link, so you read the article on the site.
Can I republish the headlines on my site?
That depends on the publisher's terms and the law of your country, and the decision is yours. The parser is made for your own monitoring and reading lists.
What if the site changes its layout?
The parser works by the pages as they are now. After a redesign it needs an update, which is a new order. It reads at a polite pace and does not get around limits a site sets.
Am I allowed to collect this data?
Collecting public data is allowed in many cases, but sites' terms and data laws differ between countries, so you decide whether you may collect and use it. The parser never logs in, gets around protection or collects personal data.
Why does it cost less than a custom parser?
It is a ready-made, typical news headlines parser: its fields and the way it moves through pages are already worked out, and we fit it to the site you name and your columns. Unusual sites and fields are the custom parser service.
Did not find your answer?


