A Python parser that collects open event and concert listings into a table: date, venue, city, price and link

Example result

def product_links(list_url: str) -> Iterator[str]:
    """Product page links from every page of the list, following 'Next'."""
    url: str | None = list_url
    while url:
        page = fetch(url)
        for card in page.select("div.product-card a.title"):
            yield urljoin(url, card["href"])
        next_link = page.select_one("a.pagination-next")
        url = urljoin(url, next_link["href"]) if next_link else None


def fetch(url: str) -> BeautifulSoup:
    """One open page, at a polite pace: a pause between requests and a few tries on errors."""
    for attempt in range(3):
        time.sleep(settings.delay_seconds)
        response = session.get(url, timeout=30)
        if response.status_code == 200:
            return BeautifulSoup(response.text, "html.parser")
        log.warning("%s answered %s, try %d of 3", url, response.status_code, attempt + 1)
    raise ScraperError(f"{url} did not open after 3 tries")

About this service

City guides, venues and promoters use this parser to gather open event listings into one table: event title, category, date and start time, venue, city, price from, age limit, ticket link and picture link. Send the listings page of the site, such as a venue, a city guide or a ticket site, one event page and one or two pages saved from your browser. We write the code in Python; you get it with a settings file and a README and run it on your computer before you update your own calendar. It does not buy tickets, check free seats or collect personal data of organisers or visitors. It reads open pages at a polite pace and never logs in or gets around captchas or protection. You decide whether the site's terms allow it, and a later change of its layout needs an update.

What is included

• What you getA ZIP archive with the Python code, a settings file and a README with step-by-step instructions; the code is also shown on the order page.
• Dates you can sortDate and time in one format, so the table sorts by day
• Ticket linksA link to the event's own page or ticket page
• Picture linksPosters as links; use them only if you may
• Polite paceA pause between pages, set in the settings
• Runs on your computerWindows, macOS or Linux, with Python

How it works

1. 1
   ListingsYou give the listings page and one saved event page
2. 2
   ParserWe write the code and the guide to running it
3. 3
   RunYou run it and check the dates of the first events
4. 4
   ChangesYou ask for changes within your package and send any error message

What we need from you

The site and the exact pages: a link to the listings and to one event page, and roughly how many events there are. The fields you need in the order of your table, e.g. title, category, date, time, venue, city, price from, link. One or two of those pages saved from your browser (File > Save page as) or screenshots. The date format you want and CSV or Excel.

We will ask you:

• Which site and pages?
• The fields you need
• How many events roughly?
• Only some events?

Compare packages

Questions and answers

Did not find your answer? Ask us