Hacker GitHub

← All repos

adbar/trafilatura

View on GitHub ↗ ★ 7,094 Python

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

8 mentions on Hacker News by 8 people: 2 stories, 6 comments · first 2022-03-31 · latest 2026-08-15

Mentions per year 8 mentions · busiest year 2023 (3)
20082026
AllStoriesComments NewestTopOldest
  1. …it out! There is another tool that on the surface appears similar to Defuddle called trafilatura: https://github.com/adbar/trafilatura It was OK, but I wasn't happy with it, as it kept stripping the comments sections.
    comment by neo1 · 2026-08-15 · in I turned my RSS feeds into an e-ink newspaper to stop reading on my phone
  2. ▲ 1
    Trafilatura: A tool and library to gather text and metadata on the Web
    story by delduca · 2025-05-28 · 0 comments
  3. …or something like that. -- 1: https://github.com/EmmanuelOga/plangs2/blob/main/packages/ai... 2: https://github.com/adbar/trafilatura
    comment by emmanueloga_ · 2024-12-13 · in Show HN: DataFuel.dev – Turn websites into LLM-ready data
  4. …1 https://www.mojeek.com/bot.html 1 http://www.reddit.com/feedback 1 https://github.com/adbar/trafilatura 1
    comment by JPLeRouzic · 2024-05-14 · in Claude is now available in Europe
  5. The feature list answers that question pretty well: https://github.com/adbar/trafilatura#features Basically: you could implement all of this on top of BeautifulSoup - polite crawling policies, sitemap and feed parsing, URL de-duplication,…
    comment by simonw · 2023-08-14 · in Trafilatura: Python tool to gather text on the Web
  6. ▲ 134
    Trafilatura: Python tool to gather text on the Web
    story by kevin_hu · 2023-08-14 · 22 comments
  7. …and I use it to give me summaries of web pages or answer specific questions all the time :) 1. https://github.com/adbar/trafilatura/ 2. https://www.adept.ai/blog/act-1
    comment by vasinov · 2023-04-21 · in Show HN: Build AI DAGs with Memory; Run and Validate LLM Tools in Containers
  8. …it. [1]: https://github.com/mozilla/readability [2]: https://github.com/chromium/dom-distiller [3]: https://github.com/adbar/trafilatura [4]: https://www.bbaw.de/en/ [5]: https://www.dwds.de/d/k-web [6]: https://arxiv.org/abs/1811.03661…
    comment by acrophobic · 2022-03-31 · in How does Firefox's Reader View work? (2020)