codelucas/newspaper
View on GitHub ↗ ★ 15,182 Python
newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
15 mentions on Hacker News by 15 people: 2 stories, 13 comments · first 2013-12-23 · latest 2021-02-15
20082026
-
…[1] https://github.com/kotartemiy/pygooglenews ` [2] https://github.com/kotartemiy/newscatcher [3] https://github.com/codelucas/newspaper [4] https://github.com/postlight/mercury-parser
comment by artembugara · 2021-02-15 · in Show HN: Dato.rss – RSS Search -
…language preferences but if you're interested in a Python approach then Newspaper3k is worth a look https://github.com/codelucas/newspaper
comment by nmstoker · 2020-09-11 · in How can I identify primary article text when scraping news pages -
…some sites. For the sites it doesn't break with, the experience with EpubPress is much better. 0 - https://github.com/codelucas/newspaper 1 - https://epub.press/
comment by charlesdaniels · 2020-05-22 · in Show HN: Python package to collect normalized news from almost any website -
Depending on what you're trying to do, there's also newspaper3k: https://github.com/codelucas/newspaper It's quite easy to get "good" extraction for large numbers of outlets/articles without a massive amount of special-casing, as news…
comment by pmyteh · 2020-05-21 · in Show HN: Python package to collect normalized news from almost any website -
What makes this library different from something like Newspaper? https://github.com/codelucas/newspaper
comment by tokyolights · 2020-02-25 · in Show HN: Py package to collect normalized news from (almost) any website -
…and analyse data fairly. So far I've just used newspaper to do the hard work of scraping for me ( https://github.com/codelucas/newspaper ) some basic filtering techniques e.g. I discard everything that has a question mark at the end of it…
comment by uncle_j · 2019-12-31 · in Ask HN: What are your news sources other than HN? -
…be escaped. These might be helpful for your use case: "Newspaper3k: Article scraping & curation" https://github.com/codelucas/newspaper lazyNLP "Library to scrape and clean web pages to create massive datasets"…
comment by westurner · 2019-06-29 · in Ask HN: Scripts/commands for extracting URL article text? (links -dump but) -
Interesting topic and well written .. I kicked the tires a few times with newspaper3k https://github.com/codelucas/newspaper/ it has nlp and summary methods that work pretty well, I think I'll peek under the hood to see how it's being done…
comment by schemathings · 2019-04-16 · in A Gentle Introduction to Text Summarization in Machine Learning -
…reading mode) https://github.com/buriy/python-readability https://github.com/goose3/goose3 https://github.com/codelucas/newspaper For a complete solution, you can also look at Wallabag, which can be self-hosted.
comment by heinrichf · 2018-08-12 · in Pocket’s 30M Users Are Great for Publishers -
I've used this in the past https://github.com/codelucas/newspaper There is also a wrapper to expose it as a rest api. Looks like it is not maintained, but easy enough to write your own https://github.com/voidfiles/newspaper-delivery
comment by amarraja · 2018-05-29 · in Ask HN: Are there any tools which can summarize an article? -
…but I can recommend newspaper to extract text. I contributed a while ago and it was pretty solid. https://github.com/codelucas/newspaper
comment by ecesena · 2017-01-25 · in Show HN: Realtime Hacker News Summarization Using Machine Learning -
…added a number of improvements. Haven't used it in anger however so can't comment on its quality. https://github.com/codelucas/newspaper
comment by kylemathews · 2016-01-14 · in A New Instapaper Parser -
…own api & new functionality and my repo ended up doing super well (even better than the original). https://github.com/codelucas/newspaper vs. https://github.com/grangier/python-goose
comment by codelucas · 2014-02-03 · in Imitate. We are imperfect mirrors