Hacker GitHub

← All repos

benibela/xidel

View on GitHub ↗ ★ 849 Pascal

Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.

11 mentions on Hacker News by 9 people: 0 stories, 11 comments · first 2017-06-24 · latest 2026-01-20

Mentions per year 11 mentions · busiest year 2021 (3)
20082026
AllStoriesComments NewestTopOldest
  1. …) - another declarative web crawling framework - and others (Xidel, https://github.com/benibela/xidel ). The shared, common abstraction of most web-scraping frameworks and tools is "node selectors" - the syntax and engine for
    comment by rodricios · 2026-01-20 · in Show HN: wxpath – Declarative web crawling in XPath
  2. …single binary called xidel [1]. The feature I really like is that it can also follow links. [1] https://github.com/benibela/xidel
    comment by smartmic · 2025-05-11 · in Scraperr – A Self Hosted Webscraper
  3. …JSON wonderfully - JSONiq is therefore obsolete. [1] https://www.videlibri.de/xidel.html [2] https://github.com/benibela/xidel
    comment by smartmic · 2025-03-28 · in Xee: A Modern XPath and XSLT Engine in Rust
  4. …but for a CLI scraper a lot of data transformations needs can be satisfied with Xpath/XQuery. [0]: https://github.com/benibela/xidel
    comment by dleeftink · 2024-08-18 · in Dasel: Select, put and delete data from JSON, TOML, YAML, XML and CSV
  5. Also: https://github.com/benibela/xidel
    comment by natrys · 2022-11-30 · in Pup: Parsing HTML at the command line
  6. Xidel for XPath on JSON, XML, and HTML: https://github.com/benibela/xidel
    comment by benibela · 2022-10-06 · in Jq Internals: Backtracking (2017)
  7. …posted xidel[0] in this thread, which I've not used, but it seems to be the "jq but for html". [0] https://github.com/benibela/xidel
    comment by gizdan · 2021-09-07 · in Htmlq: like jq, but for html
  8. …using pup[1] for years. And xidel[2] is probably older. [1] https://github.com/ericchiang/pup [2] https://github.com/benibela/xidel
    comment by natrys · 2021-09-07 · in Htmlq: like jq, but for html
  9. …xidel[1] which seems to be similar, but supports XPath. [0] https://en.wikipedia.org/wiki/XPath [1] https://github.com/benibela/xidel
    comment by dfederschmidt · 2021-09-07 · in Htmlq: like jq, but for html
  10. …[1] for that type of task. Feed it xpath , css selectors or its own pattern matching thing. [1] https://github.com/benibela/xidel
    comment by Yetanfou · 2019-10-08 · in Jtc – CLI tool to extract, manipulate and transform source JSON
  11. GitHub repo: https://github.com/benibela/xidel
    comment by fiatjaf · 2017-06-24 · in Xidel: process HTML/XML/JSON using CSS, XPath, XQuery or pattern templates