![Forrest logo](/images/logo.png)
On this page you find all important commands for the CLI tool xidel. If the
command you are looking for is missing please ask our AI.
xidel
Xidel is a powerful and versatile command line tool for parsing and extracting data from XML and HTML documents. It supports XPath, CSS, JSONPath, and pattern-based extractions, making it suitable for a wide range of data manipulation tasks.
- Xidel is an open-source command line tool that runs on Windows, macOS, and Linux systems.
- It can be used to extract data from web pages, RSS feeds, XML files, and HTML documents.
- Xidel supports both querying and modifying XML and HTML data, making it useful for data mining and data transformation tasks.
- It has a wide range of built-in functions for handling strings, numbers, dates, and other data types.
- Xidel integrates seamlessly with other command line tools like grep, sed, and awk, allowing for complex data processing pipelines.
- It supports parallel processing, allowing you to speed up data extraction tasks by utilizing multiple processor cores.
- With Xidel, you can easily filter and transform data using conditions, comparisons, and regular expressions.
- It supports operations like sorting, joining, grouping, and aggregating data, making it suitable for data analysis tasks.
- Xidel can handle large datasets and infinite streams of XML and HTML data with its memory-efficient streaming mode.
- It provides detailed error messages and diagnostics to help you debug and troubleshoot your data extraction scripts.
List of commands for xidel:
-
xidel:tldr:12509 xidel: Print all URLs found by a Google search.$ xidel ${https:--www-google-com-search?q=test} --extract "//a/extract(@href, 'url[?]q=([^&]+)&', 1)[. != '']"try on your machineexplain this command
-
xidel:tldr:17594 xidel: Print all newest Stack Overflow questions with title and URL using pattern matching on their RSS feed.$ xidel ${http:--stackoverflow-com-feeds} --extract "${
{title:=-}<-title>{uri:=@href}<-link><-entry>+}" try on your machineexplain this command -
xidel:tldr:50028 xidel: Read the pattern from example.xml (which will also check if the element containing "ood" is there, and fail otherwise).$ xidel ${path-to-example-xml} --extract "${
ood<-foo> {-}<-bar><-x>}" try on your machineexplain this command -
xidel:tldr:6df30 xidel: Follow all links on a page and print the titles, with pattern matching.$ xidel ${https:--example-org} --follow "${{-}<-a>*}" --extract "${
{-}<-title>}" try on your machineexplain this command -
xidel:tldr:71515 xidel: Follow all links on a page and print the titles, with XPath.$ xidel ${https:--example-org} --follow ${--a} --extract ${--title}try on your machineexplain this command
-
xidel:tldr:e3329 xidel: Check for unread Reddit mail, Webscraping, combining CSS, XPath, JSONiq, and automatically form evaluation.$ xidel ${https:--reddit-com} --follow "${form(css('form-login-form')[1], {'user': '$your_username', 'passwd': '$your_password'})}" --extract "${css('#mail')-@title}"try on your machineexplain this command
-
xidel:tldr:f03f5 xidel: Follow all links on a page and print the titles, with CSS selectors.$ xidel ${https:--example-org} --follow "${css('a')}" --css ${title}try on your machineexplain this command
-
xidel:tldr:f3cc1 xidel: Print the title of all pages found by a Google search and download them.$ xidel ${https:--www-google-com-search?q=test} --follow "${--a-extract(@href, 'url[?]q=([^&]+)&', 1)[- != '']}" --extract ${--title} --download ${'{$host}-'}try on your machineexplain this command