Extraction Rules
Using the extract_rules parameter, you can get the scraped site based on various extraction rules.
Extraction rules can be applied with both JavaScript rendering enabled or disabled.
Possible extraction rules:
| Parameter | Required | Details |
|---|---|---|
| selector | true | The CSS selector. |
| output | false | Choose between html, text or @[attr]. Default value is html |
| all | false | Set this parameter to "1" to return all the html elements. Default value is "0". |
Extraction Rules examples
GET
https://scrape.shifter.io/v1?api_key={{api_key}}&url=https://webscrapingapi.com&extract_rules={"title": {"selector": "h1", "output": "text"}, "subtitle": {"selector": "p.p-big", "output": "text"}}
Code to integrate
Response Example
{"title":"The leading REST API for web scraping","subtitle":"Join 10,000+ businesses that use WebScrapingAPI to gather
data at scale.WebScrapingAPI collects the HTML from any web page using a simple API and provides\n ready-to-process data
to everyone in your company.Use one API to collect data, from any website. Integrate with any development language and\n
customize your\n requests in just 30 seconds."}