> For the complete documentation index, see [llms.txt](https://stephanosterburg.gitbook.io/scrapbook/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://stephanosterburg.gitbook.io/scrapbook/data-science/web-scraping.md).

# web scraping

## Tools

{% embed url="<https://github.com/osterburg/HeadlessBrowsers/blob/master/README.md>" %}

{% embed url="<https://webhose.io>" %}

{% embed url="<https://cheerio.js.org/>" %}

{% embed url="<https://github.com/GoogleChrome/puppeteer>" %}

## Tutorials

{% embed url="<https://scrapy.org/>" %}

{% embed url="<https://pypi.org/project/beautifulsoup4/>" %}

{% embed url="<https://www.digitalocean.com/community/tutorials/how-to-crawl-a-web-page-with-scrapy-and-python-3>" %}

{% embed url="<https://www.dataquest.io/blog/web-scraping-tutorial-python/>" %}