21 Resources
Golang scraping Libraries
Newser is a simple utility to generate a pdf with you favorite news articles
Newser A simple utility to crawl some news sites or other resources and download content into a pdf Building Make sure you have config.yaml setup and
Elektra-Auto-Checkout - Utilities to assist in checkout automation of various commercial and retail sites
Elektra About This Project Elektra is designed to automate the process of invent
Pure Go implementation of fast image search and simple OCR, focused on reading info from screenshots
Lookup It is a nice, simple and fast library which helps you to lookup objects on a screen. It also includes OCR functionality. Using Lookup you can d
Scraping medium blogs to make them loadable with shitty internet and have a pleasant reading experience
Unmedium This project is still WIP We all know medium right? A bunch of JS, wast
Implementing WEB Scraping with Go
WEB Scraping with Go In this project I implement a WEB scraper that create a CSV file with quotes and authors from the Pensador programing Web Page. R
Youtube tutorial about web scraping using golang and Gocolly
This is an example project I wrote for a youtube tutorial about webscraping using golang and gocolly It extracts data from a tracking differences webs
A neat wrapper around the 4chan API for content scraping.
moonarch A neat wrapper around the 4chan API for content scraping. How-To First, get the repository: go get github.com/lazdotdigital/fourscrape. fours
Crawls web pages and prints any link it can find.
crawley Crawls web pages and prints any link it can find. Scan depth (by default - 0) can be configured. features fast SAX-parser (powered by golang.o
🦙 acao(阿草), the tool man for data scraping of https://asoul.video/.
🦙 acao acao(阿草), the tool man for data scraping of https://asoul.video/. Deploy to Aliyun serverless function with Raika update_member Update A-SOUL
DataHen Till is a standalone tool that instantly makes your existing web scraper scalable, maintainable, and more unblockable, with minimal code changes on your scraper.
DataHen Till is a standalone tool that instantly makes your existing web scraper scalable, maintainable, and more unblockable, with minimal code changes on your scraper.
Getting new films from baskino.me
Filmparser Description Every time I want to watch a film, I have to go to baskino.me to check if it is available on torrent trackers to download it th
Declarative web scraping
Ferret Try it! Docs CLI Test runner Web worker What is it? ferret is a web scraping system. It aims to simplify data extraction from the web for UI te
Elegant Scraper and Crawler Framework for Golang
Colly Lightning Fast and Elegant Scraping Framework for Gophers Colly provides a clean interface to write any kind of crawler/scraper/spider. With Col
Geziyor, a fast web crawling & scraping framework for Go. Supports JS rendering.
Geziyor Geziyor is a blazing fast web crawling and web scraping framework. It can be used to crawl websites and extract structured data from them. Gez
Extract structured data from web sites. Web sites scraping.
Dataflow kit Dataflow kit ("DFK") is a Web Scraping framework for Gophers. It extracts data from web pages, following the specified CSS Selectors. You
Extract data or evaluate value from HTML/XML documents using XPath
xquery NOTE: This package is deprecated. Recommends use htmlquery and xmlquery package, get latest version to fixed some issues. Overview Golang packa
A declarative struct-tag-based HTML unmarshaling or scraping package for Go built on top of the goquery library
goq Example import ( "log" "net/http" "astuart.co/goq" ) // Structured representation for github file name table type example struct { Title str
Extract structured data from web sites. Web sites scraping.
Dataflow kit Dataflow kit ("DFK") is a Web Scraping framework for Gophers. It extracts data from web pages, following the specified CSS Selectors. You
Elegant Scraper and Crawler Framework for Golang
Colly Lightning Fast and Elegant Scraping Framework for Gophers Colly provides a clean interface to write any kind of crawler/scraper/spider. With Col
A Devtools driver for web automation and scraping
Overview Documentation | API reference Rod is a high-level driver directly based on DevTools Protocol. It's designed for web automation and scraping.
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
Antch Antch, inspired by Scrapy. If you're familiar with scrapy, you can quickly get started. Antch is a fast, powerful and extensible web crawling &