Filter By
86 Resources
Golang Web Crawling
Simple content crawler for joyreactor.cc
Reactor Crawler Simple CLI content crawler for Joyreactor. He'll find all media content on the page you've provided and save it. If there will be any
High-performance crawler framework based on fasthttp
predator / 掠食者 基于 fasthttp 开发的高性能爬虫框架 使用 下面是一个示例，基本包含了当前已完成的所有功能，使用方法可以参考注释。
Scraper to download school attendance data from the DfE's statistics website
💪 Simple to use. Scrape attendance data with a single command! 🏇 Super fast. A
Youtube tutorial about web scraping using golang and Gocolly
This is an example project I wrote for a youtube tutorial about webscraping using golang and gocolly It extracts data from a tracking differences webs
Warhammer40K faction scraper written in Golang, powered by colly.
Wascra Description Wascra is a tool written in Golang, which lets you extract all relevant Datasheet info from a Warhammer40K (9th edition) faction fr
connpassSearcher gets ICT event informations
connpassSearcher connpassSearcher gets ICT event informations Installation When you have installed the Go, Please execute f
Go-site-crawler - a simple application written in go that can fetch contentfrom a url endpoint
Go Site Crawler Go Site Crawler is a simple application written in go that can f
A simple crawler sending Telegram notification when Refurbished Macbook Air / Pro in stock.
A simple crawler sending Telegram notification when Refurbished Macbook Air / Pro in stock.
A recursive, mirroring web crawler that retrieves child links.
A recursive, mirroring web crawler that retrieves child links.
Getting new films from baskino.me
Filmparser Description Every time I want to watch a film, I have to go to baskino.me to check if it is available on torrent trackers to download it th
Ratemyprof scraper - Ratemyprof scraper with golang
ratemyprof scraper visit https://ratemyprof-api.vercel.app/api/getProf to try ou
Dumbass-news - A web service to report dumbass news
Dumbass News - a web service to report dumbass news Copyright (C) 2022 Mike Tayl
Crawler for StandNews
StandNews Crawler for StandNews, a news-network currently being taken over by the Chinese Goverment. Running Clone the repository git clone https://gi
A cli scraper of gocomics.com made in go
goComic goComic is a cli tool written in go that scrapes your favorite childhood favorite comic from gocomics.com. It will give you a single days comi
Go program that fetches urls and prepends http:// if missing
fetchautoprefix This is an exercise of the book The Go Programming Language, by
Go program that fetches URLs concurrently and handles timeouts
fetchalltimeout This is an exercise of the book The Go Programming Language, by
Implementing WEB Scraping with Go
WEB Scraping with Go In this project I implement a WEB scraper that create a CSV file with quotes and authors from the Pensador programing Web Page. R
Go spider: A crawler of vertical communities achieved by GOLANG
go_spider A crawler of vertical communities achieved by GOLANG. Latest stable Release: Version 1.2 (Sep 23, 2014). QQ群号：337344607 Features Concurrent
An images downloader from Drive2 posts
Drive2 Images Downloader Allows to parse and download all the images that are in a post (logbook, community) Installation git clone https://github.com
Examples for chromedp for web scrapping
About chromedp examples This folder contains a variety of code examples for working with chromedp. The godoc page contains a number of simple examples
WebWalker - Fast Script To Walk Web for find urls...
WebWalker send http request to url to get all urls in url and send http request to urls and again .... WebWalker can find 10,000 urls in 10 seconds.
A neat wrapper around the 4chan API for content scraping.
moonarch A neat wrapper around the 4chan API for content scraping. How-To First, get the repository: go get github.com/lazdotdigital/fourscrape. fours
This is a small tool designed to scrape one or more URLs given as command arguments.
HTTP-FETCH This is a small tool designed to scrape one or more URLs given as command arguments. Usage http-fetch [--metadata] ...URLs The output files
A scrapy implementation in Go
go-scrapy A scrapy implementation in Go. (Work in progres) Overview go-scrapy is a very useful and productive web crawlign framework, used to crawl we
Simple price scraper with HTTP server/exporter for use with Prometheus
priceserver v0.3 Simple price scraper with HTTP server/exporter for use with Prometheus Currently working with Bitrue.com exchange but easily adaptabl
A PCPartPicker crawler for Golang.
gopartpicker A scraper for pcpartpicker.com for Go. It is implemented using Colly. Features Extract data from part list URLs Search for parts Extract
A simple crawling study that obtained the new houses for sale in Wuhan, China
Crawling-Study This is a simple crawling study that obtained the new houses for sale in Wuhan, China. The used programming language was Go. As a begin
Multiplexer: HTTP-Server & URL Crawler
Multiplexer: HTTP-Server & URL Crawler Приложение представляет собой http-сервер с одним хендлером. Хендлер на вход получает POST-запрос со списком ur
scrapes codewars solution
Codewars Solution Scraper Currently the codewars api provides the completed katas, but not the actual solution code you wrote to complete it. This go
View reddit memes and posts from ur terminal with golang and webscraping
goddit View reddit memes and posts from your terminal with golang and webscraping Installation run the following commands on your terminal to install