fast tool for separate existing domains from list of domains using DNS/HTTP.

NETGREP


How To InstallHow to use


Description

netgrep can send http/https request or resolve domain from dns (can customize dns server) to separate existing domains from all domains very easy.


Install netgrep

netgrep require go1.13 and above.

Install netgrep with command:

GO111MODULE=off go get -u github.com/aWolver/netgrep

How to use

See usage:

netgrep -h

Will print usage:

Usage - netgrep [OPTIONS] {targets specification}

TARGETS SPECIFICATION:
  Can pass targets.
  -iL <filename>: Input from list of hosts.
  If not pass target, targets read from <stdin>.

DNS:
  -dns <IP-address>: DNS Server for resolve host.
  -dns-timeout <time-duration>: DNS Server timeout (default: 10000ms).
                    durations: ns(Nanosecond), us(Microsecond), ms(Millisecond), s(Second), m(Minutes), h(Hour)
  -dns-type <type>: DNS Type (default: Host).
                    types: Host, MX, CNAME, NS

HTTP Request:
  -http/-https: Use HTTP/HTTPS request to discovery.
  -http-method <method>: HTTP[S] request method
  -cookie <data>: HTTP[S] request cookies (format like cURL).
  -header <header>: HTTP[S] request header (format like cURL).
  -http-timeout <time-duration>: HTTP[S] request timeout (default: 10s). [see -dns-timeout]
  -http-path <path>: HTTP[S] request path ( /path[query][fragment] ).
  -status-code <statuscode>: Match HTTP status codes (default: (default: 200,204,301,302,307,401,403,405)).

OUTPUT:
  -o <filename>: Output scan write to the given filename.
  -debug: Debug mode (increase verbosity level).
  -oS <style>: Output file style.
       styles: Host: {{HOST}} StatusCode: {{CODE}} Status: {{STATUS}} IP's: {{IP}} ProtocolType: {{TYPE}} Path: {{PATH}}

OTHER:
  -V: Print version and exit.
  -h, --help: Show this help menu.

DNS

  • usage:
echo "example.com" | netgrep
  • can customize dns server:
echo "example.com" | netgrep -dns 8.8.8.8
  • can set dns type and dns timeout:
echo "example.com" | netgrep -dns 8.8.8.8 -dns-timeout 10s -dns-type MX

HTTP/HTTPS

  • usage (for HTTP use -http | for HTTPS use -https):
echo "example.com" | netgrep -http
  • can set path/method/headers/cookies:
echo "example.com" | netgrep -http -http-path / -http-method POST -header 'Refferer: sub.example.com' -cookie 'NAME=VALUE; NAME=VALUE'
  • set status codes for separate:
echo "example.com" | netgrep -http -status-code 200,301,401,403

STYLING

  • for DNS:

    • {{HOST}}: domain/host
    • {{IP}}: resolved IP's
  • for HTTP/HTTPS:

    • {{HOST}}: domain/host
    • {{PATH}}: requested path
    • {{TYPE}}: http or https
    • {{CODE}}: status code
    • {{STATUS}}: e.g. '200 OK'
$ netgrep -http -o file.txt -oS '{{TYPE}}://{{HOST}}{{PATH}} - {{STATUS}}' example.com sub.example.com
...
[200 OK] example.com
[301 Moved Permanently] sub.example.com
...
$ cat file.txt
http://example.com/ - 200 OK
http://sub.example.com/ - 301 Moved Permanently
Owner
aWolver
My name is Ali. Programmer. Learning Web Penetration Testing.
aWolver
Similar Resources

A simple DNS forwarder that forwards DNS queries to various upstreams

A simple DNS forwarder that forwards DNS queries to various upstreams. If an upstream returns NXDomain, the next upstream is tried.

Jul 8, 2022

Automatically register a list of domain names, add them to Cloudflare and set DNS records.

NameCannon Automatically register a list of domain names, add them as zones on Cloudflare, then add DNS records. Usage $ ./NameCannon --namesiloSecret

Jan 26, 2022

sonarbyte is a simple and fast subdomain scanner written in go to extract subdomain from Rapid7's DNS Database using omnisint's api.

 sonarbyte is a simple and fast subdomain scanner written in go to extract subdomain from Rapid7's DNS Database using omnisint's api.

sonarbyte Description Sonarbyte is a simple and fast subdomain scanner written in go to extract subdomains from Rapid7's DNS Database using omnisint's

Jul 27, 2022

GoScan is a port-scanner made entirely in Go-lang. The purpose of the tool is to be fast, dynamic and simple so that a professional in the CyberSecurity area can make an optimized list of ports

GoScan is a port-scanner made entirely in Go-lang. The purpose of the tool is to be fast, dynamic and simple so that a professional in the CyberSecurity area can make an optimized list of ports

🦫 GoScan GoScan is a port-scanner made entirely in Go-lang. The purpose of the tool is to be fast, dynamic and simple so that a professional in the C

Jul 19, 2022

Fast Private DNS,提供自定义的DNS记录配置和DNS解析缓存。

fpdns Fast Private DNS,提供自定义的DNS记录配置和DNS解析缓存。 特性: A记录 CNAME 泛解析 DNS负载均衡 缓存DNS解析结果 上游同时多DNS Server查询 各系统测试情况 Linux: 已稳定运行3年多 Darwin: 已开发测试 Windows: 未测试

Nov 4, 2021

Privacy important, fast, recursive dns resolver server with dnssec support

Privacy important, fast, recursive dns resolver server with dnssec support

🚀 Privacy important, fast, recursive dns resolver server with dnssec support Installation go get github.com/semihalev/sdns Pre-build Binaries Downloa

Dec 26, 2022

Fast DNS implementation for Go

Fast DNS implementation for Go Features 0 Dependency Similar Interface with net/http Fast DoH Server Co-create with fasthttp Fast DNS Client with rich

Dec 27, 2022

Get related domains / subdomains by looking at Google Analytics IDs

Get related domains / subdomains by looking at Google Analytics IDs

AnalyticsRelationships This script try to get related domains / subdomains by looking at Google Analytics IDs from a URL. First search for ID of Googl

Jan 2, 2023

Coredns plugin for relaying .local domains

CoreDNS Local_Query This is a plugin for coredns that was developed to allow for the use of naked hosts in place of .local domains i.e example.local b

Nov 4, 2021
Godaddy-domains-client-go - Godaddy domains api Client golang - Write automaticly from swagger codegen

Go API client for swagger Overview This API client was generated by the swagger-codegen project. By using the swagger-spec from a remote server, you c

Jan 9, 2022
Sep 23, 2022
Wrapper for Lightning Network Daemon (lnd). It provides separate accounts with minimum trust for end users.

LndHub.go Wrapper for Lightning Network Daemon (lnd). It provides separate accounts with minimum trust for end users. LndHub compatible API implemente

Dec 21, 2022
Given a list of domains, you resolve them and get the IP addresses.
Given a list of domains, you resolve them and get the IP addresses.

resolveDomains Given a list of domains, you resolve them and get the IP addresses. Installation If you want to make modifications locally and compile

Oct 19, 2022
Gogrok is a self hosted, easy to use alternative to ngrok. It uses SSH as a base protocol, using channels and existing functionality to tunnel requests to an endpoint.

gogrok A simple, easy to use ngrok alternative (self hosted!) The server and client can also be easily embedded into your applications, see the 'serve

Dec 3, 2022
DNS Ping: to check packet loss and latency issues with DNS servers

DNSping DNS Ping checks packet loss and latency issues with DNS servers Installation If you have golang, easiest install is go get -u fortio.org/dnspi

Nov 18, 2022
Verify IP addresses of respectful crawlers like Googlebot by reverse dns and forward dns lookups
Verify IP addresses of respectful crawlers like Googlebot by reverse dns and forward dns lookups

goodbots - trust but verify goodbots verifies the IP addresses of respectful crawlers like Googlebot by performing reverse dns and forward dns lookups

Aug 16, 2022
The Dual-Stack Dynamic DNS client, the world's first dynamic DNS client built for IPv6.

dsddns DsDDNS is the Dual-Stack Dynamic DNS client. A dynamic DNS client keeps your DNS records in sync with the IP addresses associated with your hom

Sep 27, 2022
netcup DNS module for caddy: dns.providers.netcup

netcup DNS module for Caddy This package contains a DNS provider module for Caddy. It can be used to manage DNS records with the netcup DNS API using

Nov 9, 2022
A fork on miekg/dns (since I've already forked zmap/dns)

Alternative (more granular) approach to a DNS library Less is more. Complete and usable DNS library. All Resource Records are supported, including the

Jan 19, 2022