Skip to content

Extract URLs from file, and check whether they exist using wget

Notifications You must be signed in to change notification settings

Tuinslak/URL-Extractor

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

URL Extractor

Attempts to create a list of URLs from files, and checks whether they actually exist/respond before saving them to a file.

What files ?

Usually log files.

For example, getting domains from my Bind (DNS) server. But not every domain has a webserver running behind it.

Why ?

Populate my GFW-URL-checker's host file (http://yeri.be/hr).

--

Maintained by Yeri Tiete (aka Tuinslak)

Blog: http://yeri.be

About

Extract URLs from file, and check whether they exist using wget

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages