Small Bash script to check if the URL on a CSV exists or not
$>./url-visitor.sh /tmp/thefile.csv 20 > /tmp/thefile.post.csv
Where the first parameter is the file to process, and the second one is the number of the column where the URL is located.
You can also specify the type of delimiter used in the CSV by calling:
$>./url-visitor.sh /tmp/thefile.csv 20 > /tmp/thefile.post.csv ','
It will print on the standard output the new CSV with an extra column at the end stating if the url exists or not