Handles short URLs while crawling, obtains original URL from it and crawls the original link
Cool! Thanks Tanmayee. I added some stuff to your code to handle following multiple locations as well as to handle http-equiv refresh and location.
Chris
Attachments:
0263-Tanmayee_commit.patch
Handles short URLs while crawling, obtains original URL from it and crawls the original link
Cool! Thanks Tanmayee. I added some stuff to your code to handle following multiple locations as well as to handle http-equiv refresh and location.
Chris
Attachments:
0263-Tanmayee_commit.patch