[Skip Navigation]
« Back Issue #87
  • 2012-04-30 00:22 Reported by administrator
  • 2012-04-30 00:28 Marked fixed
Status: Marked fixed
Priority: Medium

Crawl Option should allow a user to crawl to some fixed depth

administrator 2012-04-30 00:22

This might be implemented by adding to the restrict/quota sites the ability for urls to have * and $ in them.

For example, if disallowed urls like http://www.site.com/*/*/

one could crawl

http://www.site.com/a/b.html

but not

http://www.site.com/a/b/c.html

administrator 2012-04-30 00:28

Fixed with 4915d9

X

 

- Blog - Privacy - Terms - SeekquarryBot - Developed at SeekQuarry -
(c) 2026 Seekquarry - Open Source Search Engine Software