Added that can crawl git repositories, a=chris
Added that can crawl git repositories, a=chris
diff --git a/en-US/pages/documentation.thtml b/en-US/pages/documentation.thtml
index 8ed66d6..e94e715 100755
--- a/en-US/pages/documentation.thtml
+++ b/en-US/pages/documentation.thtml
@@ -559,6 +559,8 @@
<li>Yioop has its own DNS caching mechanism.</li>
<li>Yioop supports crawling TOR networks (.onion urls).</li>
<li>Yioop supports crawling through a list of proxy servers.</li>
+ <li>Yioop supports crawling Git Repositories and can index Java and
+ Python code.</li>
<li>Yioop supports crawl quotas for web sites. I.e., one can control
the number of urls/hour downloaded from a site.</li>
<li>Yioop can detect website congestion and slow down crawling