Added that can crawl git repositories, a=chris

Chris Pollett [2014-06-28 04:Jun:th]
Added that can crawl git repositories, a=chris
Filename
en-US/pages/documentation.thtml
diff --git a/en-US/pages/documentation.thtml b/en-US/pages/documentation.thtml
index 8ed66d6..e94e715 100755
--- a/en-US/pages/documentation.thtml
+++ b/en-US/pages/documentation.thtml
@@ -559,6 +559,8 @@
     <li>Yioop has its own DNS caching mechanism.</li>
     <li>Yioop supports crawling TOR networks (.onion urls).</li>
     <li>Yioop supports crawling through a list of proxy servers.</li>
+    <li>Yioop supports crawling Git Repositories and can index Java and
+    Python code.</li>
     <li>Yioop supports crawl quotas for web sites. I.e., one can control
     the number of urls/hour downloaded from a site.</li>
     <li>Yioop can detect website congestion and slow down crawling
ViewGit