Your Own Search Engine, Open Source and Built to Grow!

SeekQuarry is the home of Yioop: a complete search engine, social site and web server written in PHP and released under the GPLv3. Crawl the web, index it, search it, and build a community around it, all from software you can read, run and change yourself.

A billion pages and counting

Indexes built with Yioop since it began in 2009 have reached a billion pages. Yioop does not need a data center to get there. The live site, yioop.com, runs its current crawl and serves its searches from one System76 Meerkat mini PC:

• Processor: a 13th Gen Intel Core i5-1340P, with 12 cores and 16 threads.
• Memory: 64 GB of DDR4.
• Storage: a 4 TB NVMe drive, an 8 TB Samsung SSD, and a 40 TB RAID 0 array over USB 3.1 for the index.
• Network: a 150 Mbps Comcast connection, through a gigabit Ethernet port.

The crawl fetches pages in many languages from across the web while the same machine answers searches and serves the site.

What can Yioop do?

• Search Results. Yioop comes with a crawler for the open web or for a list of sites you choose. It indexes Wikipedia XML dumps, arc and warc archives, Open Directory RDF, and dumps of email or databases. Crawls can be mixed into one set of results, and knowledge wiki callouts can sit beside them. Tools to classify and sculpt your data come built in.
• Media Services. A media updater re-indexes RSS and Atom feeds every hour, so fresh news reaches the results. It also recodes uploaded video, sends bulk email, and works out view statistics. Trending tools track how words and values change over time.
• Social Groups, Blogs, and Wikis. Users can make discussion groups, blogs and wikis, public or private, with posts that can expire. Each group has a wiki for pages, slide presentations and spreadsheets, and a ChatBot API for chat bots in group feeds.
• Web Sites. Yioop's wiki can build whole web sites, and its Model View Adapter framework can be extended into a custom search portal. Search can also be added to an existing site through an API, Open Search RSS, or JSON. Yioop's stemmers, summarizers and other language tools can be used in your own project through Composer.
• Monetization. Yioop sites can show ads from external ad servers. SeekQuarry also sells a payment processing script, now built on Stripe Elements and Payment Intents, for keyword advertising and for fees to join groups.

New in Yioop 10

• Its own servers. Yioop runs on its own web server, with HTTPS, HTTP/2 and HTTP/3, and on its own mail server, so one PHP install can serve the site and deliver its mail.
• Voice and video calls. Users can call each other from their messages, and messages arrive at once over a live connection.
• Audio and video in PHP. Yioop decodes and encodes common audio and video formats in its own PHP code.
• Git repositories with issue trackers. A wiki page can hold a git repository that people clone and push to over HTTP, with an issue tracker beside it.
• A fresh look. New themes and a layout that fits phones, plus a refreshed chat and an easier wiki editor.
• Stronger accounts. Password policies, sign-in controls, and a security audit of every url path Yioop answers. The URL Types page lists them all.
• 25 languages. Yioop speaks 25 languages, from Arabic to Vietnamese, and a faster tokenizer handles text in each of them, including Chinese, Japanese and Korean.

Requirements

Yioop asks for little: 8 GB of RAM, SQLite, cURL, PHP 8.1 or later, and Linux, macOS or Windows. Download it, start it, and you have a search engine of your own.