\seekquarry\yioop\locale\vi_VN\resourcesTokenizer

Vietnamese specific tokenization code. Typically, tokenizer.php either contains a stemmer for the language in question or it specifies how many characters in a char gram for Vietnamese neither char gramming or stemming seemed to make sense, so for now this file is blank.

Summary

Methods

Properties

Constants

stopwordsRemover()

$stop_words

No constants found

No protected methods found

No protected properties found

N/A

No private methods found

No private properties found

N/A

File: src/locale/vi_VN/resources/Tokenizer.php
Package: Default
Class hierarchy: \seekquarry\yioop\locale\vi_VN\resources\Tokenizer

Properties

$stop_words

$stop_words :

A list of frequently occurring terms for this locale which should be excluded from certain kinds of queries. This is also used for language detection

Type

Methods

stopwordsRemover()

stopwordsRemover(mixed  $data) : mixed

Removes the stop words from the page (used for Word Cloud generation and language detection)

Parameters

mixed

$data

either a string or an array of string to remove stop words from

Returns

mixed —

$data with no stop words