freebsd-ports/chinese/p5-Lingua-ZH-HanDetect/pkg-descr
Cheng-Lung Sung 6c5f5e386b Add p5-Lingua-ZH-HanDetect 0.04, guess Chinese text\'s variant and
encoding.

PR:		ports/103585
Submitted by:	Gea-Suan Lin <gslin at gslin.org>
2006-10-05 04:52:44 +00:00

12 lines
483 B
Text

Lingua::ZH::HanDetect uses statistical measures to test a text string
to see if it's in Traditional or Simplified Chinese, as well as which
encoding it is in.
If the string does not contain Chinese characters, both the encoding
and variant values will be set to the empty string.
This module is needed because the various encodings for Chinese text
tend to occupy the similar byte ranges, rendering Encode::Guess
ineffective.
WWW: http://search.cpan.org/dist/Lingua-ZH-HanDetect/