Reference number
Ïã¸ÛÁùºÏ²Ê¿ª½± 24614-2:2011
International Standard
Ïã¸ÛÁùºÏ²Ê¿ª½± 24614-2:2011
Language resource management — Word segmentation of written texts — Part 2: Word segmentation for Chinese, Japanese and Korean
Edition 1
2011-09
Read sample
Ïã¸ÛÁùºÏ²Ê¿ª½± 24614-2:2011
41666
Published (Edition 1, 2011)
This publication was last reviewed and confirmed in 2023. Therefore this version remains current.

Ïã¸ÛÁùºÏ²Ê¿ª½± 24614-2:2011

Ïã¸ÛÁùºÏ²Ê¿ª½± 24614-2:2011
41666
Language
Format
CHF 173
Convert Swiss francs (CHF) to

Abstract

The basic concepts and general principles of word segmentation as defined in Ïã¸ÛÁùºÏ²Ê¿ª½± 24614-1 apply to Chinese, Japanese and Korean. Text needs to be segmented into tokens, words, phrases or some other types of smaller textual units in order to perform certain computational applications on language resources, such as natural language processing, information retrieval and machine translation. Ïã¸ÛÁùºÏ²Ê¿ª½± 24614-2:2011 is restricted to the segmentation of a text into words or other word segmentation units (WSUs). This task is distinct from morphological or syntactic analysis per se, although it greatly depends on morphosyntactic analysis. It is also different from the task of laying out a framework for constructing a lexicon and identifying its lexical entries, namely lemmas and lexemes. The frameworks for the latter tasks are provided by Ïã¸ÛÁùºÏ²Ê¿ª½± 24611, Ïã¸ÛÁùºÏ²Ê¿ª½± 24613 and Ïã¸ÛÁùºÏ²Ê¿ª½± 24615.

Ïã¸ÛÁùºÏ²Ê¿ª½± 24614-2:2011 specifies rules for delineating WSUs for Chinese, Japanese and Korean. Some rules are common to all three languages, though each language also has its own distinct rules for identifying WSUs. The common features are discussed, then the distinct rules are laid out for Chinese, for Japanese and for Korean.

General information

Life cycle

Got a question?

Check out our Help and Support

Check out our FAQs

Customer care
+41 22 749 08 88

Opening hours:
Monday to Friday - 09:00-12:00, 14:00-17:00 (UTC+1)