Citizendia

Unicode
Character encodings
UCS
Mapping
Bi-directional text
BOM
Han unification
Unicode and HTML
Unicode and E-mail
Unicode typefaces

GB18030 is the registered Internet name for the official character set of the People's Republic of China (PRC) superseding GB2312. In Computing, Unicode is an Industry standard allowing Computers to consistently represent and manipulate text expressed in most of the world's A character encoding consists of a code that pairs a sequence of characters from a given character set (sometimes incorrectly referred to as Code page This article compares Unicode encodings Two situations are considered eight-bit-clean environments and environments like Simple Mail Transfer Protocol that forbid use of UTF-7 (7- Bit Unicode Transformation Format) is a variable-length character encoding that was proposed for representing Unicode -encoded text using a UTF-1 is a way of transforming ISO 10646/ Unicode into a stream of Bytes Due to the design it is not possible to resynchronise if decoding starts in the middle of a UTF-8 (8- Bit UCS / Unicode Transformation Format) is a variable-length Character encoding for Unicode. "Compatibility Encoding Scheme for UTF-16 8-Bit" ( CESU-8) is a variant of UTF-8 that is described in Unicode Technical Report #26. In Computing, UTF-16 (16- Bit Unicode Transformation Format is a variable-length Character encoding for Unicode, capable of encoding UTF-32 (or UCS-4) is a protocol for encoding Unicode characters that uses exactly 32 Bits for each Unicode Code point. UTF-EBCDIC is a Character encoding used to represent Unicode characters The Standard Compression Scheme for Unicode (SCSU is a Unicode Technical Standard for reducing the number of Bytes needed to represent Unicode text especially BOCU-1 is a MIME compatible Unicode compression scheme BOCU stands for B inary O rdered C ompression for U nicode Punycode is a Computer programming encoding syntax by which a Unicode string of characters can be translated into the more-limited character set permitted An internationalized domain name ( The Universal Character Set (UCS defined by the ISO / IEC 10646 International Standard, is a standard set of characters upon which Unicode ’s Bi-directional text is used as some Writing systems of the world notably the Arabic (including variants such as Nasta'liq) and Hebrew scripts A byte-order mark ( BOM) is the Unicode character at code point U+FEFF ("zero-width no-break space" when that character is used to denote Web pages authored using hypertext markup language ( HTML) may contain multilingual text represented with the Unicode universal character set. Many E-mail clients now offer some support for Unicode in E-mail bodies Unicode typefaces (also known as UCS fonts and Unicode fonts) are Typefaces containing a wide range of characters, letters, Digits A character encoding consists of a code that pairs a sequence of characters from a given character set (sometimes incorrectly referred to as Code page Talk People's Republic of China) PEOPLE'S REPUBLIC OF CHINA ARTICLE GUIDELINES GB2312 is the registered internet name for a key official Character set of the People's Republic of China, used for simplified Chinese characters This character set is formally called "Chinese National Standard GB 18030-2005: Information technology -- Chinese coded character set". GB abbreviates Guójiā Biāozhǔn (国家标准), which means national standard in Chinese. The standard was published by the China Standard Press, Beijing, November 8, 2005. Events 1519 - Hernán Cortés enters Tenochtitlán and Aztec ruler Moctezuma welcomes him with great a Celebration Year 2005 ( MMV) was a Common year starting on Saturday (link displays full calendar of the Gregorian calendar. Only a portion of the standard is mandatory. Since May 1, 2006, support for the mandatory subset is officially required for all software products sold in the PRC. Events 305 - Diocletian and Maximian retire from the office of Roman Emperor. Year 2006 ( MMVI) was a Common year starting on Sunday of the Gregorian calendar. Due to its Unicode equivalence, GB18030 supports both simplified and traditional Chinese characters.

An older version of the standard, known as "Chinese National Standard GB 18030-2000: Information Technology -- Chinese ideograms coded character set for information interchange -- Extension for the basic set", was published on March 17, 2000. Events 45 BC - In his last victory Julius Caesar defeats the Pompeian forces of Titus Labienus and Pompey the Younger 2000 ( MM) was a Leap year that started on Saturday of the Common Era, in accordance with the Gregorian calendar. The encoding scheme remains the same in the new version, except that code points for the characters ḿ and  have been exchanged. More code points are now associated to characters due to update of Unicode, especially the appearance of CJK Unified Ideographs Extension B. In Computing, Unicode is an Industry standard allowing Computers to consistently represent and manipulate text expressed in most of the world's CJK Unified Ideographs is a range of Unicode code points assigned for Ideographs used by Chinese characters. Some characters used by ethnic minorities in China, such as Mongolian characters and Tibetan characters, have been added as well, which accounts for the renaming of the standard. Ethnic minorities in China refer to the non- Han Chinese population in Mainland China and Taiwan. The classic vertical Mongolian script (ɣɣul bičig, cyrillic: Монгол бичиг Mongol bichig) was the first of many writing systems created The Tibetan script is an Abugida of Indic origin used to write the Tibetan language as well as the Dzongkha language, Ladakhi language

GB18030 can be considered a Unicode Transformation Format (i. In Computing, Unicode is an Industry standard allowing Computers to consistently represent and manipulate text expressed in most of the world's e. an encoding of all Unicode code points) that maintains compatibility with a legacy character set. In Computing, Unicode is an Industry standard allowing Computers to consistently represent and manipulate text expressed in most of the world's Like UTF-8, GB18030 is a superset of ASCII and can represent the whole range of Unicode code points; in addition, it is also a superset of GB2312. American Standard Code for Information Interchange ( ASCII) In Computing, Unicode is an Industry standard allowing Computers to consistently represent and manipulate text expressed in most of the world's GB18030 also maintains compatibility with Windows Codepage 936, sometimes known as GBK, which is Microsoft's extended version of GB2312, with the exception of the euro sign which is given a single byte code of 0x80 in Microsoft's later versions of GBK and a two byte code of A2 E3 in GB18030. GBK is an extension of the GB2312 Character set for simplified Chinese characters used in the People's Republic of China. The euro sign (€ is the Currency sign used for the Euro, the official currency of the European Union (EU GB 18030-2005 is also compatible with Chinese Internal Code Specification, Version 1. 0, known as GBK 1. 0, which is a slight extension of Windows Codepage 936 in 1995. Mapping to Unicode, however, has been modified for the 81 characters that were provisionally assigned a Unicode PUA code point in GBK 1. Unicode ’s 0 and that have later been encoded in Unicode. This is specified in Appendix E of GB 18030-2005. There are 14 characters in GB 18030-2005 that are still mapped to Unicode PUA.

Part of the mapping data is from a lookup table (similarly to GBK). The rest is calculated algorithmically. Unfortunately it also inherits the bad aspects of the legacy standards it's based on (most notably needing special code to safely find ASCII characters in a GB18030 sequence).

Most major computer companies had already standardised on some version of Unicode as the primary format for use in their binary formats and OS calls. However, they mostly had only supported code points in the BMP originally defined in Unicode 1. In Character encoding terminology a code point is any of the numerical values that make up the Codespace. See also Mapping of Unicode characters The Unicode characters can be categorized in many different ways Unicode code points can be logically divided into 17 0, which supported only 65,536 codepoints and was often encoded in 16 bits as UCS-2. In Computing, UTF-16 (16- Bit Unicode Transformation Format is a variable-length Character encoding for Unicode, capable of encoding

The mandatory part of GB 18030-2005 consists of 1 byte and 2 byte encoding, together with 4 byte encoding for CJK Unified Ideographs Extension A. CJK Unified Ideographs is a range of Unicode code points assigned for Ideographs used by Chinese characters. The corresponding Unicode code points of this subset lie entirely in the BMP.

In a move of historic significance for software supporting Unicode, the PRC decided to mandate support of certain code points outside the BMP. Talk People's Republic of China) PEOPLE'S REPUBLIC OF CHINA ARTICLE GUIDELINES This means that software can no longer get away with treating characters as 16 bit fixed width entities (UCS-2). In Computing, UTF-16 (16- Bit Unicode Transformation Format is a variable-length Character encoding for Unicode, capable of encoding Therefore they must either process the data in a variable width format (such as UTF-8 or UTF-16), which are the most common choices, or move to a larger fixed width format (such as UCS-4 or UTF-32). UTF-8 (8- Bit UCS / Unicode Transformation Format) is a variable-length Character encoding for Unicode. In Computing, UTF-16 (16- Bit Unicode Transformation Format is a variable-length Character encoding for Unicode, capable of encoding UTF-32 (or UCS-4) is a protocol for encoding Unicode characters that uses exactly 32 Bits for each Unicode Code point. UTF-32 (or UCS-4) is a protocol for encoding Unicode characters that uses exactly 32 Bits for each Unicode Code point. Microsoft made the change from UCS-2 to UTF-16 with Windows 2000.

Contents

GB18030 Support

Encoding

Windows 2000 can support the GB18030 encoding if GB18030 Support Package [1] is installed. Windows XP can support it natively.

More specifically, supporting the GB18030 encoding on Windows means that Code Page 54936 is supported by MultiByteToWideChar and WideCharToMultiByte. Due to the backward compatibility of the mapping, many files in GB18030 can be actually opened successfully as the legacy Code Page 936, that is GBK, even if the Code Page 54936 is not supported. However, that is only true when the file in question does not contain any character that does not exist in the Code Page 936, including most characters belonging to non-Chinese scripts (see below for examples).

Glyphs

GB18030 Support Package contains SimSun18030. ttc, a TrueType font collection file which combines two Chinese fonts, SimSun-18030 and NSimSun-18030.

The SimSun 18030 font includes all the characters in Unicode 2. 1 plus new characters found in the Unicode CJK Unified Ideographs Extension A section, but despite its name, it does not contain glyphs for all GB 18030 characters. Note that all (about a million) Unicode code points up to U+10FFFF can be encoded as GB 18030, hence “a font that fully supports GB 18030” would mean a font that contains glyphs for all Unicode characters, not only for CJK ones. HAN NOM A and HAN NOM B [2] are free fonts, which include all the characters in the Extension A and the Extension B, more exhaustive than SimSun-18030, or even than Simsun (Founder Extended), but they don't support all code points defined in Unicode 5. 0. 0 either.

Technical details

The four byte scheme can be thought of as consisting of two units, each of two bytes. Each unit has a similar format to a GBK two byte character but with a range of values for the second byte of 0x30-0x39 (the ASCII codes for decimal digits). American Standard Code for Information Interchange ( ASCII) The first byte has the range 0x81 to 0xFE, as before. This means that a string search routine that is safe for GBK should also be reasonably safe for GB18030 (in much the same way that a basic byte-oriented search routine is reasonably safe for EUC). Byte orientation refers to forms of Data processing in which Digital data are processed Bytewise For example Communication is called byte Extended Unix Code ( EUC) is a multibyte Character encoding system used primarily for Japanese, Korean, and Simplified Chinese.

This gives a total of 1,587,600 (126*10*126*10) possible 4 byte sequences, which is easily sufficient to cover Unicode's 1,112,046 (17 × 65536 - 2048 surrogates - 18 noncharacters) code points. In Computing, Unicode is an Industry standard allowing Computers to consistently represent and manipulate text expressed in most of the world's

Unfortunately, to further complicate matters there are no simple rules to translate between a 4 byte sequence and its corresponding code point. In Character encoding terminology a code point is any of the numerical values that make up the Codespace. Instead, codes are allocated sequentially (with the first byte containing the most significant part and the last the least significant part) only to Unicode code points that are not mapped in any other manner. For example:

U+00DE (Þ) → 81 30 89 37U+00DF (ß) → 81 30 89 38U+00E0 (à) → A8 A4U+00E1 (á) → A8 A2U+00E2 (â) → 81 30 89 39U+00E3 (ã) → 81 30 8A 30

See also

External links

© 2009 citizendia.org; parts available under the terms of GNU Free Documentation License, from http://en.wikipedia.org
 Dapyx Software network: MP3 Explorer | Ebook Manager | Zenithic