xref: /freebsd/share/i18n/csmapper/APPLE/UCS%GURMUKHI.src (revision d0b2dbfa0ecf2bbc9709efc5e20baf8e4b44bbbf)
1
2TYPE		ROWCOL
3NAME		UCS/GURMUKHI
4SRC_ZONE	0x0000-0x2212
5OOB_MODE	INVALID
6DST_INVALID	0x100
7DST_UNIT_BITS	16
8#=======================================================================
9#   File name:  GURMUKHI.TXT
10#
11#   Contents:   Map (external version) from Mac OS Gurmukhi
12#               encoding to Unicode 2.1 and later.
13#
14#   Copyright:  (c) 1997-2002, 2005 by Apple Computer, Inc., all rights
15#               reserved.
16#
17#   Contact:    charsets@apple.com
18#
19#   Changes:
20#
21#       c02  2005-Apr-05    Update header comments. Matches internal xml
22#                           <c1.1> and Text Encoding Converter 2.0.
23#      b3,c1 2002-Dec-19    Change mappings for 0x91, 0xD5 based on
24#							new decomposition rules. Update URLs,
25#                           notes. Matches internal utom<b2>.
26#       b02  1999-Sep-22    Update contact e-mail address. Matches
27#                           internal utom<b1>, ufrm<b1>, and Text
28#                           Encoding Converter version 1.5.
29#       n02  1998-Feb-05    First version; matches internal utom<n5>,
30#                           ufrm<n6>.
31#
32# Standard header:
33# ----------------
34#
35#   Apple, the Apple logo, and Macintosh are trademarks of Apple
36#   Computer, Inc., registered in the United States and other countries.
37#   Unicode is a trademark of Unicode Inc. For the sake of brevity,
38#   throughout this document, "Macintosh" can be used to refer to
39#   Macintosh computers and "Unicode" can be used to refer to the
40#   Unicode standard.
41#
42#   Apple Computer, Inc. ("Apple") makes no warranty or representation,
43#   either express or implied, with respect to this document and the
44#   included data, its quality, accuracy, or fitness for a particular
45#   purpose. In no event will Apple be liable for direct, indirect,
46#   special, incidental, or consequential damages resulting from any
47#   defect or inaccuracy in this document or the included data.
48#
49#   These mapping tables and character lists are subject to change.
50#   The latest tables should be available from the following:
51#
52#   <http://www.unicode.org/Public/MAPPINGS/VENDORS/APPLE/>
53#
54#   For general information about Mac OS encodings and these mapping
55#   tables, see the file "README.TXT".
56#
57# Format:
58# -------
59#
60#   Three tab-separated columns;
61#   '#' begins a comment which continues to the end of the line.
62#     Column #1 is the Mac OS Gurmukhi code or code sequence
63#       (in hex as 0xNN or 0xNN+0xNN)
64#     Column #2 is the corresponding Unicode or Unicode sequence
65#       (in hex as 0xNNNN or 0xNNNN+0xNNNN).
66#     Column #3 is a comment containing the Unicode name or sequence
67#       of names. In some cases an additional comment follows the
68#       Unicode name(s).
69#
70#   The entries are in two sections. The first section is for pairs of
71#   Mac OS Gurmukhi code points that must be mapped in a special way.
72#   The second section maps individual code points.
73#
74#   Within each section, the entries are in Mac OS Gurmukhi code order.
75#
76#   Control character mappings are not shown in this table, following
77#   the conventions of the standard UTC mapping tables. However, the
78#   Mac OS Gurmukhi character set uses the standard control characters
79#   at 0x00-0x1F and 0x7F.
80#
81# Notes on Mac OS Gurmukhi:
82# -------------------------
83#
84#   This is a legacy Mac OS encoding; in the Mac OS X Carbon and Cocoa
85#   environments, it is only supported via transcoding to and from
86#   Unicode.
87#
88#   Mac OS Gurmukhi is based on IS 13194:1991 (ISCII-91), with the
89#   addition of several punctuation and symbol characters. However,
90#   Mac OS Gurmukhi does not support the ATR (attribute) mechanism of
91#   ISCII-91.
92#
93# 1. ISCII-91 features in Mac OS Gurmukhi include:
94#
95#  a) Explicit halant and soft halant
96#
97#     A double halant (0xE8 + 0xE8) constitutes an "explicit halant",
98#     which will always appear as a halant instead of causing formation
99#     of a ligature or half-form consonant.
100#
101#     Halant followed by nukta (0xE8 + 0xE9) constitutes a "soft
102#     halant", which prevents formation of a ligature and instead
103#     retains the half-form of the first consonant.
104#
105#  b) Invisible consonant
106#
107#     The byte 0xD9 (called INV in ISCII-91) is an invisible consonant:
108#     It behaves like a consonant but has no visible appearance. It is
109#     intended to be used (often in combination with halant) to display
110#     dependent forms in isolation, such as the RA forms or consonant
111#     half-forms.
112#
113#  c) Extensions for Vedic, etc.
114#
115#     The byte 0xF0 (called EXT in ISCII-91) followed by any byte in
116#     the range 0xA1-0xEE constitutes a two-byte code point which can
117#     be used to represent additional characters for Vedic (or other
118#     extensions); 0xF0 followed by any other byte value constitutes
119#     malformed text. Mac OS Gurmukhi supports this mechanism, but
120#     does not currently map any of these two-byte code points to
121#     anything.
122#
123# 2. Mac OS Gurmukhi additions
124#
125#   Mac OS Gurmukhi adds characters using the code points
126#   0x80-0x8A and 0x90-0x94 (the latter are some Gurmukhi additions).
127#
128# 3. Unused code points
129#
130#   The following code points are currently unused, and are not shown
131#   here: 0x8B-0x8F, 0x95-0xA1, 0xA3, 0xAA-0xAB, 0xAE-0xAF, 0xB2,
132#   0xC7, 0xCE, 0xD0, 0xD2-0xD3, 0xD6, 0xDF-0xE0, 0xE3-0xE4, 0xE7,
133#   0xEB-0xEF, 0xFB-0xFF. In addition, 0xF0 is not shown here, but it
134#   has a special function as described above.
135#
136# Unicode mapping issues and notes:
137# ---------------------------------
138#
139# 1. Mapping the byte pairs
140#
141#   If the byte value 0xE8 is encountered when mapping Mac OS
142#   Gurmukhi text, then the next byte (if there is one) should be
143#   examined. If the next byte is 0xE8 or 0xE9, then the byte pair
144#   should be mapped using the first section of the mapping table
145#   below. Otherwise, each byte should be mapped using the second
146#   section of the mapping table below.
147#
148#   - The Unicode Standard, Version 2.0, specifies how explicit
149#     halant and soft halant should be represented in Unicode;
150#     these mappings are used below.
151#
152#   If the byte value 0xF0 is encountered when mapping Mac OS
153#   Gurmukhi text, then the next byte should be examined. If there
154#   is no next byte (e.g. 0xF0 at end of buffer), the mapping
155#   process should indicate incomplete character. If there is a next
156#   byte but it is not in the range 0xA1-0xEE, the mapping process
157#   should indicate malformed text. Otherwise, the mapping process
158#   should treat the byte pair as a valid two-byte code point with no
159#   mapping (e.g. map it to QUESTION MARK, REPLACEMENT CHARACTER,
160#   etc.).
161#
162# 2. Mapping the invisible consonant
163#
164#   It has been suggested that INV in ISCII-91 should map to ZERO
165#   WIDTH NON-JOINER in Unicode. However, this causes problems with
166#   roundtrip fidelity: The ISCII-91 sequences 0xE8+0xE8 and 0xE8+0xD9
167#   would map to the same sequence of Unicode characters. We have
168#   instead mapped INV to LEFT-TO-RIGHT MARK, which avoids these
169#   problems.
170#
171# 3. Mappings using corporate characters
172#
173#   Mapping the GURMUKHI LETTER SHA 0xD5 presents an interesting
174#   problem. At first glance, we could map it to the single Unicode
175#   character 0x0A36.
176#
177#   However, our goal is that the mappings provided here should also
178#   be able to generate the mappings to maximally decomposed Unicode
179#   by simple recursive substitution of the canonical decompositions
180#   in the Unicode database. We want mapping tables derived this way
181#   to retain full roundtrip fidelity.
182#
183#   Since the canonical decomposition of 0x0A36 is 0x0A38+0x0A3C,
184#   the decomposition mapping for 0xD5 would be identical with the
185#   decomposition mapping for 0xD7+0xE9, and roundtrip fidelity would
186#   be lost.
187#
188#   We solve this problem by using a grouping hint (one of the set of
189#   transcoding hints defined by Apple).
190#
191#   Apple has defined a block of 32 corporate characters as "transcoding
192#   hints." These are used in combination with standard Unicode characters
193#   to force them to be treated in a special way for mapping to other
194#   encodings; they have no other effect. Sixteen of these transcoding
195#   hints are "grouping hints" - they indicate that the next 2-4 Unicode
196#   characters should be treated as a single entity for transcoding. The
197#   other sixteen transcoding hints are "variant tags" - they are like
198#   combining characters, and can follow a standard Unicode (or a sequence
199#   consisting of a base character and other combining characters) to
200#   cause it to be treated in a special way for transcoding. These always
201#   terminate a combining-character sequence.
202#
203#   The transcoding coding hint used in this mapping table is:
204#     0xF860 group next 2 characters
205#
206#   Then we can map 0x91 as follows:
207#     0xD5 -> 0xF860+0x0A38+0x0A3C
208#
209#   We could also have used a variant tag such as 0xF87F and mapped it
210#   this way:
211#     0xD5 -> 0x0A36+0xF87F
212#
213# 4. Additional loose mappings from Unicode
214#
215#   These are not preserved in roundtrip mappings.
216#
217#   0A59 -> 0xB4+0xE9   # GURMUKHI LETTER KHHA
218#   0A5A -> 0xB5+0xE9   # GURMUKHI LETTER GHHA
219#   0A5B -> 0xBA+0xE9   # GURMUKHI LETTER ZA
220#   0A5E -> 0xC9+0xE9   # GURMUKHI LETTER FA
221#
222#   0A70 -> 0xA2    # GURMUKHI TIPPI
223#
224#   Loose mappings from Unicode should also map U+0A71 (GURMUKHI ADDAK)
225#   followed by any Gurmukhi consonant to the equivalent ISCII-91
226#   consonant plus halant plus the consonant again. For example:
227#
228#   0A71+0A15 -> 0xB3+0xE8+0xB3
229#   0A71+0A16 -> 0xB4+0xE8+0xB4
230#   ...
231#
232# Details of mapping changes in each version:
233# -------------------------------------------
234#
235#   Changes from version b02 to version b03/c01:
236#
237#   - Change mapping of 0x91 from 0xF860+0x0A21+0x0A3C to 0x0A5C GURMUKHI
238#     LETTER RRA, now that the canonical decomposition of 0x0A5C to
239#     0x0A21+0x0A3C has been deleted
240#
241#   - Change mapping of 0xD5 from 0x0A36 GURMUKHI LETTER SHA to
242#     0xF860+0x0A38+0x0A3C, now that a canonical decomposition of 0x0A36
243#     to 0x0A38+0x0A3C has been added.
244#
245##################
246BEGIN_MAP
2470x0000 - 0x007F = 0x00 -
2480x00A9 = 0x88
2490x00AE = 0x89
2500x00D7 = 0x80
2510x0964 = 0xEA
2520x0A02 = 0xA2
2530x0A05 = 0xA4
2540x0A06 = 0xA5
2550x0A07 = 0xA6
2560x0A08 = 0xA7
2570x0A09 = 0xA8
2580x0A0A = 0xA9
2590x0A0F = 0xAC
2600x0A10 = 0xAD
2610x0A13 = 0xB0
2620x0A14 = 0xB1
2630x0A15 = 0xB3
2640x0A16 = 0xB4
2650x0A17 = 0xB5
2660x0A18 = 0xB6
2670x0A19 = 0xB7
2680x0A1A = 0xB8
2690x0A1B = 0xB9
2700x0A1C = 0xBA
2710x0A1D = 0xBB
2720x0A1E = 0xBC
2730x0A1F = 0xBD
2740x0A20 = 0xBE
2750x0A21 = 0xBF
2760x0A22 = 0xC0
2770x0A23 = 0xC1
2780x0A24 = 0xC2
2790x0A25 = 0xC3
2800x0A26 = 0xC4
2810x0A27 = 0xC5
2820x0A28 = 0xC6
2830x0A2A = 0xC8
2840x0A2B = 0xC9
2850x0A2C = 0xCA
2860x0A2D = 0xCB
2870x0A2E = 0xCC
2880x0A2F = 0xCD
2890x0A30 = 0xCF
2900x0A32 = 0xD1
2910x0A35 = 0xD4
2920x0A38 = 0xD7
2930x0A39 = 0xD8
2940x0A3C = 0xE9
2950x0A3E = 0xDA
2960x0A3F = 0xDB
2970x0A40 = 0xDC
2980x0A41 = 0xDD
2990x0A42 = 0xDE
3000x0A47 = 0xE1
3010x0A48 = 0xE2
3020x0A4B = 0xE5
3030x0A4C = 0xE6
3040x0A4D = 0xE8
305#0x0A4D+0x200C = 0xE8+0xE8
306#0x0A4D+0x200D = 0xE8+0xE9
3070x0A5C = 0x91
3080x0A66 = 0xF1
3090x0A67 = 0xF2
3100x0A68 = 0xF3
3110x0A69 = 0xF4
3120x0A6A = 0xF5
3130x0A6B = 0xF6
3140x0A6C = 0xF7
3150x0A6D = 0xF8
3160x0A6E = 0xF9
3170x0A6F = 0xFA
3180x0A71 = 0x90
3190x0A72 = 0x93
3200x0A73 = 0x92
3210x0A74 = 0x94
3220x200E = 0xD9
3230x2013 = 0x82
3240x2014 = 0x83
3250x2018 = 0x84
3260x2019 = 0x85
3270x2022 = 0x87
3280x2026 = 0x86
3290x2122 = 0x8A
3300x2212 = 0x81
331#0xF860+0x0A38+0x0A3C = 0xD5
332END_MAP
333