History log of /freebsd/lib/libc/locale/gbk.c (Results 26 – 42 of 42)
Revision (<<< Hide revision tags) (Show revision tags >>>) Date Author Comments
# 9e0bd333 08-Nov-2003 Tim J. Robbins <tjr@FreeBSD.org>

Remove unused #includes.


# 90c7d99f 05-Nov-2003 Tim J. Robbins <tjr@FreeBSD.org>

Implement mbrtowc() and wcrtomb() directly (sync with big5.c).


Revision tags: release/4.9.0_cvs, release/4.9.0, release/5.1.0_cvs, release/5.1.0
# 9d793e98 01-Jun-2003 Andrey A. Chernov <ache@FreeBSD.org>

Add GBK encoding

PR: 51504
Submitted by: Statue <statue@freebsd.sinica.edu.tw>


Revision tags: release/7.4.0_cvs, release/8.2.0_cvs, release/7.4.0, release/8.2.0, release/8.1.0_cvs, release/8.1.0, release/7.3.0_cvs, release/7.3.0, release/8.0.0_cvs, release/8.0.0, release/7.2.0_cvs, release/7.2.0, release/7.1.0_cvs, release/7.1.0, release/6.4.0_cvs, release/6.4.0, release/7.0.0_cvs, release/7.0.0, release/6.3.0_cvs, release/6.3.0
# 367ed4e1 13-Oct-2007 Andrey A. Chernov <ache@FreeBSD.org>

The problem is: currently our single byte ctype(3) functions are broken
for wide characters locales in the argument range >= 0x80 - they may
return false positives.

Example 1: for UTF-8 locale we cu

The problem is: currently our single byte ctype(3) functions are broken
for wide characters locales in the argument range >= 0x80 - they may
return false positives.

Example 1: for UTF-8 locale we currently have:
iswspace(0xA0)==1 and isspace(0xA0)==1
(because iswspace() and isspace() are the same code)
but must have
iswspace(0xA0)==1 and isspace(0xA0)==0
(because there is no such character and all others in the range
0x80..0xff for the UTF-8 locale, it keeps ASCII only in the single byte
range because our internal wchar_t representation for UTF-8 is UCS-4).

Example 2: for all wide character locales isalpha(arg) when arg > 0xFF may
return false positives (must be 0).
(because iswalpha() and isalpha() are the same code)

This change address this issue separating single byte and wide ctype
and also fix iswascii() (currently iswascii() is broken for
arguments > 0xFF).
This change is 100% binary compatible with old binaries.

Reviewied by: i18n@

show more ...


Revision tags: release/6.2.0_cvs, release/6.2.0
# c879ae35 09-Jan-2007 Warner Losh <imp@FreeBSD.org>

Per Regents of the University of Calfornia letter, remove advertising
clause.

# If I've done so improperly on a file, please let me know.


Revision tags: release/5.5.0_cvs, release/5.5.0, release/6.1.0_cvs, release/6.1.0, release/6.0.0_cvs, release/6.0.0, release/5.4.0_cvs, release/5.4.0
# e94c6cb4 27-Feb-2005 Alexey Zelkin <phantom@FreeBSD.org>

. Static'ize functions exported via function reference variables only.
. Replace inclusion of sys/param.h to sys/cdefs.h and sys/types.h where
appropriate.
. move _*_init() prototypes to mblocal.h,

. Static'ize functions exported via function reference variables only.
. Replace inclusion of sys/param.h to sys/cdefs.h and sys/types.h where
appropriate.
. move _*_init() prototypes to mblocal.h, and remove these prototypes
from .c files
. use _none_init() in __setrunelocale() instead of duplicating code
. move __mb* variables from table.c to none.c allowing us to not to
export _none_*() externs, and appropriately remove them from mblocal.h

Ok'ed by: tjr

show more ...


Revision tags: release/4.11.0_cvs, release/4.11.0, release/5.3.0_cvs, release/5.3.0, release/4.10.0_cvs, release/4.10.0
# 61074767 17-May-2004 Tim J. Robbins <tjr@FreeBSD.org>

Use a simpler and faster buffering scheme for partial multibyte characters.


# f789f94d 13-May-2004 Tim J. Robbins <tjr@FreeBSD.org>

Fix braino in previous: check that the second byte in the character
buffer is non-null when the character is two bytes long, not when
the buffer is two bytes long.


# 2051a8f2 12-May-2004 Tim J. Robbins <tjr@FreeBSD.org>

Move prototypes of various encoding-related functions into a new header
file to avoid extern'ing them all over the place.


# 88af941a 11-May-2004 Tim J. Robbins <tjr@FreeBSD.org>

In the absence of proper validation, at least check that null bytes
do not appear as anything but the first byte of a multibyte character.


# fc813796 12-Apr-2004 Tim J. Robbins <tjr@FreeBSD.org>

Perform some basic validation of multibyte conversion state objects.


# fa02ee78 10-Apr-2004 Tim J. Robbins <tjr@FreeBSD.org>

Don't cast away const qualifiers.

Spotted by: bde


# ca2dae42 07-Apr-2004 Tim J. Robbins <tjr@FreeBSD.org>

Allow partial multibyte characters to accumulate in conversion state
objects passed to mbrtowc(), mbsrtowcs(), and mbrlen(), as required
by C99.


Revision tags: release/5.2.1_cvs, release/5.2.1, release/5.2.0_cvs, release/5.2.0
# 6abda1f0 19-Dec-2003 Andrey A. Chernov <ache@FreeBSD.org>

First byte of GBK-like sequences is 0x81, not 0x80


# 9e0bd333 08-Nov-2003 Tim J. Robbins <tjr@FreeBSD.org>

Remove unused #includes.


# 90c7d99f 05-Nov-2003 Tim J. Robbins <tjr@FreeBSD.org>

Implement mbrtowc() and wcrtomb() directly (sync with big5.c).


Revision tags: release/4.9.0_cvs, release/4.9.0, release/5.1.0_cvs, release/5.1.0
# 9d793e98 01-Jun-2003 Andrey A. Chernov <ache@FreeBSD.org>

Add GBK encoding

PR: 51504
Submitted by: Statue <statue@freebsd.sinica.edu.tw>


12