darkplaces/gmqcc
0
0
Fork 0
mirror of https://github.com/DarkPlacesEngine/gmqcc.git synced 2025-03-30 06:21:45 +00:00
Code Issues Projects Releases Packages Wiki Activity

Document what the utf8 table actually is

Browse source
This commit is contained in:
Dale Weiler 2013-10-10 22:10:36 -04:00
parent 3e362e872c
commit e263506b3f
1 changed files with 12 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

12
utf8.c
View file

@ -50,6 +50,18 @@
* In this table the transition values are pre-multiplied with 16 to
* save a shift instruction for every byte, we throw away fillers
* which makes the table smaller.
*
* The first section of the table handles bytes with leading C
* The second section of the table handles bytes with leading D
* The third section of the table handles bytes with leading E
* The last section of the table handles bytes with leading F
*
* The values themselfs in the table are arranged so that when you
* left shift them by 6 to shif continuation characters into palce, the
* new top bits tell:
*
* 1 - if you keep going
* 2 - the range of valid values for the next byte
*/
static const uint32_t utf8_tab[] = {
0xC0000002, 0xC0000003, 0xC0000004, 0xC0000005, 0xC0000006, 0xC0000007,