1 # Copyright 2001-2010 Unicode, Inc.
5 # This source code is provided as is by Unicode, Inc. No claims are
6 # made as to fitness for any particular purpose. No warranties of any
7 # kind are expressed or implied. The recipient agrees to determine
8 # applicability of information provided. If this file has been
9 # purchased on magnetic or optical media from Unicode, Inc., the
10 # sole remedy for any claim will be exchange of defective media
11 # within 90 days of receipt.
13 # Limitations on Rights to Redistribute This Code
15 # Unicode, Inc. hereby grants the right to freely use the information
16 # supplied in this file in the creation of products supporting the
17 # Unicode Standard, and to make copies of this file in any form
18 # for internal or external distribution as long as this notice
21 ### Custom Normalization mappings for UTR#30
22 ### (http://www.unicode.org/reports/tr30/tr30-4.html)
24 ### Created from Unicode 5.2 UCD
27 # Removes diacritics, as defined by [:Diacritic:]
28 # These may or may not be combining marks
154 # Latin script "composed" that do not further decompose, so decompose here
155 # These are from AsciiFoldingFilter
492 # Cyrillic script "composed" that do not further decompose, so decompose here
493 # These are from UTR#30 DiacriticFolding.txt
522 # Additional signs and diacritic, from examination of [:Mark:]&[:Lm:]
557 # Additional Arabic/Hebrew decompositions
fnp / pylucene.git / blob