Skip to content
Snippets Groups Projects
  1. Aug 26, 2014
  2. Aug 21, 2014
  3. Aug 01, 2014
  4. Jul 24, 2014
  5. Jun 18, 2014
  6. Jun 17, 2014
  7. Jun 10, 2014
  8. May 24, 2014
  9. May 20, 2014
  10. May 06, 2014
  11. May 05, 2014
    • jshin@chromium.org's avatar
      Add back display names for non-UI languages in A-L list · 4266d6d1
      jshin@chromium.org authored
      I was too aggressive in trimming the data and dropped the display
      names for languages that Chromium needs (for non-UI languages
      that are in the A-L list). It's not my intention (the comment in
      trim_data.sh said one thing, but the code did another). 
      
      Besides, add Norweigian (nb) and Malay (ms) locale data that were not 
      included by mistake.
      
      Also update trim_data.sh script NOT to drop 'ALIAS' lines which are
      used to indicate that a given locale is an alias to another locale.
      That also required adding ro_MD.txt (null locale which mo.txt is 
      aliased to).
      
      The above three adds about 110kB to the icu data (from 10.3MB to 10.4MB).
      
      Also update the pre-built icu data files for Linux, Mac and Windows.
      The Android data will be updated in a follow-up patch.
      
      BUG=132145
      TEST=When ICU is rolled, unit_tests:ExtensionL10* pass.
      TBR=mark
      
      Review URL: https://codereview.chromium.org/264973016
      
      git-svn-id: http://src.chromium.org/svn/trunk/deps/third_party/icu52@268285 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
      4266d6d1
  12. Apr 30, 2014
  13. Apr 29, 2014
  14. Apr 28, 2014
    • jshin@chromium.org's avatar
      Add icudt.dll for Windows · 8df7e257
      jshin@chromium.org authored
      1. Generate and add windows/icudt.dll with the procedure outlined
      in README.chromium. It uses a out-of-tree copy of the upstream ICU
      along with our custom-built icudtl.dat and a locally modified version
      of makedata.mak.
      
      We used to have a separate build/ directory for VS solution/project files
      to build icudtl.dll. Maintaining them is rather cumbersom now that we
      want to update our ICU (major version changes) more frequently. 
      
      Note that icudt.dll is not used by default (icu_use_data_file_flag=1). 
      The GN build still uses it by default and we should not break that build.
      
      2. Add scripts/make_mac_assembly.sh to simplify the generation of the icu
      data assembly source file for Mac.
      
      3. Update README.chromium accordingly.
      
      This CL was uploaded and reviewed at 
      
      https://codereview.chromium.org/255943004/
      
      Due to a malfunction at codereview.chromium.org, I'm landing this CL 
      manually in two parts. 
      This check-in is the 2nd part of the CL dealing with #2 and #3
      above.
      
      BUG=132145
      TEST=None until icu is rolled to this version.
      
      
      git-svn-id: http://src.chromium.org/svn/trunk/deps/third_party/icu52@266602 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
      8df7e257
    • jshin@chromium.org's avatar
      Add icudt.dll for Windows · be1611ad
      jshin@chromium.org authored
      1. Generate and add windows/icudt.dll with the procedure outlined
      in README.chromium. It uses a out-of-tree copy of the upstream ICU
      along with our custom-built icudtl.dat and a locally modified version
      of makedata.mak.
      
      We used to have a separate build/ directory for VS solution/project files
      to build icudtl.dll. Maintaining them is rather cumbersom now that we
      want to update our ICU (major version changes) more frequently. 
      
      Note that icudt.dll is not used by default (icu_use_data_file_flag=1). 
      The GN build still uses it by default and we should not break that build.
      
      2. Add scripts/make_mac_assembly.sh to simplify the generation of the icu
      data assembly source file for Mac.
      
      3. Update README.chromium accordingly.
      
      This CL was uploaded and reviewed at 
      
      https://codereview.chromium.org/255943004/
      
      Due to a malfunction at codereview.chromium.org, I'm landing this CL 
      manually.
      
      BUG=132145
      TEST=None until icu is rolled to this version.
      
      
      git-svn-id: http://src.chromium.org/svn/trunk/deps/third_party/icu52@266601 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
      be1611ad
  15. Apr 24, 2014
  16. Apr 22, 2014
    • jshin@chromium.org's avatar
      Trim unit* sections in data/locales/* · 4a39040d
      jshin@chromium.org authored
      Add 'filter_locale_data' function to trim_data.sh
      
      Chromium/Blink do not use most of unit* sections in locale data. Keep
      only duration and compound sub-sections. 
      
      Update the icudtl.dat and two assembly source files for Mac/Linux.
      
      It saves ~200kB (uncompressed). 7z-compressed size reduction is 34kB.
      
      With all these changes (up to this CL) applied, the net increase of the ICU data from icu 46 to 52 is 49kB with 7z-compressed.
      (3,070,246 vs  3,021,457) and ~ 390kB uncompressed (10,370,656 vs 9,980,368 ). 
      
      BUG=132145
      TEST=None.
      TBR=mark
      
      Review URL: https://codereview.chromium.org/247663002
      
      git-svn-id: http://src.chromium.org/svn/trunk/deps/third_party/icu52@265354 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
      4a39040d
  17. Apr 21, 2014
  18. Apr 18, 2014
    • jshin@chromium.org's avatar
      Remove {big5,gb2312}han collation data · 991d1f1e
      jshin@chromium.org authored
      1. {big5,gb2312}han collation data is not used by anybody because they're
      useless as a sorting order.
      
        Add a function to trim_data.sh to remove them from zh.txt
      
      2. Remove remove_unihan.sh and add back unihan rules to coll/{zh,ja,ko}.txt.
      In ICU 52, tools/genrb does NOT include unihan collation by default so that 
      we don't have to bother to remove it from the rule files.
      
      3. Remove obsolete patch files (locale[23].patch)
      
      4. Add LICENSE file (converted from license.html)
      
      5. Update README.chromium accordingly.
      
      6. Check in the updated data file/assembly files.
      
      The net saving in icudtl.dat is ~ 220kB.
      
      
      BUG=132145
      TEST=icudtl.dat is 10576480
      TBR=mark
      
      Review URL: https://codereview.chromium.org/243763002
      
      git-svn-id: http://src.chromium.org/svn/trunk/deps/third_party/icu52@264857 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
      991d1f1e
    • jshin@chromium.org's avatar
      Trim ICU data to reduce the download size/memory usage · 4e493261
      jshin@chromium.org authored
      Add a shell script to trim the ICU data further : trim_data.sh along with
      locale list files.  The script does the following:
      
      1. Remove the display names of languages NOT listed in Chrome's Accept-Language
         list. (800kB)
      2. Minimize the locale data for locales listed in the A-L list that are
         not a UI locale in Chrome. For those locales, exemplar characters,
         the display name in the native language and layout direction are included.
         (640kB)
      3. Filter the region data to drop numeric region display names other than 419
         (Latin-America). (50kB)
      4. Filter the currency data (display name and plurals) for historic currencies.
         (200kB)
      
      This CL also checks in icudtl.dat (source/data/in) and
      icudt_dat.S (mac and linux). Note that I dropped '52' (the version number)
      in the assembly source file name and icu.gyp was adjusted accordingly.
      
      With all these changes, icudtl.dat is ~ 800kB larger than that in ICU 4.6.
      The 7z compression (as used by the installer) makes the size difference
      go down to ~ 130kB.
      
      BUG=132145
      TEST=The icudtl.dat (uncompressed) is about 10.7MB instead of 12.4MB without this CL.
      R=mark@chromium.org
      
      Review URL: https://codereview.chromium.org/239543018
      
      git-svn-id: http://src.chromium.org/svn/trunk/deps/third_party/icu52@264811 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
      4e493261
  19. Apr 17, 2014
  20. Apr 11, 2014
    • jshin@chromium.org's avatar
      ICU 52 local change part 2 · 1084fe06
      jshin@chromium.org authored
      Update patches/local1.patch
      
      1. Drop a lot of changes that have been upstreamed since ICU 4.6.x
      2. Keep and update exemplar character set for zh*, ja, Indic locales
      3. Make timezone names more consistent. Most of the inconsistencies have
         been fixed in the upstream, but there are still some remaining while
         others were fixed after ICU 52.1
      4. Minor fixes in other locale data : Date/interval formats, 
         AmPm markers (Indic locales), etc.
      
      BUG=76328
      TEST=None (when rolled, net_unittests:*IDN* passes).
      TBR=mark
      
      Review URL: https://codereview.chromium.org/232773005
      
      git-svn-id: http://src.chromium.org/svn/trunk/deps/third_party/icu52@263295 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
      1084fe06
  21. Apr 07, 2014
    • jshin@chromium.org's avatar
      ICU 52 local changes part1 · 4dfa619c
      jshin@chromium.org authored
      1. Remove all the obsolete patches. There are lots of them because most of
      local patches to ICU 4.6.1 have either been accepted or become obsolete.
      The largest local patch removed is our patches for CJ word breaker because
      they were upstreamed.
      
      Android didn't apply the CJK word breaker patch to ICU 4.6 to reduce the
      data size. In a follow-up CL, we'll have an Android-specific change for this issue.
      
      Besides, we don't include patches for files we locally add because the
      patches for new files are redundant. Instead, they're mentioned in
      README.chromium.
      
      2. We don't need platform-specific headers any more (pmac, plinux, pwin, etc).
      They're combined into a single file and all platforms we care about are
      well-supported except for one issue on Android/QNX. putil.patch takes care
      of it.
      
      
      3. Breakiterator patches for a few remaining issues. We also use
      a much smaller Khmer dictionary (upstream fix pending).
      
      4. Converter
        - Introduced two WHATWG-encoding-standard-compliant mapping tables
          are added (derived directly from the spec with a script) for EUC-JP
          and CP866
        - Disabled various non-HTML5-encodings such as SCSU,BOCU, UTF-7, CESU-8
          saving ~30kB in the code size. Even though we link statically, they're
          still pulled in as a part of uconv.
        - Disabled ISO-2022-JP-[1-4] in ucnv2022.c
        - Removed a number of encoding alias entries in the alias table
          leading to ~40kB data size reduction.
      
      5. Locale data : Haven't yet updated. We need to trim them substantially.
      
      6. Unihan collation removal is now done with a script (scripts/remove_unihan.sh)
      
      7. Updated timezone data to the latest (2014b) as of today.
      
      8. Customized transliterator for Greek uppercasing
      
      9. Updated data build related patches. The windows data build patch has yet
         to be updated.
      
      10. The updated ICU data file/assembly source files are not included in this
          CL. They'll be updated in a separate CL.
          With all the size reduction changes applied, the data size went down
          from > 23MB to 12.4MB. However, it's still 2.5MB larger than ICU 4.6.1
          data. The locale data trimming will bring it down further.
      
      11. Update README.chromium accordingly. The only exceptions are
      item #5 and the android entry in item #3 (breakiterator. see #1 above)
      
      
      
      BUG=259715,76328
      TEST=Following the procedure outlined in README.chromium, one can build
      the icu data file.
      
      R=jsbell@chromium.org, mark@chromium.org
      
      Review URL: https://codereview.chromium.org/224943002
      
      git-svn-id: http://src.chromium.org/svn/trunk/deps/third_party/icu52@262192 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
      4dfa619c
  22. Apr 03, 2014
  23. Apr 02, 2014
  24. Apr 01, 2014
  25. Mar 27, 2014
  26. Mar 26, 2014
    • jshin@chromium.org's avatar
      Check in the pristine copy of ICU 52.1 · 6f31ac30
      jshin@chromium.org authored
      The following directories we don't use are removed:
      
      as_is
      packaging
      source/layout
      source/layoutex
      
      Better plural formatting, updated locale data, the segmentation support
      for Chinese, Japanese (our code was upstreamed) and Khmer/Lao are among
      many improvements. EcmaScript I18N API also need this update to be compliant
      to the spec.
      
      Because codereview.chromium.org keeps giving me a 500 error when uploading
      the CL, so this initial check-in is done directly with svn.
      
      BUG=132145
      TEST=None
      
      
      git-svn-id: http://src.chromium.org/svn/trunk/deps/third_party/icu52@259715 4ff67af0-8c30-449e-8e8b-ad334ec8d88c
      6f31ac30
Loading