Unicode encoding issue – ne_10m_lakes.dbf

Home Forums General Announcements & General Questions Unicode encoding issue – ne_10m_lakes.dbf

This topic contains 2 replies, has 3 voices, and was last updated by  pfunes 3 years, 8 months ago.

Viewing 3 posts - 1 through 3 (of 3 total)
  • Author
  • #4872


    I have tried to load this file in a variety of ways (ArcGIS, Excel, DBF Viewer and through code) and cannot seem to get the correct encoding.

    For example, I get a row with ‘name’ = Pjrvi when the expected result is Pääjärvi.

    Does anyone else see this or do you see the correct value?  Any ideas about what I could do to correctly load the file?




    Graham Asher

    The trouble is, it seems (based on a bug report I made a long time ago) that the Natural Earth input scripts which are used to prepare the data ignore any character outside the ASCII range.

    I pointed out this bug but was told (I think) that there was no easy way to fix it, which must surely be wrong. I now can’t find my bug report, but I found a note here (http://www.naturalearthdata.com/blog/natural-earth-version-1-4-release-notes/) that one of my suggestions had been implemented – but not, it seems, the general solution.

    So somehow we have to persuade Natural Earth to accept the existence of non-ASCII characters in placenames.



    The ne_10m_populated_places file has similar issues on version 3.0.0 as of 6/5/2014.

    ne_10m_admin_1_provinces_and_states 3.0.0 DOES HAVE correct UTF-8 encoding for non-ASCII names but ne_10m_populated_places DOES NOT. Seemingly, the code to do the right thing, but care was not taken when produced some of the files, such as lakes and populated places.


Viewing 3 posts - 1 through 3 (of 3 total)

You must be logged in to reply to this topic.