Skip to content

shapefiles only loading partially or not at all #97

@john-min

Description

@john-min

When attempting to load some shapefiles and count the number of polygons, as follows

val data = sqlContext.read.format("magellan").load("path")
data.count()

I get counts of 0, or a number that is less than the appropriate number. I have verified the number of polygons that should be in the shapefiles in a variety of ways (geopandas/Python, QGIS, ogr2ogr web client).

I am using Spark 2.1 / Scala 2.11.

To be more specific,
I am attempting to load the US Census Block data for the various states (https://www.census.gov/cgi-bin/geo/shapefiles/index.php). I select the year, 2016, and layer type, Blocks.

Using the methodology aforementioned, I only see ~ 120k polygons for California and for other states, I get zero counts.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions