-
Notifications
You must be signed in to change notification settings - Fork 149
Closed
Description
When attempting to load some shapefiles and count the number of polygons, as follows
val data = sqlContext.read.format("magellan").load("path")
data.count()
I get counts of 0, or a number that is less than the appropriate number. I have verified the number of polygons that should be in the shapefiles in a variety of ways (geopandas/Python, QGIS, ogr2ogr web client).
I am using Spark 2.1 / Scala 2.11.
To be more specific,
I am attempting to load the US Census Block data for the various states (https://www.census.gov/cgi-bin/geo/shapefiles/index.php). I select the year, 2016, and layer type, Blocks.
Using the methodology aforementioned, I only see ~ 120k polygons for California and for other states, I get zero counts.
Metadata
Metadata
Assignees
Labels
No labels