Skip to content

Resolved Path java serialization issue in HadoopGeoTiffRDD - #2105

Merged
lossyrob merged 1 commit into
locationtech:masterfrom
jbouffard:hadoopgeotiffrdd-fix
Mar 31, 2017
Merged

lossyrob merged 1 commit into
locationtech:masterfrom
jbouffard:hadoopgeotiffrdd-fix

Conversation

@jbouffard

Copy link
Copy Markdown
Contributor

Currently, HadoopGeoTiffRDD has an issue where setting both maxTileSize and numPartitions causes the reading to fail. This is due to a serialization problem where the default serializer cannot serialize/deserialize org.apache.hadoop.fs.Path. To fix this problem, the Paths were converted to URIs during the transformation of the input key.

This resolves #2103

@jbouffard
jbouffard force-pushed the hadoopgeotiffrdd-fix branch from 974718b to 871c16f Compare March 29, 2017 16:52
@pomadchin pomadchin changed the title Resolved Repartitioning issue with HadoopGeoTiffRDD Resolved Path java serialization issue in HadoopGeoTiffRDD Mar 29, 2017
@lossyrob lossyrob added this to the 1.1 milestone Mar 29, 2017
@jbouffard

Copy link
Copy Markdown
Contributor Author

@lossyrob This is ready for review.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Fix HadoopGeoTiffRDD Window Reading Error

3 participants