Skip to content

Table scan on layer read in AccumuloLayerReader - #2163

Closed
echeipesh wants to merge 1 commit into
locationtech:masterfrom
echeipesh:fix/accumulo-full-layer-scan
Closed

echeipesh wants to merge 1 commit into
locationtech:masterfrom
echeipesh:fix/accumulo-full-layer-scan

Conversation

@echeipesh

Copy link
Copy Markdown
Contributor

This optimization is to avoid the current edge case of generating too many index ranges when performing table scan. Given the implementation in this PR the single unbounded Accumulo Range will be split across the index and will generate sub-range per existing tablet.

new AccumuloRange(new Text(AccumuloKeyEncoder.long2Bytes(min)), new Text(AccumuloKeyEncoder.long2Bytes(max)))
}
val decompose = { (bounds: KeyBounds[K]) =>
if (bounds == metadata.getComponent[Bounds[K]].get)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Kinda very unsafe .get call here.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think we're able to write a layer with EmptyKeyBounds, so this seemed safe to me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants