Skip to content
This repository was archived by the owner on May 16, 2026. It is now read-only.
This repository was archived by the owner on May 16, 2026. It is now read-only.

dataset.list_tables max_results parameter #173

Description

@OmriBromberg

I'm using great_expectations to test my data in BigQuery and the library introspects the entire database/schema for tables, meaning they use the function sa.inspect(engine).get_table_names(), because I have alot of tables this process is very very slow, I want to change the max_results parameter passed on to dataset.list_tables operation, when tested it increased performance dramatically

Activity

  1. self-assigned this
    on May 17, 2021
  2. jimfulton commented on May 25, 2021

    @jimfulton
    Contributor

    max_results doesn't really do what we want. We really want page_size.

    See googleapis/python-api-core#194

  3. jimfulton commented on Jun 3, 2021

    @jimfulton
    Contributor

    api_core has been updated. There's a bigquery PR: googleapis/python-bigquery#686

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

api: bigqueryIssues related to the googleapis/python-bigquery-sqlalchemy API.status: blockedResolving the issue is dependent on other work.type: feature request‘Nice-to-have’ improvement, new feature or different behavior or design.

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions