Skip to content

The project exceeded the rate limit for creating and deleting buckets. #411

Description

@ryanseys

Currently our regression tests, which run on three different travis instances simultaneously and hit real Google servers, are hitting the rate limit for creating and deleting buckets in a small period of time and thus causing the tests to fail. These are likely safety limits imposed to all projects. We can turn off two of the three travis instances and just run on 0.12.x which should reduce our usage enough that we don't hit the rate limit or someone internal (@jgeewax) could attempt to win over the Google Cloud Storage Quota gods with chocolate and flowers.

Activity

  1. jgeewax commented on Feb 24, 2015

    @jgeewax
    Contributor

    /me buys flowers and chocolates.

    Assigning to myself to see if we can change the rate limit. What are the project IDs? And where do the credentials live on the testing machine? (Google will want to know the answer to this...)

  2. ryanseys commented on Feb 24, 2015

    @ryanseys
    ContributorAuthor

    The credentials live in Travis, along with the project ID which I don't know. I don't believe I have access to see them. You might be able to see them here if you have the right authority: https://travis-ci.org/GoogleCloudPlatform/gcloud-node/settings/env_vars

  3. self-assigned this
    on Feb 24, 2015
  4. added this to the Storage Future milestone on Feb 24, 2015
  5. stephenplusplus commented on Mar 5, 2015

    @stephenplusplus
    Contributor

    Any updates? Blocking our release of 0.12.

    I'm okay with removing iojs from Travis if you think that will fix it.

  6. jgeewax commented on Mar 13, 2015

    @jgeewax
    Contributor

    Do you guys know how many requests we make in a typical day or hour? This way I can make sure that if allowed, the respective teams can increase the quota correctly....

  7. ryanseys commented on Mar 13, 2015

    @ryanseys
    ContributorAuthor

    We're breaching the safety quotas for creating buckets and performing acl changes on buckets... there may be other quotas we are also hitting, I'm not sure. These quotas are per-minute... If we merge a couple commits or even run travis across different versions of node, it will hit these limits many times over so it's hard to say how many requests we need, though a good place to start counting would be our storage regression test file(s).

    https://cloud.google.com/appengine/docs/quotas#Safety_Quotas_and_Billable_Quotas

  8. stephenplusplus commented on Mar 31, 2015

    @stephenplusplus
    Contributor

    Should we let this go now that we have "backed off" of the servers?

  9. ryanseys commented on Mar 31, 2015

    @ryanseys
    ContributorAuthor

    I believe JJ is still assigned to convince them to increase our rate limits. We should see if that's still required after backing off.

  10. ryanseys commented on Apr 29, 2015

    @ryanseys
    ContributorAuthor

    I think we're over this.

  11. 38 remaining items

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

🚨This issue needs some love.api: storageIssues related to the Cloud Storage API.triage meI really want to be triaged.

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions