Repository navigation
Random Auth Errors with BigQuery #2139
Description
Activity
@stephenplusplus This smells like a rate limit to me, other than the error message. Might this be a case where we are clobbering an error?
I don't think we're clobbering it, just judging by the error message not being one that we've written. Before every request, we do a token grab, refreshing if necessary (that work is done by google-auth-library).
With this large amount of requests, maybe we need a larger safety window around the expiration timestamp for when the auth client makes the grab. @jmdobry does that sound possible? (please re-tag if someone else is closer to the auth library code)
@ofrobots wdyt?
Friendly re-ping.
This issue was moved to googleapis/google-auth-library-nodejs#133
We haven't been able to attract the right attention over here, so I've moved the issue to the source of the error (I think). googleapis/google-auth-library-nodejs#133
Can please we keep this open so I can easily track it?
For tracking, just subscribe to the new issue with the button in the right column: googleapis/google-auth-library-nodejs#133 -- I assumed you'd be automatically subscribed because of the
@mention of your name over there, but it wouldn't hurt to confirm.
Insert calls to BigQuery randomly result in auth errors.
I have a job that is responsible for sending data in bulk to BigQuery by using
.insert([ 'lots', 'of', 'items' ])repeatedly in synchronous fashion. This process goes on for hours at a time, callinginsertafter the prior operation finishes.After a few hours, my calls to BigQuery abruptly fail. I'm not sure if this issue is time-related or the call itself randomly fails. It does seem to occur after a few hours. This happens repeatedly.
Error:
Environment details
@google-cloud/bigqueryversion: 0.8.0Steps to reproduce
The above description tells it all, but I'm working on a script. I'll update this if I can find a way to reproduce in a more predictable manner.