Repository navigation
Vertex AI Pipeline - PipelineJob run is still logging in background when sync is set to False #688
Description
Activity
- changed the title
[-]PipelineJob run is still logging in background when sync is set to False[/-][+]Vertex AI Pipeline - PipelineJob run is still logging in background when sync is set to False[/+]on Sep 3, 2021 Morning
any feedback on that?Morning
any feedback on that?Hi Sascha,
We plan to add a create API to handle the case where the intention is to create a PipelineJob but not monitor it's completion.
Thanks,
SashaHi everyone,
I just ran into the same bug with the "sync=False" flag not having the intended effect here, and would very much support any solution/possibility to trigger an async pipeline job run.
Best Regards,
AlexHi @adesso-alex, by 'not having the intended effect', do you mean the job is not async?
If you do
pl = PipelineJob( ... ) # Execute pipeline in Vertex pl.run( sync=False ) print('next action')'next action' was printed immediately after async call. I understand you might get confused over some pipelineJob comments being sent out after async, but that's just the side effect. In fact, the next line (if you have any) is run immediately after.
Hi @ji-yaqi,
you are right, that's the way it works right now. I see that this is the expected behavior.
It would be cool if, as requested, there would be a way to avoid a background thread just being created to do the logging/monitoring here.Thanks!
@adesso-alex we are working on a solution right now :) Thanks for you patience
Hello Google Team,
when running a PipelineJob in async mode it still logs the pipeline job status in the background.
This is particularly bad if we just want to use the Client Library to start a pipeline run. I would expect that no action is happening in the background when setting the sync mode to False
Best regards
Sascha