Avoid Authentication When Connecting to Storage Emulator

Problem
When connecting to a 3rd party storage emulator, like gcloud-storage-emulator, authentication is required. This requires injecting credentials into containers and adding conditional logic in code to authenticate when running against emulators.

import os
from firebase_admin import initialize_app, storage

os.environ['STORAGE_EMULATOR_HOST'] = 'http://localhost:9090'
assert 'GOOGLE_APPLICATION_CREDENTIALS' not in os.environ

initialize_app()
storage.bucket() # google.auth.exceptions.DefaultCredentialsError

Solution
When STORAGE_EMULATOR_HOST is set, use an insecure connection, as is done for firestore.

@stefanadelbert

@stefanadelbert For now i think you can use a class method create_anonymous_client which doesn't throw an error of credential.

from google.cloud import storage

client = storage.Client.create_anonymous_client()
client. project = 'project_name'
print (list(client.list_buckets()))

python-storage/google/cloud/storage/client.py

Lines 142 to 155 in 6a0b8a7

    
               def create_anonymous_client(cls): 
        
                   """Factory: return client with anonymous credentials. 
        
                   .. note:: 
        
                      Such a client has only limited access to "public" buckets: 
        
                      listing their contents and downloading their blobs. 
        
                   :rtype: :class:`google.cloud.storage.client.Client` 
        
                   :returns: Instance w/ anonymous credentials and no project. 
        
                   """ 
        
                   client = cls(project="<none>", credentials=AnonymousCredentials()) 
        
                   client.project = None 
        
                   return client

Is this issue abandoned?

It's quite annoying that you can't simply initiate the storage client if you ever intend to run tests.

client = storage.Client()

You always have to write some kind of wrapper like this.

if os.getenv("STORAGE_EMULATOR_HOST"):
    # Local testing etc.
    client = storage.Client.create_anonymous_client()
    client.project = "none"
else:
    # Normal usage
    client = storage.Client()

googleapis/python-storage/issues/324 is fixed

googleapis/python-storage/issues/324 is fixed (#127)

Navigation Menu

Repository navigation

Avoid Authentication When Connecting to Storage Emulator #324

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

	def create_anonymous_client(cls):
	"""Factory: return client with anonymous credentials.

	.. note::

	Such a client has only limited access to "public" buckets:
	listing their contents and downloading their blobs.

	:rtype: :class:`google.cloud.storage.client.Client`
	:returns: Instance w/ anonymous credentials and no project.
	"""
	client = cls(project="<none>", credentials=AnonymousCredentials())
	client.project = None
	return client

Avoid Authentication When Connecting to Storage Emulator #324

Description

Activity

HemangChothani commented on Nov 28, 2020

oittaa commented on Nov 24, 2021

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions