Skip to content

Logging flood in Openstack primary storage configuration #10737

Description

@remidebette

Hello!
First, thank you for the awesome work on Nextcloud. I administrate a server which has been running like a charm for a few years now.
I decided to migrate to Openstack Primary storage. I set up a new server that runs fine also.

But there is a log flood starting when the Admin user opens the UI Logging page: it was first mentioned here.

Steps to reproduce

  1. Use a nextcloud instance with Openstack primary storage
  2. Connect as an Admin user
  3. Go to the Logging page

Expected behaviour

On a clean and stable installation, no logs should display outside of standard usage logs

Actual behaviour

The error is the following:

Undefined index: bucket at /var/www/html/lib/private/Files/ObjectStore/Swift.php#81

tail -f /var/www/nextcloud/data/nextcloud.log shows that this error happens only when the admin opens the Logging UI. The server runs fine othewise.

Server configuration

Operating system:
Ubuntu 18.04.1 LTS

Web server:
Apache/2.4.29

Database:
PostgreSQL 10.5 (Ubuntu 10.5-0ubuntu0.18.04)

PHP version:
PHP 7.2.7-0ubuntu0.18.04.2

Nextcloud version: (see Nextcloud admin page)
Nextcloud 13.0.5

Updated from an older Nextcloud/ownCloud or fresh install:
Fresh install

Where did you install Nextcloud from:
Manually from Nextcloud latest zip

Signing status:

Signing status
No errors have been found.

List of activated apps:

App list
The process control (PCNTL) extensions are required in case you want to interrupt long running commands - see http://php.net/manual/en/book.pcntl.php
Enabled:
  - activity: 2.6.1
  - admin_audit: 1.3.0
  - admin_notifications: 1.0.1
  - announcementcenter: 3.2.1
  - bruteforcesettings: 1.1.0
  - calendar: 1.6.1
  - circles: 0.14.1
  - comments: 1.3.0
  - contacts: 2.1.5
  - dav: 1.4.7
  - deck: 0.4.1
  - federatedfilesharing: 1.3.1
  - federation: 1.3.0
  - files: 1.8.0
  - files_accesscontrol: 1.3.0
  - files_external: 1.4.1
  - files_markdown: 2.0.4
  - files_pdfviewer: 1.2.1
  - files_sharing: 1.5.0
  - files_texteditor: 2.5.1
  - files_trashbin: 1.3.0
  - files_versions: 1.6.0
  - files_videoplayer: 1.2.0
  - firstrunwizard: 2.2.1
  - gallery: 18.0.0
  - impersonate: 1.0.4
  - issuetemplate: 0.3.0
  - logreader: 2.0.0
  - lookup_server_connector: 1.1.0
  - nextcloud_announcements: 1.2.0
  - notes: 2.4.0
  - notifications: 2.1.2
  - oauth2: 1.1.1
  - password_policy: 1.3.0
  - provisioning_api: 1.3.0
  - richdocuments: 2.0.10
  - serverinfo: 1.3.0
  - sharebymail: 1.3.0
  - socialsharing_email: 1.0.3
  - survey_client: 1.1.0
  - systemtags: 1.3.0
  - theming: 1.4.5
  - twofactor_backupcodes: 1.2.3
  - twofactor_totp: 1.4.1
  - twofactor_u2f: 1.5.5
  - updatenotification: 1.3.0
  - user_external: 0.4
  - user_ldap: 1.3.1
  - workflowengine: 1.3.0
Disabled:
  - encryption
  - quota_warning
  - spreed

Nextcloud configuration:

Config report
The process control (PCNTL) extensions are required in case you want to interrupt long running commands - see http://php.net/manual/en/book.pcntl.php
{
    "system": {
        "objectstore": {
            "class": "OC\\Files\\ObjectStore\\Swift",
            "arguments": {
                "username": "***REMOVED SENSITIVE VALUE***",
                "password": "***REMOVED SENSITIVE VALUE***",
                "container": "***REMOVED SENSITIVE VALUE***",
                "objectPrefix": "oid:urn:",
                "autocreate": true,
                "region": "***REMOVED SENSITIVE VALUE***",
                "url": "https:\/\/auth.cloud.ovh.net\/v2.0\/",
                "tenantName": "***REMOVED SENSITIVE VALUE***",
                "serviceName": "swift"
            }
        },
        "trusted_domains": [
            "***REMOVED SENSITIVE VALUE***",
        ],
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "overwrite.cli.url": "http:\/\/localhost",
        "dbtype": "pgsql",
        "version": "13.0.5.2",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "logtimezone": "UTC",
        "ldapIgnoreNamingRules": false,
        "ldapUserCleanupInterval": "51",
        "memcache.local": "\\OC\\Memcache\\APCu",
        "filelocking.enabled": "true",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 6379,
            "timeout": 0
        },
        "appstore.experimental.enabled": true,
        "mail_smtpmode": "sendmail",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "updater.release.channel": "stable",
        "skeletondirectory": "",
        "trashbin_retention_obligation": "auto",
        "enable_previews": true,
        "loglevel": 1,
        "ldapProviderFactory": "\\OCA\\User_LDAP\\LDAPProviderFactory",
        "htaccess.RewriteBase": "\/"
    }
}

Are you using external storage, if yes which one: local/smb/sftp/...
Primary storage: Openstack.

Are you using encryption: yes/no
no

Are you using an external user-backend, if yes which one: LDAP/ActiveDirectory/Webdav/...
LDAP

LDAP configuration (delete this part if not used)

LDAP config
The process control (PCNTL) extensions are required in case you want to interrupt long running commands - see http://php.net/manual/en/book.pcntl.php
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Configuration                 |                                                                                                                 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+
| hasMemberOfFilterSupport      | 0                                                                                                               |
| hasPagedResultSupport         |                                                                                                                 |
| homeFolderNamingRule          | attr:uid                                                                                                        |
| lastJpegPhotoLookup           | 0                                                                                                               |
| ldapAgentName                 | ***REMOVED SENSITIVE VALUE***                                                                                     |
| ldapAgentPassword             | ***                                                                                                             |
| ldapAttributesForGroupSearch  |                                                                                                                 |
| ldapAttributesForUserSearch   |                                                                                                                 |
| ldapBackupHost                |                                                                                                                 |
| ldapBackupPort                |                                                                                                                 |
| ldapBase                      | ***REMOVED SENSITIVE VALUE***                                                                                              |
| ldapBaseGroups                |                                                                                                                 |
| ldapBaseUsers                 |                                                                                                                 |
| ldapCacheTTL                  | 600                                                                                                             |
| ldapConfigurationActive       | 1                                                                                                               |
| ldapDefaultPPolicyDN          |                                                                                                                 |
| ldapDynamicGroupMemberURL     |                                                                                                                 |
| ldapEmailAttribute            | mail                                                                                                            |
| ldapExperiencedAdmin          | 0                                                                                                               |
| ldapExpertUUIDGroupAttr       |                                                                                                                 |
| ldapExpertUUIDUserAttr        |                                                                                                                 |
| ldapExpertUsernameAttr        | uid                                                                                                             |
| ldapGidNumber                 | gidNumber                                                                                                       |
| ldapGroupDisplayName          | cn                                                                                                              |
| ldapGroupFilter               | (&(|(objectclass=posixGroup))(|(cn=***REMOVED SENSITIVE VALUE***)))                                         |
| ldapGroupFilterGroups         |                                                                                                                 |
| ldapGroupFilterMode           | 1                                                                                                               |
| ldapGroupFilterObjectclass    |                                                                                                                 |
| ldapGroupMemberAssocAttr      | memberUid                                                                                                       |
| ldapHost                      | localhost                                                                                                       |
| ldapIgnoreNamingRules         |                                                                                                                 |
| ldapLoginFilter               | (&(|(objectclass=inetOrgPerson)(objectclass=posixAccount))(|(uid=%uid)(|(mailPrimaryAddress=%uid)(mail=%uid)))) |
| ldapLoginFilterAttributes     |                                                                                                                 |
| ldapLoginFilterEmail          | 1                                                                                                               |
| ldapLoginFilterMode           | 0                                                                                                               |
| ldapLoginFilterUsername       | 1                                                                                                               |
| ldapNestedGroups              | 0                                                                                                               |
| ldapOverrideMainServer        |                                                                                                                 |
| ldapPagingSize                | 500                                                                                                             |
| ldapPort                      | 389                                                                                                             |
| ldapQuotaAttribute            |                                                                                                                 |
| ldapQuotaDefault              |                                                                                                                 |
| ldapTLS                       | 0                                                                                                               |
| ldapUserAvatarRule            | default                                                                                                         |
| ldapUserDisplayName           | uid                                                                                                             |
| ldapUserDisplayName2          |                                                                                                                 |
| ldapUserFilter                | (|(objectclass=inetOrgPerson)(objectclass=posixAccount))(objectclass=*)                                         |
| ldapUserFilterGroups          |                                                                                                                 |
| ldapUserFilterMode            | 1                                                                                                               |
| ldapUserFilterObjectclass     |                                                                                                                 |
| ldapUuidGroupAttribute        | auto                                                                                                            |
| ldapUuidUserAttribute         | auto                                                                                                            |
| turnOffCertCheck              | 0                                                                                                               |
| turnOnPasswordChange          | 0                                                                                                               |
| useMemberOfToDetectMembership | 1                                                                                                               |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+

Client configuration

Browser:
N/A

Operating system:
N/A

Logs

Nextcloud log (data/nextcloud.log)

Nextcloud log
Undefined index: bucket at /var/www/html/lib/private/Files/ObjectStore/Swift.php#81

Activity

  1. nextcloud-bot commented on Aug 17, 2018

    @nextcloud-bot
    Member

    GitMate.io thinks possibly related issues are #4730 (Storage), #60 (Configuring S3 and OpenStack Swift as Primary Storage), #5928 (Support for multiple primary storage?), #6019 (failure uploading files to external openstack storage), and #10022 (S3 Primary storage backup).

  2. MariusBluem commented on Aug 18, 2018

    @MariusBluem
    Member

    As this seems to be a setup issue I would like to ask you to raise your question in the forums: https://help.nextcloud.com

    If you wish support with setup issues from Nextcloud GmbH we offer this as part of the Nextcloud subscription. Learn more about this at https://nextcloud.com/enterprise/

  3. remidebette commented on Aug 18, 2018

    @remidebette
    Author
  4. remidebette commented on Sep 1, 2018

    @remidebette
    Author

    I did not see at first that this issue was simply closed.
    This is not a set up issue unless setting Swift primary storage is considered a set up issue in itself.

    Unless someone tells me from the data I shared that my configuration is not good, I believe my install is properly done. Files are created in the Swift instance.

    This bug of logs not working properly for Swift at least happened to one other person, could you have a look into it?
    Thank you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions