[Bug]: Alot of FILE_MISSING with bamarni/composer-bin-plugin

⚠️ This issue respects the following points: ⚠️

This is a bug, not a question or a configuration/webserver/proxy issue.
This issue is not already reported on Github OR Nextcloud Community Forum (I've searched it).
Nextcloud Server is up to date. See Maintenance and Release Schedule for supported versions.
I agree to follow Nextcloud's Code of Conduct.

Bug description

After a fresh install of Nextcloud 30.0.1 I get this: https://pastebin.com/XUMg1uwe

Steps to reproduce

Install Nextcloud with the Nextcloud VM scripts
Choose defaults
Login and run the setup check

Expected behavior

No errors since the VM only does everything with ./occ.

Nextcloud Server version

30

Operating system

Debian/Ubuntu

PHP engine version

PHP 8.3

Web server

Apache (supported)

Database engine version

PostgreSQL

Is this bug present after an update or on a fresh install?

Fresh Nextcloud Server install

Are you using the Nextcloud Server Encryption module?

Encryption is Disabled

What user-backends are you using?

Default user-backend (database)
LDAP/ Active Directory
SSO - SAML
Other

Configuration report

{
"system": {
"passwordsalt": "REMOVED SENSITIVE VALUE",
"secret": "REMOVED SENSITIVE VALUE",
"trusted_domains": [
"localhost",
"10.100.99.107",
"nextcloud",
"90.230.110.139"
],
"datadirectory": "REMOVED SENSITIVE VALUE",
"dbtype": "pgsql",
"version": "30.0.1.2",
"overwrite.cli.url": "https://nextcloud",
"dbname": "REMOVED SENSITIVE VALUE",
"dbhost": "REMOVED SENSITIVE VALUE",
"dbport": "",
"dbtableprefix": "oc_",
"dbuser": "REMOVED SENSITIVE VALUE",
"dbpassword": "REMOVED SENSITIVE VALUE",
"installed": true,
"instanceid": "REMOVED SENSITIVE VALUE",
"redis": {
"host": "REMOVED SENSITIVE VALUE",
"port": "0",
"dbindex": "0",
"timeout": "0.5",
"password": "REMOVED SENSITIVE VALUE"
},
"memcache.local": "\OC\Memcache\Redis",
"filelocking.enabled": "true",
"memcache.distributed": "\OC\Memcache\Redis",
"memcache.locking": "\OC\Memcache\Redis",
"upgrade.disable-web": true,
"log_type": "file",
"logfile": "/var/log/nextcloud/nextcloud.log",
"loglevel": "2",
"log.condition": {
"apps": [
"admin_audit"
]
},
"maintenance_window_start": 2,
"mail_smtpmode": "smtp",
"remember_login_cookie_lifetime": "1800",
"log_rotate_size": "10485760",
"trashbin_retention_obligation": "auto, 60",
"versions_retention_obligation": "auto, 180",
"activity_expire_days": "120",
"simpleSignUpLink.shown": false,
"default_phone_region": "se",
"logtimezone": "Europe/Stockholm",
"htaccess.RewriteBase": "/",
"preview_concurrency_new": "4",
"preview_concurrency_all": "8",
"enabledPreviewProviders": [
"OC\Preview\Imaginary",
"OC\Preview\Image",
"OC\Preview\MarkDown",
"OC\Preview\MP3",
"OC\Preview\TXT",
"OC\Preview\OpenDocument",
"OC\Preview\Movie",
"OC\Preview\Krita",
"OC\Preview\ImaginaryPDF"
],
"preview_imaginary_url": "REMOVED SENSITIVE VALUE",
"preview_max_x": "2048",
"preview_max_y": "2048",
"jpeg_quality": "60",
"preview_max_memory": "256",
"maintenance": false
}
}

List of activated Apps

Enabled:

activity: 3.0.0
admin_audit: 1.20.0
app_api: 4.0.0
bruteforcesettings: 3.0.0
calendar: 5.0.1
circles: 30.0.0-dev
cloud_federation_api: 1.13.0
collectives: 2.14.4
comments: 1.20.1
contacts: 6.1.0
contactsinteraction: 1.11.0
dashboard: 7.10.0
dav: 1.31.1
deck: 1.14.1
federatedfilesharing: 1.20.0
federation: 1.20.0
files: 2.2.0
files_downloadlimit: 3.0.0
files_pdfviewer: 3.0.0
files_reminders: 1.3.0
files_sharing: 1.22.0
files_trashbin: 1.20.1
files_versions: 1.23.0
firstrunwizard: 3.0.0
logreader: 3.0.0
lookup_server_connector: 1.18.0
mail: 4.0.2
nextcloud_announcements: 2.0.0
notifications: 3.0.0
oauth2: 1.18.1
password_policy: 2.0.0
photos: 3.0.2
privacy: 2.0.0
provisioning_api: 1.20.0
recommendations: 3.0.0
related_resources: 1.5.0
serverinfo: 2.0.0
settings: 1.13.0
sharebymail: 1.20.0
support: 2.0.0
survey_client: 2.0.0
systemtags: 1.20.0
text: 4.1.0
theming: 2.5.0
twofactor_backupcodes: 1.19.0
updatenotification: 1.20.0
user_status: 1.10.0
viewer: 3.0.0
weather_status: 1.10.0
webhook_listeners: 1.1.0-dev
workflowengine: 2.12.0
Disabled:
encryption: 2.18.0
extract: 1.3.6
files_external: 1.22.0
suspicious_login: 8.0.0
twofactor_nextcloud_notification: 4.0.0
twofactor_totp: 12.0.0-dev
user_ldap: 1.21.0

Nextcloud Signing status

Technical information

The following list covers which files have failed the integrity check. Please read
the previous linked documentation to learn more about the errors and how to fix
them.

Results

suspicious_login
- FILE_MISSING
  - vendor/bamarni/composer-bin-plugin/.makefile/touch.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario0/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario1/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario10/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario11/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario12/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario2/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario3/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario5/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario6/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario7/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario8/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario9/script.sh
  - vendor/rubix/tensor/.github/workflows/ci-ext.sh
photos
- FILE_MISSING
  - build-js/npm-post-build.sh
deck
- FILE_MISSING
  - .devcontainer/setup.sh
mail
- FILE_MISSING
  - l10n/preproc.sh
  - vendor/bamarni/composer-bin-plugin/.makefile/touch.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario0/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario1/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario10/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario11/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario12/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario2/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario3/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario5/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario6/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario7/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario8/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario9/script.sh
calendar
- FILE_MISSING
  - vendor/bamarni/composer-bin-plugin/.makefile/touch.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario0/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario1/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario10/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario11/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario12/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario2/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario3/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario5/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario6/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario7/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario8/script.sh
  - vendor/bamarni/composer-bin-plugin/e2e/scenario9/script.sh
twofactor_nextcloud_notification
- FILE_MISSING
  - build-js/npm-post-build.sh
collectives
- FILE_MISSING
  - vendor/predis/predis/docker/unstable_cluster/create_cluster.sh
recommendations
- FILE_MISSING
  - build-js/npm-post-build.sh
files_pdfviewer
- FILE_MISSING
  - build-js/npm-post-build.sh
related_resources
- FILE_MISSING
  - build/npm-post-build.sh

Raw output

Array
(
[suspicious_login] => Array
(
[FILE_MISSING] => Array
(
[vendor/bamarni/composer-bin-plugin/.makefile/touch.sh] => Array
(
[expected] => d28bd83c3e865caca37e54b29e3a07879fb02e1780c4c344c6a498591fc11ceb3e927f160728811797f9fa8c7695696b169ee16cfdbe5c58568367cc4c353010
[current] =>
)

)

Nextcloud Logs

NotFoundException /appdata_oc2jdg7b0n8o/theming/global
Error while running background job OCA\Theming\Jobs\MigrateBackgroundImages (id: 129, arguments: {"stage":"prepare"})

Additional info

No response

Thanks for the report 👍

~~mail/appinfo/signature.json indeed contains the hashes for the files in vendor-bin, however they are not shipped and therefore the warning.~~

My bad, I've looked at the wrong file. It's not ideal that we ship those .sh files, but they are part of the mail and calendar archives and therefore also in the signature file.

For some reason, they are now missing on your end.
Maybe antivirus blocking .sh files?

Maybe antivirus blocking .sh files?

You mean on the server or the webUI (client computer connecting)?

There's no antivirus at all actually. Not on the server and not on the connecting laptop. The laptop is Ubuntu 22.04, and server a 24.04 minimal, with only the listed apps installed, nothing else.

Thanks for looking into this!

We guess that something on your end does delete those .sh files. They are part of the release file and therefore also in the list of expected files/hashes.

Aaaah, now I think I know where the bugs comes from.

This must be it. https://github.com/nextcloud/vm/blob/main/nextcloud-startup-script.sh#L520

Yup, that's it!

root@next:/var/www/nextcloud# find /var/www/nextcloud -type f \( -name 'results' -o -name '*.sh*' \)

/var/www/nextcloud/apps/calendar/vendor/bamarni/composer-bin-plugin/e2e/scenario8/script.sh
/var/www/nextcloud/apps/calendar/vendor/bamarni/composer-bin-plugin/e2e/scenario1/script.sh
/var/www/nextcloud/apps/calendar/vendor/bamarni/composer-bin-plugin/e2e/scenario0/script.sh
/var/www/nextcloud/apps/calendar/vendor/bamarni/composer-bin-plugin/e2e/scenario10/script.sh
/var/www/nextcloud/apps/calendar/vendor/bamarni/composer-bin-plugin/e2e/scenario12/script.sh
/var/www/nextcloud/apps/calendar/vendor/bamarni/composer-bin-plugin/e2e/scenario11/script.sh
/var/www/nextcloud/apps/calendar/vendor/bamarni/composer-bin-plugin/e2e/scenario7/script.sh
/var/www/nextcloud/apps/calendar/vendor/bamarni/composer-bin-plugin/e2e/scenario2/script.sh
/var/www/nextcloud/apps/calendar/vendor/bamarni/composer-bin-plugin/e2e/scenario5/script.sh
/var/www/nextcloud/apps/calendar/vendor/bamarni/composer-bin-plugin/e2e/scenario3/script.sh
/var/www/nextcloud/apps/calendar/vendor/bamarni/composer-bin-plugin/e2e/scenario9/script.sh
/var/www/nextcloud/apps/calendar/vendor/bamarni/composer-bin-plugin/e2e/scenario6/script.sh
/var/www/nextcloud/apps/calendar/vendor/bamarni/composer-bin-plugin/.makefile/touch.sh
/var/www/nextcloud/apps/suspicious_login/vendor/rubix/tensor/.github/workflows/ci-ext.sh

Don't delete .sh files in ../nextcloud

Don't delete .sh files in ../nextcloud (#2694)

Logged issues to clean up our releases:

Navigation Menu

Repository navigation

[Bug]: Alot of FILE_MISSING with `bamarni/composer-bin-plugin` #48773

⚠️ This issue respects the following points: ⚠️

Bug description

Steps to reproduce

Expected behavior

Nextcloud Server version

Operating system

PHP engine version

Web server

Database engine version

Is this bug present after an update or on a fresh install?

Are you using the Nextcloud Server Encryption module?

What user-backends are you using?

Configuration report

List of activated Apps

Nextcloud Signing status

Technical information

Results

Raw output

Nextcloud Logs

Additional info

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

[Bug]: Alot of FILE_MISSING with bamarni/composer-bin-plugin #48773

Description

⚠️ This issue respects the following points: ⚠️

Bug description

Steps to reproduce

Expected behavior

Nextcloud Server version

Operating system

PHP engine version

Web server

Database engine version

Is this bug present after an update or on a fresh install?

Are you using the Nextcloud Server Encryption module?

What user-backends are you using?

Configuration report

List of activated Apps

Nextcloud Signing status

Technical information

Results

Raw output

Nextcloud Logs

Additional info

Activity

kesselb commented on Oct 17, 2024

enoch85 commented on Oct 17, 2024

kesselb commented on Oct 18, 2024

enoch85 commented on Oct 18, 2024

enoch85 commented on Oct 18, 2024

kesselb commented on Oct 18, 2024

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions

[Bug]: Alot of FILE_MISSING with `bamarni/composer-bin-plugin` #48773