Skip to content

Auto upload queue continuously starting from the beginning again #10572

Description

@Clancy508

⚠️ Before posting ⚠️

  • This is a bug, not a question or an enhancement.
  • I've searched for similar issues and didn't find a duplicate.
  • I've written a clear and descriptive title for this issue, not just "Bug" or "Crash".
  • I agree to follow Nextcloud's Code of Conduct.

Steps to reproduce

Install latest version of Nextcloud Android (3.20.3)
Enable auto upload with existing files

Expected behaviour

Auto upload finishes. In the event of a crash auto upload resumes from last file rather than restarting from scratch.

Actual behaviour

As described by others, the app crashes prior to finishing auto upload. The behaviour that does not seem to be described by others is that every time Nextcloud reattempts auto upload it restarts the entire queue and checks each file one by one, so the upload pending list keeps resetting. Already uploaded files are not reuploaded as far as I can tell but constantly getting rechecked over and over against the server version instead of just keeping a local log of successful uploads.

If this constant restarting behaviour was fixed then the crashing wouldn't be a big deal as Nextcloud would eventually finish uploading and would then become reasonably stable.

Android version

12

Device brand and model

Samsung Note 20 Ultra

Stock or custom OS?

Stock

Nextcloud android app version

3.20.3

Nextcloud server version

24.0.1.1

Using a reverse proxy?

Yes

Android logs

No response

Server error logs

No response

Additional information

Don't have adb set up or available

Activity

  1. svenb1234 commented on Aug 14, 2022

    @svenb1234

    This does not only happen when it crashes. My impression is that there is a "retry timer" for failed uploads, e.g. because they cause a conflict. So if one has 1000 pictures to upload which cause a conflict each picture is tried, causes an error and is thus put into the "failed uploads section". If the 1000 pictures are not finished before the "retry timer" kicks in, they are queued again for upload. This causes an endless loop.

    Expected behaviour: do not retry anything while there is still something in the upload queue. Start the "retry timer" only after the active queue is empty.

  2. stoically commented on Nov 6, 2022

    @stoically

    Another observation: This also seems to happen when the android app loses connection to the server. I have a nightly cron job that restarts all docker containers, and sometimes the android app then gets stuck in an endless file check loop (HTTP 204). It's not reproducible, and the retrying stops after like 1-2 hours.

    Also the app itself is mostly frozen when this happens.

    Nextcloud server version: 25.0.0

  3. r3df0chs commented on Dec 29, 2022

    @r3df0chs

    In the last month i also have the feeling this problems happens more and more.
    My phone runs normally fine with the auto upload but i think since upgrade to Android 13 i see the reupload and File conflict dialogs much more often.

  4. Killea commented on May 23, 2023

    @Killea

    still have this issue with:
    android 3.24.2 and PHP 26.0.1

  5. dobos commented on May 31, 2023

    @dobos

    Same issue here, Android app 3.24.2, server running the latest docker image. Look like the upload thread (or thread pool) keeps crashing and then every time the upload counter jumps up to 5000+. I'm a new user, no historical experience but syncing 5000 images from a phone should be easy to handle. Any workarounds?

  6. dobos commented on May 31, 2023

    @dobos

    Also, I'm trying to get out of the endless loop by turning autouploads off directory by directory but even if I do so, the already scheduled upload operations remain in the queue and the apps tries to upload them anyway. Then they fails and everything starts again.

  7. r3df0chs commented on Jun 1, 2023

    @r3df0chs

    Also, I'm trying to get out of the endless loop by turning autouploads off directory by directory but even if I do so, the already scheduled upload operations remain in the queue and the apps tries to upload them anyway. Then they fails and everything starts again.

    One thing i do when the error appears.
    Let the app to try to upload and wait till some pictures fail (keep the upload window open or as you wrote, it restarts after switching again into the upload menu) after some times the pictures fail which was alredy uploaded. Then press the 3 Dot Menu in the Top right corner and "Clear failed uploads".
    So you can sort out the failed uploads and nextcloud do not try to upload them again.

  8. rchovan commented on Jun 8, 2023

    @rchovan

    This steps helped me:

    1. Force stop app Nextcloud in app manager
    2. clear cache
    3. run NC app
    4. go to upload
    5. clear finished and failed upload

    so far no upload loop

  9. changed the title [-]Auto upload endless loop[/-] [+]Auto upload queue continuously starting from the begging again[/+] on Nov 28, 2023
  10. changed the title [-]Auto upload queue continuously starting from the begging again[/-] [+]Auto upload queue continuously starting from the beginning again[/+] on Nov 28, 2023
  11. distante commented on Dec 31, 2023

    @distante

    As am trying to move my family to use nextcloud and this bug is causing them to reject it.

    I have a 4000+ photos folder that have to be copied (not moved!) to the nextcloud server. They had the "always ask if file already exist in server" option enabled in case that the file already exists.

    After a lot of uploaded files, the app is now asking what to do for each already uploaded file!

    I though the upload client does a checksum check of something, but looks like it just checks namefiles?

    I have no idea what to do now.

  12. distante commented on Dec 31, 2023

    @distante

    This steps helped me:

    1. Force stop app Nextcloud in app manager
    2. clear cache
    3. run NC app
    4. go to upload
    5. clear finished and failed upload

    so far no upload loop

    This cancels the loop, but how can we sure that all the existing files were correctly uploaded before?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions