Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rsync and cp commands hang #85

Open
triszalo opened this issue Dec 23, 2024 · 1 comment
Open

rsync and cp commands hang #85

triszalo opened this issue Dec 23, 2024 · 1 comment

Comments

@triszalo
Copy link

Dear all!

The issue

I was using pcloudcc (https://github.com/pcloudcom/console-client) on my RPi 4 for creating automatic backup from the pCloud to a hdd. I have services for doing the job, but the relevant part is, that an rsync command is run regularly.
One day I found, that the rsync command hangs for unlimited time, without any cpu, disk or network activity.

Investigation

During the investigation at an early phase I discovered this project, so I removed the old pcloudcc installation and installed this one. I am very happy and thankful, that there is an AUR package for that, so I could install it this simple way:

[admin@****** ~]$ yay -Syu pcloudcc-lneely
:: A csomagadatbázisok szinkronizálása...
core naprakész
extra naprakész
alarm naprakész
aur naprakész
:: Searching AUR for updates...
:: Searching databases for updates...
:: 1 package to upgrade/install.
1  aur/pcloudcc-lneely   -> 20240825T2000Z-2
==> Packages to exclude: (eg: "1 2 3", "1-3", "^4" or repo name)
 -> Excluding packages may cause partial upgrades and break systems
==>
AUR Explicit (1): pcloudcc-lneely-20240825T2000Z-2
:: (1/1) Downloaded PKGBUILD: pcloudcc-lneely
  1 pcloudcc-lneely                          (Build Files Exist)
==> Packages to cleanBuild?
==> [N]one [A]ll [Ab]ort [I]nstalled [No]tInstalled or (1 2 3, 1-3, ^4)
==>
  1 pcloudcc-lneely                          (Build Files Exist)
==> Diffs to show?
==> [N]one [A]ll [Ab]ort [I]nstalled [No]tInstalled or (1 2 3, 1-3, ^4)
==> N
==> HIBA: pcloudcc-lneely nem érhető el 'armv7h' architektúrára.
 -> error downloading sources: /home/admin/.cache/yay/pcloudcc-lneely
         context: exit status 12


:: (1/1) Parsing SRCINFO: pcloudcc-lneely
 -> The following packages are not compatible with your architecture:
  pcloudcc-lneely
:: Try to build them anyway? [Y/n]
==> Csomag készítése: pcloudcc-lneely 20240825T2000Z-2 (2024. dec. 23., hétfő, 10:22:10 CET)
==> Futtatási függőségek ellenőrzése...
==> Fordítási függőségek ellenőrzése...
==> Források letöltése...
  -> pcloudcc-lneely-20240825T2000Z.tar.gz letöltése...
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  471k    0  471k    0     0  1005k      0 --:--:-- --:--:-- --:--:-- 1006k
==> source fájl eredetiségének ellenőrzése ezzel: sha256sums...
    pcloudcc-lneely-20240825T2000Z.tar.gz ... Rendben
==> Meglévő $srcdir/ könyvtár eltávolítása...
==> Források kibontása...
  -> pcloudcc-lneely-20240825T2000Z.tar.gz kibontása a(z) bsdtar programmal
==> A források készen állnak.
==> Csomag készítése: pcloudcc-lneely 20240825T2000Z-2 (2024. dec. 23., hétfő, 10:22:19 CET)
==> Futtatási függőségek ellenőrzése...
==> Fordítási függőségek ellenőrzése...
==> FIGYELMEZTETÉS: Meglévő $srcdir/ könyvtár használata
==> build() indítása...
g++ -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -O2 -DNDEBUG -c -o control_tools.o control_tools.cpp
g++ -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -O2 -DNDEBUG -c -o main.o main.cpp
g++ -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -O2 -DNDEBUG -c -o pclsync_lib.o pclsync_lib.cpp
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o debug.o pclsync/debug.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o overlay_client.o pclsync/overlay_client.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o papi.o pclsync/papi.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pasyncnet.o pclsync/pasyncnet.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pbusinessaccount.o pclsync/pbusinessaccount.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pcache.o pclsync/pcache.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pcallbacks.o pclsync/pcallbacks.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pcloudcrypto.o pclsync/pcloudcrypto.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pcompat.o pclsync/pcompat.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pcompression.o pclsync/pcompression.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pcontacts.o pclsync/pcontacts.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pcrc32c.o pclsync/pcrc32c.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pcrypto.o pclsync/pcrypto.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pdevice_monitor.o pclsync/pdevice_monitor.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pdiff.o pclsync/pdiff.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pdownload.o pclsync/pdownload.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pexternalstatus.o pclsync/pexternalstatus.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pfileops.o pclsync/pfileops.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pfolder.o pclsync/pfolder.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pfs.o pclsync/pfs.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pfscrypto.o pclsync/pfscrypto.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pfsfolder.o pclsync/pfsfolder.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pfsstatic.o pclsync/pfsstatic.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pfstasks.o pclsync/pfstasks.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pfsupload.o pclsync/pfsupload.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pfsxattr.o pclsync/pfsxattr.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pintervaltree.o pclsync/pintervaltree.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o plibs.o pclsync/plibs.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o plist.o pclsync/plist.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o plocalnotify.o pclsync/plocalnotify.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o plocalscan.o pclsync/plocalscan.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o plocks.o pclsync/plocks.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pmemlock.o pclsync/pmemlock.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pnetlibs.o pclsync/pnetlibs.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pnotifications.o pclsync/pnotifications.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o poverlay.o pclsync/poverlay.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pp2p.o pclsync/pp2p.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o ppagecache.o pclsync/ppagecache.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o ppassword.o pclsync/ppassword.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o ppathstatus.o pclsync/ppathstatus.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o prunratelimit.o pclsync/prunratelimit.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pscanner.o pclsync/pscanner.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o psettings.o pclsync/psettings.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pssl.o pclsync/pssl.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pstatus.o pclsync/pstatus.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o psyncer.o pclsync/psyncer.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o psynclib.o pclsync/psynclib.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o ptasks.o pclsync/ptasks.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o ptimer.o pclsync/ptimer.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o ptools.o pclsync/ptools.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o ptree.o pclsync/ptree.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o publiclinks.o pclsync/publiclinks.c
gcc -fPIC  -I./pclsync -I/usr/include -I/usr/include/mbedtls2 -O2 -DNDEBUG -c -o pupload.o pclsync/pupload.c
g++ -o pcloudcc control_tools.o main.o pclsync_lib.o debug.o overlay_client.o papi.o pasyncnet.o pbusinessaccount.o pcache.o pcallbacks.o pcloudcrypto.o pcompat.o pcompression.o pcontacts.o pcrc32c.o pcrypto.o pdevice_monitor.o pdiff.o pdownload.o pexternalstatus.o pfileops.o pfolder.o pfs.o pfscrypto.o pfsfolder.o pfsstatic.o pfstasks.o pfsupload.o pfsxattr.o pintervaltree.o plibs.o plist.o plocalnotify.o plocalscan.o plocks.o pmemlock.o pnetlibs.o pnotifications.o poverlay.o pp2p.o ppagecache.o ppassword.o ppathstatus.o prunratelimit.o pscanner.o psettings.o pssl.o pstatus.o psyncer.o psynclib.o ptasks.o ptimer.o ptools.o ptree.o publiclinks.o pupload.o -lboost_program_options -lfuse -lpthread -ludev -lsqlite3 -lz -l:libmbedtls.so.14 -l:libmbedx509.so.1 -l:libmbedcrypto.so.7
==> Belépés a fakeroot környezetbe...
==> package() indítása...
==> Telepítés takarítása...
  -> libtool fájlok eltávolítása...
  -> Nem kívánt fájlok eltávolítása...
  -> Statikus függvénytárfájlok eltávolítása...
  -> Hibakereső szimbólumok kivétele a binárisokból és függvénytárakból...
  -> man és info oldalak tömörítése...
==> Csomagolási problémák ellenőrzése...
==> "pcloudcc-lneely" csomag készítése...
  -> .PKGINFO fájl generálása...
  -> .BUILDINFO fájl generálása...
  -> .MTREE fájl generálása...
  -> Csomag tömörítése....
==> fakeroot környezet elhagyása.
==> Létrehozás befejezve: pcloudcc-lneely 20240825T2000Z-2 (2024. dec. 23., hétfő, 10:25:47 CET)
==> Tisztítás...
csomagok betöltése...
függőségek feloldása...
ütköző csomagok keresése...

Csomagok (1) pcloudcc-lneely-20240825T2000Z-2

Teljes telepített méret:  1,00 MiB

:: Kezdődhet a telepítés? [I/n]
(1/1) kulcsok vizsgálata a kulcstartóban                                                                                                                           [#####################################################################################################] 100%
(1/1) csomagok integritásának ellenőrzése                                                                                                                          [#####################################################################################################] 100%
(1/1) csomagfájlok betöltése                                                                                                                                       [#####################################################################################################] 100%
(1/1) fájlütközések vizsgálata                                                                                                                                     [#####################################################################################################] 100%
(1/1) szabad lemezterület ellenőrzése                                                                                                                              [#####################################################################################################] 100%
:: Csomagváltozások feldolgozása...
(1/1) telepítés: pcloudcc-lneely                                                                                                                                   [#####################################################################################################] 100%
:: Tranzakció utáni műveletek végrehajtása...
(1/1) Arming ConditionNeedsUpdate...
[admin@****** ~]$ 

I have **** for the sensitive parts (this time only for the hostname) and sorry for the hungarian language, but you can see, that the only error is, that your package is not available for armv7h. Fortunately it asks, if I want to build it anyway. I selected yes, the build and installation was successful without any warning.

Just in case I removed the old ~/.pcloud folder before I started the new pcloudcc:

[******@****** ~]$ rm -r ~/.pcloud
[******@****** ~]$ pcloudcc -u "backup@******" -p -s
pCloud console client (git-lneely)
Please, enter password
Down: Everything Downloaded| Up: Everything Uploaded, status is LOGIN_REQUIRED
logging in
Down: Everything Downloaded| Up: Everything Uploaded, status is CONNECTING
Down: Everything Downloaded| Up: Everything Uploaded, status is SCANNING
event 1073741824
event 1073741825
Down: Everything Downloaded| Up: Everything Uploaded, status is READY

I typed the password and everything was ok, the ~/pCloudDrive has the content.

I run the rsync command, already with multiple -v in order to get more debug info:

/usr/bin/rsync -avvvvih --delete --numeric-ids --delete-excluded --progress ~/pCloudDrive/******/ /hdd/******/.sync/******/

Unfortunately, at some point (after 2-3GB) the rsync command hangs (sensitive data with ******):

send_files mapped /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-20.jpg of size 4303053
calling match_sums /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-20.jpg
>f+++++++++ Projektek/_archive/******/******/rokus_szhely/rokus_szhely-20.jpg
         32,77K   0%   70,33kB/s    0:01:00
sending file_sum
false_alarms=0 hash_hits=0 matches=0
          4,30M 100%    7,73MB/s    0:00:00 (xfr#56, ir-chk=1041/6561)
sender finished /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-20.jpg
send_files(6069, /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-21.jpg)
count=0 n=0 rem=0
send_files mapped /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-21.jpg of size 4227213
calling match_sums /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-21.jpg
>f+++++++++ Projektek/_archive/******/******/rokus_szhely/rokus_szhely-21.jpg
         32,77K   0%   59,26kB/s    0:01:10
sending file_sum
false_alarms=0 hash_hits=0 matches=0
          4,23M 100%    6,62MB/s    0:00:00 (xfr#57, ir-chk=1040/6561)
sender finished /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-21.jpg
send_files(6070, /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-22.jpg)
count=0 n=0 rem=0
send_files mapped /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-22.jpg of size 4174742
calling match_sums /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-22.jpg
>f+++++++++ Projektek/_archive/******/******/rokus_szhely/rokus_szhely-22.jpg
         32,77K   0%   51,70kB/s    0:01:20
sending file_sum
false_alarms=0 hash_hits=0 matches=0
          4,17M 100%    5,70MB/s    0:00:00 (xfr#58, ir-chk=1039/6561)
sender finished /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-22.jpg
send_files(6071, /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-23.jpg)
count=0 n=0 rem=0
^C^Crsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at io.c(518) [generator=3.3.0]

In this example the transfer of the last file (rokus_szhely-23.jpg) did not begin, but in other cases it just hangs at e.g. 82% of a file.
I tried to ctrl+C, but no prompt is presented.

In another terminal we can see, that the one rsync command spawned three processes, and the first one is stuck in the "uninterruptible sleep" state:

[******@****** ~]$ ps -ax | grep rsync
30427 pts/7    D+     0:04 /usr/bin/rsync -avvvvih --delete --numeric-ids --delete-excluded --progress /home/******/pCloudDrive/******/ /hdd/******/.sync/******/
30428 pts/7    S+     0:00 /usr/bin/rsync -avvvvih --delete --numeric-ids --delete-excluded --progress /home/******/pCloudDrive/******/ /hdd/******/.sync/******/
30429 pts/7    S+     0:00 /usr/bin/rsync -avvvvih --delete --numeric-ids --delete-excluded --progress /home/******/pCloudDrive/******/ /hdd/******/.sync/******/
30457 pts/0    S+     0:00 grep rsync
[******@****** ~]$

I tried deleting the last transferred file and rerun the rsync command:

rm -r /hdd/******/.sync/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-21.jpg
/usr/bin/rsync -avvvvih --delete --numeric-ids --delete-excluded --progress ~/pCloudDrive/******/ /hdd/******/.sync/******/

We can see, that it transfers the rokus_szhely-21.jpg, but it has problems with rokus_szhely-22.jpg:

send_files(6068, /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-20.jpg)
.f          Projektek/_archive/******/******/rokus_szhely/rokus_szhely-20.jpg
send_files(6069, /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-21.jpg)
count=0 n=0 rem=0
send_files mapped /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-21.jpg of size 4227213
calling match_sums /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-21.jpg
>f+++++++++ Projektek/_archive/******/******/rokus_szhely/rokus_szhely-21.jpg
         32,77K   0%    0,00kB/s    0:00:00
sending file_sum
false_alarms=0 hash_hits=0 matches=0
          4,23M 100%   36,36MB/s    0:00:00 (xfr#1, ir-chk=1040/6561)
sender finished /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-21.jpg
send_files(6070, /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-22.jpg)
count=0 n=0 rem=0
send_files mapped /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-22.jpg of size 4174742
calling match_sums /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-22.jpg
>f+++++++++ Projektek/_archive/******/******/rokus_szhely/rokus_szhely-22.jpg
         32,77K   0%  262,30kB/s    0:00:15
sending file_sum
false_alarms=0 hash_hits=0 matches=0
          4,17M 100%   19,91MB/s    0:00:00 (xfr#2, ir-chk=1039/6561)
sender finished /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-22.jpg
send_files(6071, /home/******/pCloudDrive/******/Projektek/_archive/******/******/rokus_szhely/rokus_szhely-23.jpg)
count=0 n=0 rem=0
^C^C^C^Crsync error: received SIGINT, SIGTERM, or SIGHUP (code 20) at io.c(518) [generator=3.3.0]

If I stop the pcloudcc, remove the ~/.pcloud folder, start the pcloudcc and run the rsync again, it transfers a new 2-3GB, but it hangs before/during/after a different file. It can be seen clearly, that the previous problematic file is transferred successfully (e.g. rokus_szhely-22.jpg) in this case.

If I just restart the pcloudcc and run the rsync again, it transfers the problematic file and a couple new files (around 10 files), but it hangs afterwards.

I tried copying the problematic file with a simple cp, but it hangs as well.

If I remove the ~/.pcloud folder and try to copy the folder, which I tried to backup with rsync, the cp starts and looks good, but it hangs after 2.3GB.

I have 20GB free space for the root filesystem, so the the ~/.pcloud folder and the pcloudcc program should not face disk space issues.
The problem is there (in both rsync and cp cases with previously removing the ~/.pcloud folder) when the ~/.pcloud folder reaches the size around 2.1GB (in these cases I had 2192464 and 2192368 bytes).

Guesses

My guess is, that something gets corrupted in the ~/.pcloud folder.

Other important info is, that my automatic backup was running 2 years without any issue, and suddenly on 2024.11.28. the problem was there (I can see the exact date in the logfiles).
As I remember, around this date me and my colleagues were dropped out from all pcloud clients (mobile, Linux desktop, Windows desktop) and have to login on all platforms again. Maybe pcloud modified something serious, which is not tracked in the pcloudcc. If this would be the case, that is sad, because I guess we can not get the info from the pcloud support and their pcloudcc (https://github.com/pcloudcom/console-client) seems abandoned.

Does anybod have something similar?
Could you help me resolve this?

I try to avoid reinstalling the whole system, but I can investigate more, if anybody has some guesses or ideas.

Thank you in advance!

@lneely
Copy link
Owner

lneely commented Jan 30, 2025

@triszalo First, thanks much for the thorough investigation and documentation. I don't use pcloudcc in this way, but I will do my best to help (unfortunately, my "spare cycles" right now are exceedingly few).

You identify a specific date (28 Nov) where this process stopped working, but I suspect the data set being synchronized to pCloud changes more frequently than the program itself. What isn't obvious to me is whether your investigation clearly determines that a change in the program caused this problem, or a change in the file set. The only coding activity at that time was an update to CLI. My questions:

Is the problem caused by recent changes?

  • Try the process with a pcloudcc build prior to 28 November
  • Successful outcome may indicate something in the code changed that caused this problem

... caused by one or more files?

  • Identifying exactly which files were added to the backup process on that date
  • Removing those files from the backup set
  • Trying to run this process again
  • Successful outcome indicates program is not handling one or more files properly

The best I can do right now is try to reproduce with rsync in some temporary folder or something. I will follow up with my observations. :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants