Hang in traverse - how to debug? #555
Description
Running master 2.10.1 and develop plus a few patches and I am getting a hang during initial traverse with both versions.
Traversing (316260 usable files / 0 + 0 ignored files / folders)
Always at the same file count.
After this, the drives spin down and nothing appears to be happening. The process continues to run, waiting for something. CPU usage is low.
I checked RAM use - no problems there. 4GB RAM, ca. 2GB used. (Raspberry Pi 4B)
With -vvv set, the last message I (always) see is:
WARNING: Added big file /srv/path/Scans BU Dec 2014/Africa_Turmoil_WEB.pdf
Would it be this file causing the problem? (probably more likely something afterwards)
Running gdb (develop version compiled with DEBUG=1) when I get to the "same place" I do a CTRL-C (not sure if this is useful)
INFO: Added big file /srv/path/Scans BU Dec 2014/Africa_Turmoil_WEB.pdf
^C
Thread 1 "rmlint" received signal SIGINT, Interrupt.
syscall () at ../sysdeps/unix/sysv/linux/arm/syscall.S:37
37 ../sysdeps/unix/sysv/linux/arm/syscall.S: No such file or directory.
(gdb) bt
#0 0xb6af5aec in syscall () at ../sysdeps/unix/sysv/linux/arm/syscall.S:37
#1 0xb6ce2908 in g_cond_wait () at /usr/lib/arm-linux-gnueabihf/libglib-2.0.so.0
#2 0x0001f6b8 in rm_mds_finish ()
#3 0x0002a4f0 in rm_traverse_tree ()
#4 0x0001adf4 in rm_cmd_main ()
#5 0x00015b18 in main ()
(gdb) thread apply all bt
Thread 3 (Thread 0xb5c513a0 (LWP 19170)):
#0 0xb6af5aec in syscall () at ../sysdeps/unix/sysv/linux/arm/syscall.S:37
#1 0xb6ce2a80 in g_cond_wait_until () at /usr/lib/arm-linux-gnueabihf/libglib-2.0.so.0
#2 0x0001f81c in rm_mds_factory ()
Thread 2 (Thread 0xb64523a0 (LWP 19169)):
#0 0xb6b81c58 in __libc_open (file=0xb64503b8 "\230\305\002", oflag=131072)
at ../sysdeps/unix/sysv/linux/open.c:44
#1 0x0002c61c in rm_sys_open ()
#2 0x0002dba4 in rm_util_is_nonstripped ()
#3 0x00028834 in rm_traverse_file ()
#4 0x00029900 in rm_traverse_directory ()
#5 0x0001f868 in rm_mds_factory ()
Thread 1 (Thread 0xb6829010 (LWP 19164)):
#0 0xb6af5aec in syscall () at ../sysdeps/unix/sysv/linux/arm/syscall.S:37
#1 0xb6ce2908 in g_cond_wait () at /usr/lib/arm-linux-gnueabihf/libglib-2.0.so.0
#2 0x0001f6b8 in rm_mds_finish ()
#3 0x0002a4f0 in rm_traverse_tree ()
#4 0x0001adf4 in rm_cmd_main ()
#5 0x00015b18 in main ()
(gdb)
I am not sure if these backtraces help - I am VERY rusty at debugging.
Any hints on how to hunt this problem down appreciated :)