https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c1 --- Comment #1 from Jean Delvare 2010-09-22 11:49:43 UTC --- Tracker is now done doing what it thinks had to be done, and I have the following files on my disk: khali@endymion:~> ls -lhR .local/share/tracker .cache/tracker cache/tracker: total 2.1G -rw-r--r-- 1 khali users 3.0K Sep 14 17:19 contents.db -rw-r--r-- 1 khali users 2 Sep 14 17:19 db-version.txt -rw-r--r-- 1 khali users 449M Sep 22 13:15 fulltext.db -rw-r--r-- 1 khali users 1.6G Sep 22 13:15 meta.db local/share/tracker: total 16K drwxr-xr-x 2 khali users 4.0K Sep 22 13:44 data -rw-r--r-- 1 khali users 0 Sep 22 10:34 tracker-extract.log -rw-r--r-- 1 khali users 0 Sep 22 08:14 tracker-miner-fs.log -rw-r--r-- 1 khali users 11K Sep 22 08:19 tracker-store.log local/share/tracker/data: total 1.6G -rw-r----- 1 khali users 1.6G Sep 22 13:15 tracker-store.journal khali@endymion:~> So this is a total of 3.7 GB of data wasted on my /home partition, supposedly indexing only /home/khali/Documents: khali@endymion:~> du -hs Documents 36M Documents khali@endymion:~> The index over 100 times larger than the data it indexes? Doesn't seem right at all. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c2 --- Comment #2 from Jean Delvare 2010-09-29 12:13:32 UTC --- To make things even worse, tracker is apparently re-indexing what it calls "Applications" (which I can't seem to be allowed to disable) every time I log in. The time it takes to complete ranges from several minutes to a few hours, which seems excessive considering that /usr/share/applications is only 1.3 MB, and presumably doesn't change often. What can I do to prevent this misbehavior? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c4 --- Comment #4 from Vincent Untz 2010-10-06 13:30:28 UTC --- First time I hear about that. So, first: you can disable tracker by just disabling its services in gnome-session-properties -- you can choose to just disable the filesystem miner, btw. So the first (stupid) question: do you have a symlink in one of those directories to a system directory? (In reply to comment #2)

To make things even worse, tracker is apparently re-indexing what it calls "Applications" (which I can't seem to be allowed to disable) every time I log in. The time it takes to complete ranges from several minutes to a few hours, which seems excessive considering that /usr/share/applications is only 1.3 MB, and presumably doesn't change often.

What can I do to prevent this misbehavior?

Could be http://git.gnome.org/browse/tracker/commit/?h=tracker-0.8&id=0a0289555939b12809b262d86cc6c3ab043f6b0d. If you have some time for tests, I can build some packages. One with the patch above, and one with the latest 0.8.x version. Want me to do that? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c6 --- Comment #6 from Jean Delvare 2010-10-06 14:23:59 UTC --- BTW, is there a way to "see" the contents of tracker-store.journal and ~/.cache/tracker/*.db? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c8 Jean Delvare changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|tracker indexes the whole |tracker indexes my whole |filesystem when not told to |home when not told to --- Comment #8 from Jean Delvare 2010-10-07 07:53:14 UTC --- (In reply to comment #7)

Hrm, not sure. You can certainly do some search to guess what's in there, though.

I ended up doing exactly this. The results are that my whole filesystem is NOT indexed, contrary to my initial claim. I may have been fooled by the fact that lsof lists dynamically-linked libraries, not only files being read by the application. Sorry about that. However, I found that my whole home is being indexed, instead of just ~/Documents as I asked. This includes various copies of the Linux kernel source tree, and all my mails - no wonder the cache is pretty large. So there is still a bug, just not exactly the one I initially suspected. I've updated the summary line to reflect this. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c10 --- Comment #10 from Jean Delvare 2010-10-07 11:00:53 UTC --- Created an attachment (id=393527) --> (http://bugzilla.novell.com/attachment.cgi?id=393527) ~/.config/tracker/tracker-miner-fs.cfg -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c12 --- Comment #12 from Jean Delvare 2010-10-07 11:29:49 UTC --- Just for completeness, I confirm that the removal of the symbolic link did not change anything. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c14 --- Comment #14 from Vincent Untz 2010-10-07 12:34:57 UTC --- Yeah, you probably need to remove the databases so that they're re-created to really know if it's better with this version. I don't know if "tracker-control -e" would be enough; if it's not, "tracker-control -r" should be good, though. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c16 --- Comment #16 from Jean Delvare 2010-10-07 14:09:07 UTC --- "tracker-control -r" followed by "tracker-control -s" did the trick: khali@endymion:~> ls -lR .local/share/tracker .cache/tracker cache/tracker: total 4424 -rw-r--r-- 1 khali users 3072 oct. 7 15:35 contents.db -rw-r--r-- 1 khali users 2 sept. 14 17:19 db-version.txt -rw-r--r-- 1 khali users 594944 oct. 7 16:01 fulltext.db -rw-r--r-- 1 khali users 3915776 oct. 7 16:01 meta.db local/share/tracker: total 20 drwxr-xr-x 2 khali users 4096 oct. 7 15:35 data -rw-r--r-- 1 khali users 0 oct. 7 16:01 tracker-extract.log -rw-r--r-- 1 khali users 0 oct. 7 15:35 tracker-miner-fs.log -rw-r--r-- 1 khali users 13007 oct. 7 15:35 tracker-store.log local/share/tracker/data: total 2144 -rw-r----- 1 khali users 2187912 oct. 7 16:01 tracker-store.journal khali@endymion:~> du -hsc .local/share/tracker .cache/tracker 2,2M .local/share/tracker 4,4M .cache/tracker 6,5M total khali@endymion:~> This is more reasonable :) But the user shouldn't have to run these commands to get tracker to do the right thing. Then I tried adding a second directory to the list of recursively indexed directories, and I was able to search for documents located there. The interesting thing is that when I later removed this second directory from the list, I was _still_ able to search for documents located in this directory. So the actual bug would be that removed entries in the configuration are _not_ dropped from the database as they should. Vincent, can you please try reproducing this? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c18 --- Comment #18 from Vincent Untz 2010-10-11 10:19:47 UTC --- And I can reproduce on 11.3, so that's fixed in 0.9.x. (looking a bit at git) This is the fix: http://git.gnome.org/browse/tracker/commit/?id=2d0dfca3311ac2337b69e11e85a05... It looks like we can probably backport that. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c20 Vincent Untz changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO InfoProvider| |maintenance@opensuse.org --- Comment #20 from Vincent Untz 2010-10-11 12:19:10 UTC --- I added the patch to home:vuntz:11.3-testing and it works for me. Unfortunately, it won't work for directories that you removed from the config before the update. I'm not sure this situation would be easily fixable, unfortunately -- it's probably easier to just rebuild the database :/ Maintenance team: is it okay to submit home:vuntz:11.3-testing/tracker as a maintenance update? It fixes an issue where, if you remove a directory from the list of directories to index, the database still references items that were in this directory. This can lead to a huge database. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c22 --- Comment #22 from Vincent Untz 2010-10-11 12:51:01 UTC --- ~/.cache/ is not world-readable, or if it is, you have many more issues :-) -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c24 Christian Dengler changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |cdengler@novell.com --- Comment #24 from Christian Dengler 2010-10-11 14:41:11 UTC --- For me: update is ok (+1) -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c26 --- Comment #26 from Vincent Untz 2010-10-11 14:54:08 UTC --- (In reply to comment #25)

the question is also how it started the full index first?

There was no full index; it was just indexing Jean's $HOME, which is big. And when Jean changed the configuration to index only a subset of $HOME, the database didn't get updated. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c28 Christian Dengler changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW InfoProvider|maintenance@opensuse.org | --- Comment #28 from Christian Dengler 2010-10-15 15:04:22 UTC --- update started -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c30 Vincent Untz changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|tracker keeps old data in |[maintenance] tracker keeps |store when asked to stop |old data in store when |indexing a directory |asked to stop indexing a | |directory --- Comment #30 from Vincent Untz 2010-11-30 09:26:06 UTC --- (In reply to comment #27)

The SWAMPID for this issue is 36517. This issue was rated as low. Please submit fixed packages until 2010-11-12.

Gah, I'm sorry, I completely forgot to submit the fix while I was traveling :/ I submitted it now (sr#54146).

Also create a patchinfo file using this link: https://swamp.suse.de/webswamp/wf/36517

For some reason, I can't access swamp, even with the vpn. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c32 --- Comment #32 from J. Daniel Schmidt 2010-11-30 10:26:12 UTC --- (In reply to comment #31)

...

1. Why does tracker create such big waste files in the users home?

Well, it's hard to tell since I have no idea what's in the file...

I did not read it completely due to time limitations :) But a 'tail' on that file showed some IRC logs. A 'tail -n1000' also showed binary data, so it must be different stuff that got logged there. Btw. I deleted the file.

...

2. Why does tracker get started in the first place and how? I did not start it?

Because it's autostarted on login.

I was not informed about that (note: I use my home since SuSE Linux 8.2).

...

3. How to disable it? Yes, I can "rpm -e" it but this will not solve the issue - just mine.

Disable tracker? Just remove it from the applications started on login.

Where do I do this in KDE? I could not find any place to configure that or remove it. This bug now turns into a usability issue as well, as a normal user most likely is unable to determine what application is messing around in his $HOME and does not find any hint about how to disable the unknown thing. Thank you for addressing this. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c34 Swamp Workflow Management changed: What |Removed |Added ---------------------------------------------------------------------------- Status Whiteboard|maint:running:36517:low |maint:running:36517:low | |maint:released:11.3:37502 --- Comment #34 from Swamp Workflow Management 2010-12-06 08:45:38 UTC --- Update released for: evolution-tracker, evolution-tracker-debuginfo, libtracker-client-0_8-0, libtracker-client-0_8-0-debuginfo, libtracker-extract-0_8-0, libtracker-extract-0_8-0-debuginfo, libtracker-miner-0_8-0, libtracker-miner-0_8-0-debuginfo, nautilus-tracker, nautilus-tracker-debuginfo, tracker, tracker-applet, tracker-applet-debuginfo, tracker-debuginfo, tracker-debugsource, tracker-devel, tracker-gui, tracker-gui-debuginfo, tracker-lang Products: openSUSE 11.3 (debug, i586, x86_64) -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

https://bugzilla.novell.com/show_bug.cgi?id=640786 https://bugzilla.novell.com/show_bug.cgi?id=640786#c35 Vincent Untz changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |RESOLVED Resolution| |FIXED --- Comment #35 from Vincent Untz 2010-12-06 15:43:31 UTC --- Closing the bug, since the update got released. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.