[Bug 308698] New: grep slow in utf8 locale
https://bugzilla.novell.com/show_bug.cgi?id=308698 Summary: grep slow in utf8 locale Product: openSUSE 10.3 Version: Beta 2 Platform: Other OS/Version: Other Status: NEW Severity: Major Priority: P5 - None Component: Basesystem AssignedTo: schwab@novell.com ReportedBy: dmueller@novell.com QAContact: qa@suse.de Found By: --- grep from 10.2: time distpin foobla >/dev/null real 0m6.311s user 0m5.964s sys 0m0.448s grep from 10.3: time distpin foobla >/dev/null real 1m5.049s user 1m3.012s sys 0m1.224s export LC_ALL=C time distpin foobla >/dev/null real 0m6.024s user 0m5.692s sys 0m0.400s -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=308698#c1
Ludwig Nussel
https://bugzilla.novell.com/show_bug.cgi?id=308698#c2
Stephan Kulow
https://bugzilla.novell.com/show_bug.cgi?id=308698#c3
--- Comment #3 from Dirk Mueller
https://bugzilla.novell.com/show_bug.cgi?id=308698#c4
Bernd Strieder
time nm *.o | LANG=C time grep -v " W " > link.nm 0.12user 0.13system 0:02.16elapsed 12%CPU (0avgtext+0avgdata 0maxresident)k 0inputs+0outputs (0major+189minor)pagefaults 0swaps
real 0m2.179s user 0m1.840s sys 0m0.564s openSuSE 10.3 RC1 with utf8
time nm *.o | time grep -v " W " > link.nm 335.10user 0.08system 5:36.78elapsed 99%CPU (0avgtext+0avgdata 0maxresident)k 0inputs+0outputs (0major+252minor)pagefaults 0swaps
real 5m36.819s user 5m36.817s sys 0m0.528s For comparision SuSE 9.0 with the same hardware:
time nm *.o | LANG=C time grep -v " W " > link.nm 0.04user 0.12system 0:08.58elapsed 1%CPU (0avgtext+0avgdata 0maxresident)k 0inputs+0outputs (134major+22minor)pagefaults 0swaps
real 0m8.611s user 0m8.240s sys 0m0.530s Looking at the inner time output we are talking here about hundredths of seconds vs. hundreds of seconds, a factor of over 1000 at the given input size. grep is used by so many scripts within about every distro, that this problem could become a show-stopper. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=308698#c5
--- Comment #5 from Dirk Mueller
https://bugzilla.novell.com/show_bug.cgi?id=308698#c6
--- Comment #6 from Michael Matz
https://bugzilla.novell.com/show_bug.cgi?id=308698
User bj@sernet.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c7
Bjoern Jacke
https://bugzilla.novell.com/show_bug.cgi?id=308698
User bj@sernet.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c8
Bjoern Jacke
https://bugzilla.novell.com/show_bug.cgi?id=308698
User dmueller@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c9
--- Comment #9 from Dirk Mueller
https://bugzilla.novell.com/show_bug.cgi?id=308698
User mmarek@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c10
Michal Marek
https://bugzilla.novell.com/show_bug.cgi?id=308698
User roland.kletzing@materna.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c11
roland kletzing
a quite simple grep on a 70MB log file is a *real* problem in a UTF-8 locale.
yes. i have come across today (opensuse 11 alpha1) after i wondered why grepping trough larger amount of data did nothing but burning cpu cycles. i needed a while to find out that this is a locale problem. this is not obvious to the end-user and people will have major hassle because of this. major annoyance,imho. please fix ! -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=308698
User nordhaus@informatik.hu-berlin.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c12
--- Comment #12 from Stefan Nordhausen
https://bugzilla.novell.com/show_bug.cgi?id=308698
User roland.kletzing@materna.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c13
--- Comment #13 from roland kletzing
https://bugzilla.novell.com/show_bug.cgi?id=308698
User dmueller@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c14
--- Comment #14 from Dirk Mueller
https://bugzilla.novell.com/show_bug.cgi?id=308698
User roland.kletzing@materna.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c15
--- Comment #15 from roland kletzing
https://bugzilla.novell.com/show_bug.cgi?id=308698
User lyeoh@inter-touch.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c16
Lincoln Yeoh
https://bugzilla.novell.com/show_bug.cgi?id=308698
User dmueller@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c17
--- Comment #17 from Dirk Mueller
https://bugzilla.novell.com/show_bug.cgi?id=308698
User roland.kletzing@materna.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c18
--- Comment #18 from roland kletzing
https://bugzilla.novell.com/show_bug.cgi?id=308698
User coolo@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c19
--- Comment #19 from Stephan Kulow
https://bugzilla.novell.com/show_bug.cgi?id=308698
User dmueller@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c22
--- Comment #22 from Dirk Mueller
https://bugzilla.novell.com/show_bug.cgi?id=308698
User dmueller@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c23
--- Comment #23 from Dirk Mueller
https://bugzilla.novell.com/show_bug.cgi?id=308698
User koenig@linux.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c25
--- Comment #25 from Harald Koenig
the new submission from Andreas Schwab labeled "Some speadups" does improve the situation:
is this new submission available for testing ? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.
https://bugzilla.novell.com/show_bug.cgi?id=308698
User jengelh@gmx.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c26
Jan Engelhardt
https://bugzilla.novell.com/show_bug.cgi?id=308698
User schwab@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c27
Andreas Schwab
https://bugzilla.novell.com/show_bug.cgi?id=308698
Dirk Mueller
https://bugzilla.novell.com/show_bug.cgi?id=308698
User schwab@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c28
Andreas Schwab
https://bugzilla.novell.com/show_bug.cgi?id=308698
User matz@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c29
--- Comment #29 from Michael Matz
https://bugzilla.novell.com/show_bug.cgi?id=308698
User jengelh@medozas.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c30
--- Comment #30 from Jan Engelhardt
https://bugzilla.novell.com/show_bug.cgi?id=308698
User mfabian@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c31
--- Comment #31 from Mike Fabian
https://bugzilla.novell.com/show_bug.cgi?id=308698
User matz@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c32
--- Comment #32 from Michael Matz
https://bugzilla.novell.com/show_bug.cgi?id=308698
User strieder@informatik.uni-kl.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c33
--- Comment #33 from Bernd Strieder
Whoever needs grep searches with utf-8 support should possibly look at
https://bugzilla.novell.com/show_bug.cgi?id=308698
User jengelh@medozas.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c34
--- Comment #34 from Jan Engelhardt
https://bugzilla.novell.com/show_bug.cgi?id=308698
User jengelh@medozas.de added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c35
--- Comment #35 from Jan Engelhardt
https://bugzilla.novell.com/show_bug.cgi?id=308698
User matz@novell.com added comment
https://bugzilla.novell.com/show_bug.cgi?id=308698#c36
--- Comment #36 from Michael Matz
participants (1)
-
bugzilla_noreply@novell.com