[Bug 872302] New: Large delays ( > 10 seconds ) for queries on small firebird databases - openSUSE Bugs - openSUSE Mailing Lists

newer
[Bug 947645] New: aarch64: Yast...

[Bug 872302] New: Large delays ( > 10 seconds ) for queries on small firebird databases

older
[Bug 947635] New: File missing in...

bugzilla_noreply＠novell.com

7 Apr 2014 7 Apr '14

08:45

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c0 Summary: Large delays ( > 10 seconds ) for queries on small firebird databases Classification: openSUSE Product: openSUSE 13.1 Version: Final Platform: x86-64 OS/Version: openSUSE 13.1 Status: NEW Severity: Normal Priority: P5 - None Component: Kernel AssignedTo: kernel-maintainers@forge.provo.novell.com ReportedBy: georg.weickelt@ibedelmann.de QAContact: qa-bugs@suse.de Found By: --- Blocker: --- User-Agent: Mozilla/5.0 (Windows NT 6.1; rv:28.0) Gecko/20100101 Firefox/28.0 We observe significant delays in project operations that use firebird databases. For example, taking a view of a project list sometimes 10 s or more. We are only three users of this software , so that the load of the server is very small. We use a CAD system on windows, which saves a few settings in a Firebird database. Firebird is running on a server with openSUSE 13.1. The manufacturer has released only version 2.50 of Firebird , but the problems exist also with version 2.5.2. The server has a RAID 5 from three disks, 16GB RAM and an Intel Xeon E5- 2407 CPU 0@2.20GHz , 4 cores . The *.fdb data resides on a partition that is partitioned with ext4 under LVM, but the problem exist also if I move them to a ram-disk. They are 1-10 MB in size - so rather small. Networking works over a Broadcom BCM95720. Reproducible: Always Steps to Reproduce: Sorry only with the cad-system possible 1. 2. 3. Actual Results: slow response > 10 - 40s Expected Results: fast response < 2 s -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

Show replies by date

bugzilla_noreply＠novell.com

8 Apr 8 Apr

07:02

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c1 --- Comment #1 from Georg Weickelt 2014-04-08 07:01:56 UTC --- It seems to be a regression. In openSUSE 12.3, I can not observe this problem. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

9 Apr 9 Apr

05:21

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c2 --- Comment #2 from Georg Weickelt 2014-04-09 05:21:26 UTC --- also if I'm using the "3.11.10-7-desktop-kernel" or tumbleweed-kernels the problem disappears. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

07:48

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c3 Takashi Iwai changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO CC| |tiwai@suse.com InfoProvider| |georg.weickelt@ibedelmann.d | |e --- Comment #3 from Takashi Iwai 2014-04-09 07:48:51 UTC --- Thanks for the information. So, is the problem already solved by openSUSE 13.1 update kernel or the newer upstream kernel, right? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

08:17

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c4 Georg Weickelt changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW InfoProvider|georg.weickelt@ibedelmann.d | |e | --- Comment #4 from Georg Weickelt 2014-04-09 08:17:40 UTC --- The problem persists in the kernel 3.11.10-7-default-kernel. It is not present in the "desktop"- flavor or in tumbleweed-default (3.14.x?). -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

09:12

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c5 Takashi Iwai changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO CC| |jack@suse.com InfoProvider| |georg.weickelt@ibedelmann.d | |e --- Comment #5 from Takashi Iwai 2014-04-09 09:12:29 UTC --- Thanks. This sounds interesting. Since the desktop flavor enables preemption and higher HZ, the responsiveness should be better than the default flavor. But we thought that the general throughput is better on default kernel than on desktop kernel. Just to be sure, does the problem still happen with the latest stable kernel with default flavor? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

09:30

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c6 --- Comment #6 from Georg Weickelt 2014-04-09 09:30:05 UTC --- Tested with a virtual VM ad with a DELL T320 with default 3.11.10-7 - it seems the latest stable kernel: problem does still happen. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

09:30

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c Georg Weickelt changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW InfoProvider|georg.weickelt@ibedelmann.d | |e | -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

09:49

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c7 --- Comment #7 from Takashi Iwai 2014-04-09 09:49:06 UTC --- Ah, it's on a VM. Then it's a different story. Does the same problem happen with the real machine? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

09:55

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c8 --- Comment #8 from Georg Weickelt 2014-04-09 09:55:27 UTC --- shure, VM was only for testing, the real machine is described on top of the page- a DELL T320. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

10:03

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c9 --- Comment #9 from Takashi Iwai 2014-04-09 10:03:41 UTC --- Well, the question is where you applied the workload and tested. Did you test various kernels inside VM and it made difference, or you changed the kernel on the host and it made difference in the performance of each VM? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

11:05

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c10 --- Comment #10 from Georg Weickelt 2014-04-09 11:05:40 UTC --- I tested varous kernels inside a VM- it makes a difference. And I tested two different kernels on the real machine without any involved VM- it makes a difference too. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

14:31

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c11 Jan Kara changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO InfoProvider| |georg.weickelt@ibedelmann.d | |e --- Comment #11 from Jan Kara 2014-04-09 14:31:49 UTC --- The difference between -desktop and -default looks really unexpected. I'm not sure how Firebird exactly works but to move further with this we'd need to find out where does the database exactly hang. Since the stalls are relatively long, can you observe the processes during stalls whether there are processes in D state for a long time or something like that? Or maybe strace the DB process (if there's anything like that) and see whether there's some syscall in which we spend unexpected amount of time? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

10 Apr 10 Apr

06:04

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c12 --- Comment #12 from Georg Weickelt 2014-04-10 06:04:32 UTC --- Created an attachment (id=585764) --> (http://bugzilla.novell.com/attachment.cgi?id=585764) Output of stracing the fbserver-process have done strace on the fbserver- process while waiting for the expected reaction of the database- selecting one row. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

06:06

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c13 Georg Weickelt changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW InfoProvider|georg.weickelt@ibedelmann.d | |e | --- Comment #13 from Georg Weickelt 2014-04-10 06:06:13 UTC --- Created an attachment (id=585767) --> (http://bugzilla.novell.com/attachment.cgi?id=585767) another stracing-output same as befor, selecting many rows of the database- and waitig longer. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

14 Apr 14 Apr

18:04

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c Jan Kara changed: What |Removed |Added ---------------------------------------------------------------------------- Priority|P5 - None |P3 - Medium -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

18:09

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c15 --- Comment #15 from Jan Kara 2014-04-14 18:09:39 UTC --- Hum, so sadly the straces are useless. The fbserver process just receives some data and waits for futexes but doesn't do any database operations itself. How about watching processes with ps. Does it show any suspicious processes in D state? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

18:10

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c16 Jan Kara changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO InfoProvider| |georg.weickelt@ibedelmann.d | |e --- Comment #16 from Jan Kara 2014-04-14 18:10:01 UTC --- Forgot to set NEEDINFO... -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

16 Apr 16 Apr

05:28

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c17 --- Comment #17 from Georg Weickelt 2014-04-16 05:28:31 UTC --- trying to watch the problem with ps I'm now more than confused- can no longer see any delays. Changed nothing(that I remember), but the problem has gone away. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

17 Apr 17 Apr

05:39

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c18 Georg Weickelt changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW InfoProvider|georg.weickelt@ibedelmann.d | |e | --- Comment #18 from Georg Weickelt 2014-04-17 05:39:49 UTC --- ok, I'm no longer confused- was the wrong VM. But I get only: linux-hbha:~ # ps -axu | grep D USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND root 934 0.0 0.2 46832 2832 ? Ss 07:10 0:00 /usr/sbin/sshd -D root 1047 0.0 0.2 175040 2868 ? Ss 07:10 0:00 /usr/sbin/nmbd -D root 1092 0.0 0.5 233104 5740 ? Ss 07:10 0:00 /usr/sbin/smbd -D root 1108 0.0 0.3 233112 3344 ? S 07:10 0:00 /usr/sbin/smbd -D root 1771 0.9 0.7 248072 7304 ? S 07:34 0:00 /usr/sbin/smbd -D root 1854 0.0 0.0 9268 928 pts/0 S+ 07:35 0:00 grep --color=auto D no processes in D State. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

22 Apr 22 Apr

09:18

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c19 Jan Kara changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO InfoProvider| |georg.weickelt@ibedelmann.d | |e --- Comment #19 from Jan Kara 2014-04-22 09:17:59 UTC --- OK, thanks for checking. So what I suspect now is that there's some process likely spinning in the kernel for a long time. That would also explain why default vs desktop kernel flavors make a difference - in the desktop kernel we are able to preempt a processes running in kernel (unless it holds a spinlock or explicitly disables preemption) while in the default kernel we can preempt a process only when it asks to sleep. Do you have softlockup watchdog enabled in the VM (you can check in /proc/sys/kernel/nmi_watchdog)? If yes, can you perhaps set /proc/sys/kernel/watchdog_thresh to 5 and see whether kernel complains about something in kernel logs? Also can you run top and see whether there are processes in 'R' state for a long time? -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

12:19

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c20 Georg Weickelt changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEEDINFO |NEW InfoProvider|georg.weickelt@ibedelmann.d | |e | --- Comment #20 from Georg Weickelt 2014-04-22 12:19:47 UTC --- /proc/sys/kernel/nmi_watchdog = 1 /proc/sys/kernel/nmi_watchdog = 5 No kernel messages in /var/log/messages can be found after booting. And there are no processes in "R" state for a long time. -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

15:02

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c21 Jan Kara changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |mkubecek@suse.com, | |opensusefactory@fleetriver. | |com --- Comment #21 from Jan Kara 2014-04-22 15:02:45 UTC --- :-( So much for my theory. So we really need to find out what is the database doing and from that hopefully understand why it is taking so long. Adding firebird maintainers to CC. Guys, can you please help Georg in finding what is taking so long with his firebird database? Thanks! -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

1 May 1 May

14:59

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

https://bugzilla.novell.com/show_bug.cgi?id=872302 https://bugzilla.novell.com/show_bug.cgi?id=872302#c22 Jan Kara changed: What |Removed |Added ---------------------------------------------------------------------------- Status|NEW |NEEDINFO InfoProvider| |jbohac@suse.com --- Comment #22 from Jan Kara 2014-05-01 14:59:10 UTC --- OK, so I was working with Georg on identifying source of the slowness and I think I found something interesting. We were comparing wireshark traces between the slow (-default) and the fast (-desktop) kernel. In the slow case I observed the following pattern a lot: 79203 34.769528000 192.168.1.100 192.168.1.107 GDS DB 82 Close blob 79204 34.772220000 192.168.1.107 192.168.1.100 GDS DB 86 Response 79205 34.980770000 192.168.1.100 192.168.1.107 TCP 54 49388 > +gds-db [ACK] Seq=159617 Ack=619073 Win=64772 Len=0 79206 34.982536000 192.168.1.107 192.168.1.100 GDS DB 86 Response 192.168.1.107 is the server and 192.168.1.100 is the client. The client sent a request and server responds with two packets. What is special is that the second response packet from the server arrives only after the client waits for 8 miliseconds and then sends ack of the first response packet separately. This doesn't happen for the -desktop kernel. Jiri, do you have any idea why that happens? I can provide the wireshark traces for inspection if you need them (or feel free to redirect the question to someone more appropriate). -- Configure bugmail: https://bugzilla.novell.com/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

bugzilla_noreply＠novell.com

25 Sep 25 Sep

21:59

New subject: [Bug 872302] Large delays ( > 10 seconds ) for queries on small firebird databases

http://bugzilla.novell.com/show_bug.cgi?id=872302 http://bugzilla.novell.com/show_bug.cgi?id=872302#c23 Jiri Bohac changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |jbohac@suse.com Flags|needinfo?(jbohac@suse.com) | --- Comment #23 from Jiri Bohac --- Sorry for the appallingly late reply! I can't tell why this happens with so little information. TCP is using timers for many purposes and having finer granularity with HZ=1000 on the -desktop kernel may influence the timing of packets a lot. If the bug is still relevant and you believe this could really caused by TCP delays, please attach a full packet dump from both the -desktop and -default kernels. -- You are receiving this mail because: You are on the CC list for the bug.

Reply

Sign in to reply online Use email software

3144

Age (days ago)

3680

Last active (days ago)

Download

24 comments

1 participants

tags

participants (1)

bugzilla_noreply＠novell.com