http://bugzilla.suse.com/show_bug.cgi?id=1037118 http://bugzilla.suse.com/show_bug.cgi?id=1037118#c1 --- Comment #1 from Martin Wilck --- I uploaded a btrfs-image dump of the broken file system to l3slave.suse.de:/space/mwilck/1037118/ (506MiB; partition size was 40963 MiB). Meanwhile I transferred the data except for older snapshots to a new btrfs volume because (not being sure how to recover from this situation) I wanted to avoid to be left with a totally corrupt file system, and unable to work. In the recovery process I made some minor write accesses to the file system, so the dumped state is not exactly the same as when this error first occured. While I tried to copy the data, I got thousands of errors like this because I'd forgotten to mount the volume with "noatime" or "ro":

May 02 16:07:04 apollon.suse.de kernel: ------------[ cut here ]------------ May 02 16:07:04 apollon.suse.de kernel: WARNING: CPU: 1 PID: 577 at ../fs/btrfs/qgroup.c:2936 btrfs_qgroup_free_meta+0x89/0x90 [btrfs] May 02 16:07:04 apollon.suse.de kernel: CPU: 1 PID: 577 Comm: rsync Tainted: G U 4.10.12-1-default #1 May 02 16:07:04 apollon.suse.de kernel: Hardware name: Dell Inc. Latitude E7470/0T6HHJ, BIOS 1.9.4 08/26/2016 May 02 16:07:04 apollon.suse.de kernel: Call Trace: May 02 16:07:04 apollon.suse.de kernel: dump_stack+0x5c/0x7a May 02 16:07:04 apollon.suse.de kernel: __warn+0xbe/0xe0 May 02 16:07:04 apollon.suse.de kernel: btrfs_qgroup_free_meta+0x89/0x90 [btrfs] May 02 16:07:04 apollon.suse.de kernel: start_transaction+0x3a5/0x4a0 [btrfs] May 02 16:07:04 apollon.suse.de kernel: btrfs_dirty_inode+0x99/0xc0 [btrfs] May 02 16:07:04 apollon.suse.de kernel: touch_atime+0x89/0xb0 May 02 16:07:04 apollon.suse.de kernel: SyS_readlink+0xd9/0x110 May 02 16:07:04 apollon.suse.de kernel: entry_SYSCALL_64_fastpath+0x1e/0xad May 02 16:07:04 apollon.suse.de kernel: ---[ end trace 3a2f8149ed5137ab ]---

Another examination of the journal showed that the first occurence of this bug occured actually before today's update. The first one that's recorded was last week:

Apr 24 21:16:54 apollon.suse.de kernel: CPU: 0 PID: 702 Comm: systemd-journal Tainted: G U W 4.10.9-1-default #1 Apr 24 21:16:54 apollon.suse.de kernel: Hardware name: Dell Inc. Latitude E7470/0T6HHJ, BIOS 1.9.4 08/26/2016 Apr 24 21:16:54 apollon.suse.de kernel: Call Trace: Apr 24 21:16:54 apollon.suse.de kernel: dump_stack+0x5c/0x7a Apr 24 21:16:54 apollon.suse.de kernel: __warn+0xbe/0xe0 Apr 24 21:16:54 apollon.suse.de kernel: btrfs_qgroup_free_meta+0x89/0x90 [btrfs] Apr 24 21:16:54 apollon.suse.de kernel: start_transaction+0x3a5/0x4a0 [btrfs] Apr 24 21:16:54 apollon.suse.de kernel: btrfs_rename+0x184/0xd40 [btrfs] Apr 24 21:16:54 apollon.suse.de kernel: vfs_rename+0x6ba/0x900 Apr 24 21:16:54 apollon.suse.de kernel: SyS_rename+0x3a6/0x3c0 Apr 24 21:16:54 apollon.suse.de kernel: do_syscall_64+0x57/0xc0 Apr 24 21:16:54 apollon.suse.de kernel: entry_SYSCALL64_slow_path+0x25/0x25 Apr 24 21:16:54 apollon.suse.de kernel: ---[ end trace efd3cc31a94c61e4 ]---

From memory, I can't associate any relevant system configuration changes with

However the update today was the first time that I noticed because this resulted in a fatal error of a user command (see comment 0). this date (Apr 24 21:16) except that that was the first day I ran the 4.10.9-1-default kernel (updated from 4.10.8-1-default on 2017-04-23 21:34:01). -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.suse.com/show_bug.cgi?id=1037118 http://bugzilla.suse.com/show_bug.cgi?id=1037118#c3 --- Comment #3 from Martin Wilck --- Here is the full log of the update failure this morning from zypper:

2017-05-02 08:34:20|install|gzip|1.8-3.1|x86_64||repo-oss|1df1e5ccce1ddc9df2538d0591c10d0884c2ae3f| 2017-05-02 08:34:20|install|glibc-utils|2.25-2.1|x86_64||repo-oss|ee7a913810271fcceb5fcf737e30831c12998ad8| # 2017-05-02 08:34:23 glibc-locale-2.25-2.1.x86_64.rpm install failed # rpm output: # error: unpacking of archive failed on file /usr/lib/locale/en_ZW.utf8/LC_TIME: cpio: rename # error: glibc-locale-2.25-2.1.x86_64: install failed # error: glibc-locale-2.25-1.1.x86_64: erase skipped # # 2017-05-02 08:38:17 glibc-locale-2.25-2.1.x86_64.rpm install failed # rpm output: # error: unpacking of archive failed on file /usr/lib/locale/ar_JO.utf8/LC_TIME: cpio: rename # error: glibc-locale-2.25-2.1.x86_64: install failed # error: glibc-locale-2.25-1.1.x86_64: erase skipped # 2017-05-02 08:38:52|install|glibc-locale|2.25-2.1|x86_64||repo-oss|5bad4843aa58844d7ac6d7bb44eea40bfb86e1e2| 2017-05-02 08:38:53|install|glibc-extra|2.25-2.1|x86_64||repo-oss|6680872c0673a6fe7ecaa875ccf1c8274728c42c| # 2017-05-02 08:38:53 glibc-devel-2.25-2.1.x86_64.rpm install failed # rpm output: # error: unpacking of archive failed on file /usr/include/bits/mqueue2.h: cpio: rename # error: glibc-devel-2.25-2.1.x86_64: install failed # error: glibc-devel-2.25-1.1.x86_64: erase skipped

and from rpm:

May 02 08:34:20 apollon.suse.de [RPM][25081]: Transaction ID 5908286c started May 02 08:34:20 apollon.suse.de [RPM][25081]: erase glibc-locale-2.25-1.1.x86_64: success May 02 08:34:23 apollon.suse.de kernel: ------------[ cut here ]------------ May 02 08:34:23 apollon.suse.de kernel: WARNING: CPU: 3 PID: 25081 at ../fs/btrfs/qgroup.c:2936 btrfs_qgroup_free_meta+0x89/0x90 [btrfs] May 02 08:34:23 apollon.suse.de kernel: Modules linked in: fuse cmac rfcomm ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntr May 02 08:34:23 apollon.suse.de kernel: snd_pcm dell_smm_hwmon snd_timer intel_rapl cfg80211 x86_pkg_temp_thermal snd intel_powerclamp rtsx_pci_ms coretemp kvm_intel memstick kvm irqbypa May 02 08:34:23 apollon.suse.de kernel: aes_x86_64 crypto_simd cryptd glue_helper serio_raw i915 i2c_algo_bit xhci_pci drm_kms_helper xhci_hcd syscopyarea sysfillrect rtsx_pci sysimgblt May 02 08:34:23 apollon.suse.de kernel: CPU: 3 PID: 25081 Comm: rpm Tainted: G U 4.10.10-1-default #1 May 02 08:34:23 apollon.suse.de kernel: Hardware name: Dell Inc. Latitude E7470/0T6HHJ, BIOS 1.9.4 08/26/2016 May 02 08:34:23 apollon.suse.de kernel: Call Trace: May 02 08:34:23 apollon.suse.de kernel: dump_stack+0x5c/0x7a May 02 08:34:23 apollon.suse.de kernel: __warn+0xbe/0xe0 May 02 08:34:23 apollon.suse.de kernel: btrfs_qgroup_free_meta+0x89/0x90 [btrfs] May 02 08:34:23 apollon.suse.de kernel: start_transaction+0x3a5/0x4a0 [btrfs] May 02 08:34:23 apollon.suse.de kernel: btrfs_rename+0x184/0xd40 [btrfs] May 02 08:34:23 apollon.suse.de kernel: vfs_rename+0x6ba/0x900 May 02 08:34:23 apollon.suse.de kernel: SyS_rename+0x3a6/0x3c0 May 02 08:34:23 apollon.suse.de kernel: entry_SYSCALL_64_fastpath+0x1e/0xad May 02 08:34:23 apollon.suse.de kernel: ---[ end trace f292d529165d04fc ]--- May 02 08:34:23 apollon.suse.de [RPM][25081]: install glibc-locale-2.25-2.1.x86_64: failure May 02 08:34:23 apollon.suse.de [RPM][25081]: 1 elements failed, 0 scripts failed May 02 08:34:23 apollon.suse.de [RPM][25081]: Transaction ID 5908286c finished: -1 May 02 08:38:17 apollon.suse.de [RPM][25104]: Transaction ID 59082959 started May 02 08:38:17 apollon.suse.de [RPM][25104]: erase glibc-locale-2.25-1.1.x86_64: success May 02 08:38:17 apollon.suse.de kernel: ------------[ cut here ]------------ May 02 08:38:17 apollon.suse.de kernel: WARNING: CPU: 1 PID: 25104 at ../fs/btrfs/qgroup.c:2936 btrfs_qgroup_free_meta+0x89/0x90 [btrfs] May 02 08:38:17 apollon.suse.de kernel: Modules linked in: fuse cmac rfcomm ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntr May 02 08:38:17 apollon.suse.de kernel: snd_pcm dell_smm_hwmon snd_timer intel_rapl cfg80211 x86_pkg_temp_thermal snd intel_powerclamp rtsx_pci_ms coretemp kvm_intel memstick kvm irqbypa May 02 08:38:17 apollon.suse.de kernel: aes_x86_64 crypto_simd cryptd glue_helper serio_raw i915 i2c_algo_bit xhci_pci drm_kms_helper xhci_hcd syscopyarea sysfillrect rtsx_pci sysimgblt May 02 08:38:17 apollon.suse.de kernel: CPU: 3 PID: 25104 Comm: rpm Tainted: G U W 4.10.10-1-default #1 May 02 08:38:17 apollon.suse.de kernel: Hardware name: Dell Inc. Latitude E7470/0T6HHJ, BIOS 1.9.4 08/26/2016 May 02 08:38:17 apollon.suse.de kernel: Call Trace: May 02 08:38:17 apollon.suse.de kernel: dump_stack+0x5c/0x7a May 02 08:38:17 apollon.suse.de kernel: __warn+0xbe/0xe0 May 02 08:38:17 apollon.suse.de kernel: btrfs_qgroup_free_meta+0x89/0x90 [btrfs] May 02 08:38:17 apollon.suse.de kernel: start_transaction+0x3a5/0x4a0 [btrfs] May 02 08:38:17 apollon.suse.de kernel: btrfs_rename+0x184/0xd40 [btrfs] May 02 08:38:17 apollon.suse.de kernel: vfs_rename+0x6ba/0x900 May 02 08:38:17 apollon.suse.de kernel: SyS_rename+0x3a6/0x3c0 May 02 08:38:17 apollon.suse.de kernel: entry_SYSCALL_64_fastpath+0x1e/0xad May 02 08:38:17 apollon.suse.de kernel: ---[ end trace f292d529165d04fd ]--- May 02 08:38:17 apollon.suse.de [RPM][25104]: install glibc-locale-2.25-2.1.x86_64: failure May 02 08:38:17 apollon.suse.de [RPM][25104]: 1 elements failed, 0 scripts failed May 02 08:38:17 apollon.suse.de [RPM][25104]: Transaction ID 59082959 finished: -1 May 02 08:38:52 apollon.suse.de [RPM][25109]: Transaction ID 5908297c started May 02 08:38:52 apollon.suse.de [RPM][25109]: erase glibc-extra-2.25-1.1.x86_64: success May 02 08:38:52 apollon.suse.de [RPM][25109]: install glibc-extra-2.25-2.1.x86_64: success May 02 08:38:53 apollon.suse.de [RPM][25109]: erase glibc-extra-2.25-1.1.x86_64: success May 02 08:38:53 apollon.suse.de [RPM][25109]: install glibc-extra-2.25-2.1.x86_64: success May 02 08:38:53 apollon.suse.de [RPM][25109]: Transaction ID 5908297c finished: 0 May 02 08:38:53 apollon.suse.de [RPM][25110]: Transaction ID 5908297d started May 02 08:38:53 apollon.suse.de [RPM][25110]: erase glibc-devel-2.25-1.1.x86_64: success May 02 08:38:53 apollon.suse.de kernel: ------------[ cut here ]------------ May 02 08:38:53 apollon.suse.de kernel: WARNING: CPU: 2 PID: 25110 at ../fs/btrfs/qgroup.c:2936 btrfs_qgroup_free_meta+0x89/0x90 [btrfs] May 02 08:38:53 apollon.suse.de kernel: Modules linked in: fuse cmac rfcomm ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntr May 02 08:38:53 apollon.suse.de kernel: snd_pcm dell_smm_hwmon snd_timer intel_rapl cfg80211 x86_pkg_temp_thermal snd intel_powerclamp rtsx_pci_ms coretemp kvm_intel memstick kvm irqbypa May 02 08:38:53 apollon.suse.de kernel: aes_x86_64 crypto_simd cryptd glue_helper serio_raw i915 i2c_algo_bit xhci_pci drm_kms_helper xhci_hcd syscopyarea sysfillrect rtsx_pci sysimgblt May 02 08:38:53 apollon.suse.de kernel: CPU: 2 PID: 25110 Comm: rpm Tainted: G U W 4.10.10-1-default #1 May 02 08:38:53 apollon.suse.de kernel: Hardware name: Dell Inc. Latitude E7470/0T6HHJ, BIOS 1.9.4 08/26/2016 May 02 08:38:53 apollon.suse.de kernel: Call Trace: May 02 08:38:53 apollon.suse.de kernel: dump_stack+0x5c/0x7a May 02 08:38:53 apollon.suse.de kernel: __warn+0xbe/0xe0 May 02 08:38:53 apollon.suse.de kernel: btrfs_qgroup_free_meta+0x89/0x90 [btrfs] May 02 08:38:53 apollon.suse.de kernel: start_transaction+0x3a5/0x4a0 [btrfs] May 02 08:38:53 apollon.suse.de kernel: btrfs_rename+0x184/0xd40 [btrfs] May 02 08:38:53 apollon.suse.de kernel: vfs_rename+0x6ba/0x900 May 02 08:38:53 apollon.suse.de kernel: SyS_rename+0x3a6/0x3c0 May 02 08:38:53 apollon.suse.de kernel: entry_SYSCALL_64_fastpath+0x1e/0xad May 02 08:38:53 apollon.suse.de kernel: ---[ end trace f292d529165d04fe ]--- May 02 08:38:53 apollon.suse.de [RPM][25110]: install glibc-devel-2.25-2.1.x86_64: failure May 02 08:38:53 apollon.suse.de [RPM][25110]: 1 elements failed, 0 scripts failed May 02 08:38:53 apollon.suse.de [RPM][25110]: Transaction ID 5908297d finished: -1

-- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.suse.com/show_bug.cgi?id=1037118 http://bugzilla.suse.com/show_bug.cgi?id=1037118#c4 --- Comment #4 from Takashi Iwai --- Is this still an issue with the latest TW kernel? -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.suse.com/show_bug.cgi?id=1037118 http://bugzilla.suse.com/show_bug.cgi?id=1037118#c9 --- Comment #9 from Jeff Mahoney --- The WARNINGs are harmless qgroup underflow warnings. I know what the cause is and mostly how to fix them. It's just waiting on the time to do it. The rename failures are more likely spurious ENOSPC errors (which you won't see via 'df' and the like). It should've been fixed in Leap 42.3 via: commit 8bf31dae2ad1a3c5471841801bc4f12233e3c2ec Author: Nikolay Borisov Date: Wed Jun 28 17:39:40 2017 +0300 btrfs: disable possible cause of premature ENOSPC (bsc#1040182) -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.suse.com/show_bug.cgi?id=1037118 http://bugzilla.suse.com/show_bug.cgi?id=1037118#c11 --- Comment #11 from Jeff Mahoney --- Otherwise, the only thing your system has in common is that it's ALSO hitting the same warnings. Your file system is experiencing other issues: [ 51.506124] BTRFS error (device dm-0): bad tree block start 14466633889687238980 I'd suggest validating your hardware and if you see still issues, file a separate report. -- You are receiving this mail because: You are on the CC list for the bug.

http://bugzilla.suse.com/show_bug.cgi?id=1037118 http://bugzilla.suse.com/show_bug.cgi?id=1037118#c13 --- Comment #13 from Martin Wilck --- (In reply to Jeff Mahoney from comment #9)

The rename failures are more likely spurious ENOSPC errors (which you won't see via 'df' and the like).

It should've been fixed in Leap 42.3 via:

commit 8bf31dae2ad1a3c5471841801bc4f12233e3c2ec Author: Nikolay Borisov Date: Wed Jun 28 17:39:40 2017 +0300

btrfs: disable possible cause of premature ENOSPC (bsc#1040182)

Hm, that patch just disables "0001-Btrfs-skip-commit-transaction-if-we-don-t-have-enoug.patch" in Leap 42.3. I saw this on TW, where this patch isn't included, AFAICS (merged upstream only in 4.13-rc1). -- You are receiving this mail because: You are on the CC list for the bug.