[opensuse] Broken perl?
Hi, For years I have run a weekly perl script that checks the integrity of some files (md5checksum comparisons), and then mails me a reassuring message. Today I got the following error message: *** Error in `/usr/bin/perl': double free or corruption (!prev): 0x000000000209fdd0 *** ======= Backtrace: ========= /lib64/libc.so.6(+0x7abf6)[0x7f35724efbf6] /lib64/libc.so.6(+0x7b973)[0x7f35724f0973] /usr/bin/perl(Perl_av_extend+0x1ed)[0x49ce5d] /usr/bin/perl(Perl_stack_grow+0x22)[0x4d2d72] /usr/bin/perl(Perl_pp_gv+0x24)[0x49f654] /usr/bin/perl(Perl_runops_standard+0x16)[0x49ee16] /usr/bin/perl(perl_run+0x402)[0x43cbb2] /usr/bin/perl(main+0x11b)[0x41ec5b] /lib64/libc.so.6(__libc_start_main+0xf5)[0x7f3572496a15] /usr/bin/perl[0x41ec95] ======= Memory map: ======== 00400000-00571000 r-xp 00000000 08:07 10853 /usr/bin/perl 00770000-00771000 r--p 00170000 08:07 10853 /usr/bin/perl 00771000-00776000 rw-p 00171000 08:07 10853 /usr/bin/perl 017cf000-0245d000 rw-p 00000000 00:00 0 [heap] 7f3572058000-7f357206d000 r-xp 00000000 08:07 785018 /lib64/libgcc_s.so.1 7f357206d000-7f357226c000 ---p 00015000 08:07 785018 /lib64/libgcc_s.so.1 7f357226c000-7f357226d000 r--p 00014000 08:07 785018 /lib64/libgcc_s.so.1 7f357226d000-7f357226e000 rw-p 00015000 08:07 785018 /lib64/libgcc_s.so.1 7f357226e000-7f3572274000 r-xp 00000000 08:07 1839943 /usr/lib/perl5/5.16.2/x86_64-linux-thread-multi/auto/File/Glob/Glob.so 7f3572274000-7f3572473000 ---p 00006000 08:07 1839943 /usr/lib/perl5/5.16.2/x86_64-linux-thread-multi/auto/File/Glob/Glob.so 7f3572473000-7f3572474000 r--p 00005000 08:07 1839943 /usr/lib/perl5/5.16.2/x86_64-linux-thread-multi/auto/File/Glob/Glob.so 7f3572474000-7f3572475000 rw-p 00006000 08:07 1839943 /usr/lib/perl5/5.16.2/x86_64-linux-thread-multi/auto/File/Glob/Glob.so 7f3572475000-7f3572618000 r-xp 00000000 08:07 784908 /lib64/libc-2.17.so 7f3572618000-7f3572818000 ---p 001a3000 08:07 784908 /lib64/libc-2.17.so 7f3572818000-7f357281c000 r--p 001a3000 08:07 784908 /lib64/libc-2.17.so 7f357281c000-7f357281e000 rw-p 001a7000 08:07 784908 /lib64/libc-2.17.so 7f357281e000-7f3572822000 rw-p 00000000 00:00 0 7f3572822000-7f3572839000 r-xp 00000000 08:07 784934 /lib64/libpthread-2.17.so 7f3572839000-7f3572a38000 ---p 00017000 08:07 784934 /lib64/libpthread-2.17.so 7f3572a38000-7f3572a39000 r--p 00016000 08:07 784934 /lib64/libpthread-2.17.so 7f3572a39000-7f3572a3a000 rw-p 00017000 08:07 784934 /lib64/libpthread-2.17.so 7f3572a3a000-7f3572a3e000 rw-p 00000000 00:00 0 7f3572a3e000-7f3572a4a000 r-xp 00000000 08:07 784912 /lib64/libcrypt-2.17.so 7f3572a4a000-7f3572c4a000 ---p 0000c000 08:07 784912 /lib64/libcrypt-2.17.so 7f3572c4a000-7f3572c4b000 r--p 0000c000 08:07 784912 /lib64/libcrypt-2.17.so 7f3572c4b000-7f3572c4c000 rw-p 0000d000 08:07 784912 /lib64/libcrypt-2.17.so 7f3572c4c000-7f3572c7a000 rw-p 00000000 00:00 0 7f3572c7a000-7f3572c7d000 r-xp 00000000 08:07 784914 /lib64/libdl-2.17.so 7f3572c7d000-7f3572e7c000 ---p 00003000 08:07 784914 /lib64/libdl-2.17.so 7f3572e7c000-7f3572e7d000 r--p 00002000 08:07 784914 /lib64/libdl-2.17.so 7f3572e7d000-7f3572e7e000 rw-p 00003000 08:07 784914 /lib64/libdl-2.17.so 7f3572e7e000-7f3572f7b000 r-xp 00000000 08:07 784916 /lib64/libm-2.17.so 7f3572f7b000-7f357317a000 ---p 000fd000 08:07 784916 /lib64/libm-2.17.so 7f357317a000-7f357317b000 r--p 000fc000 08:07 784916 /lib64/libm-2.17.so 7f357317b000-7f357317c000 rw-p 000fd000 08:07 784916 /lib64/libm-2.17.so 7f357317c000-7f357319d000 r-xp 00000000 08:07 784901 /lib64/ld-2.17.so 7f3573379000-7f357337d000 rw-p 00000000 00:00 0 7f357339b000-7f357339d000 rw-p 00000000 00:00 0 7f357339d000-7f357339e000 r--p 00021000 08:07 784901 /lib64/ld-2.17.so 7f357339e000-7f357339f000 rw-p 00022000 08:07 784901 /lib64/ld-2.17.so 7f357339f000-7f35733a0000 rw-p 00000000 00:00 0 7ffff3607000-7ffff3628000 rw-p 00000000 00:00 0 [stack] 7ffff371c000-7ffff371d000 r-xp 00000000 00:00 0 [vdso] ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall] The script hasn't changed, so it must be due to a recent 'upgrade' to perl. /lib64/libc.so.6 is a symlink to libc-2.17.so which is also in /lib64/ Where should I start trying to solve this problem? Bob -- Bob Williams System: Linux 3.7.10-1.1-desktop Distro: openSUSE 12.3 (x86_64) with KDE Development Platform: 4.10.1 "release 545" Uptime: 06:00am up 1 day 16:20, 3 users, load average: 0.24, 0.14, 0.14 -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
On Sat, Apr 06, 2013 at 10:31:07AM +0100, Bob Williams wrote:
For years I have run a weekly perl script that checks the integrity of some files (md5checksum comparisons), and then mails me a reassuring message.
Today I got the following error message:
*** Error in `/usr/bin/perl': double free or corruption (!prev): 0x000000000209fdd0 *** ======= Backtrace: ========= /lib64/libc.so.6(+0x7abf6)[0x7f35724efbf6] /lib64/libc.so.6(+0x7b973)[0x7f35724f0973] /usr/bin/perl(Perl_av_extend+0x1ed)[0x49ce5d] /usr/bin/perl(Perl_stack_grow+0x22)[0x4d2d72] /usr/bin/perl(Perl_pp_gv+0x24)[0x49f654] /usr/bin/perl(Perl_runops_standard+0x16)[0x49ee16] /usr/bin/perl(perl_run+0x402)[0x43cbb2] /usr/bin/perl(main+0x11b)[0x41ec5b] /lib64/libc.so.6(__libc_start_main+0xf5)[0x7f3572496a15] /usr/bin/perl[0x41ec95] ======= Memory map: ======== 00400000-00571000 r-xp 00000000 08:07 10853 /usr/bin/perl 00770000-00771000 r--p 00170000 08:07 10853 /usr/bin/perl 00771000-00776000 rw-p 00171000 08:07 10853 /usr/bin/perl 017cf000-0245d000 rw-p 00000000 00:00 0 [heap] 7f3572058000-7f357206d000 r-xp 00000000 08:07 785018 /lib64/libgcc_s.so.1 7f357206d000-7f357226c000 ---p 00015000 08:07 785018 /lib64/libgcc_s.so.1 7f357226c000-7f357226d000 r--p 00014000 08:07 785018 /lib64/libgcc_s.so.1 7f357226d000-7f357226e000 rw-p 00015000 08:07 785018 /lib64/libgcc_s.so.1 7f357226e000-7f3572274000 r-xp 00000000 08:07 1839943 /usr/lib/perl5/5.16.2/x86_64-linux-thread-multi/auto/File/Glob/Glob.so 7f3572274000-7f3572473000 ---p 00006000 08:07 1839943 /usr/lib/perl5/5.16.2/x86_64-linux-thread-multi/auto/File/Glob/Glob.so 7f3572473000-7f3572474000 r--p 00005000 08:07 1839943 /usr/lib/perl5/5.16.2/x86_64-linux-thread-multi/auto/File/Glob/Glob.so 7f3572474000-7f3572475000 rw-p 00006000 08:07 1839943 /usr/lib/perl5/5.16.2/x86_64-linux-thread-multi/auto/File/Glob/Glob.so 7f3572475000-7f3572618000 r-xp 00000000 08:07 784908 /lib64/libc-2.17.so 7f3572618000-7f3572818000 ---p 001a3000 08:07 784908 /lib64/libc-2.17.so 7f3572818000-7f357281c000 r--p 001a3000 08:07 784908 /lib64/libc-2.17.so 7f357281c000-7f357281e000 rw-p 001a7000 08:07 784908 /lib64/libc-2.17.so 7f357281e000-7f3572822000 rw-p 00000000 00:00 0 7f3572822000-7f3572839000 r-xp 00000000 08:07 784934 /lib64/libpthread-2.17.so 7f3572839000-7f3572a38000 ---p 00017000 08:07 784934 /lib64/libpthread-2.17.so 7f3572a38000-7f3572a39000 r--p 00016000 08:07 784934 /lib64/libpthread-2.17.so 7f3572a39000-7f3572a3a000 rw-p 00017000 08:07 784934 /lib64/libpthread-2.17.so 7f3572a3a000-7f3572a3e000 rw-p 00000000 00:00 0 7f3572a3e000-7f3572a4a000 r-xp 00000000 08:07 784912 /lib64/libcrypt-2.17.so 7f3572a4a000-7f3572c4a000 ---p 0000c000 08:07 784912 /lib64/libcrypt-2.17.so 7f3572c4a000-7f3572c4b000 r--p 0000c000 08:07 784912 /lib64/libcrypt-2.17.so 7f3572c4b000-7f3572c4c000 rw-p 0000d000 08:07 784912 /lib64/libcrypt-2.17.so 7f3572c4c000-7f3572c7a000 rw-p 00000000 00:00 0 7f3572c7a000-7f3572c7d000 r-xp 00000000 08:07 784914 /lib64/libdl-2.17.so 7f3572c7d000-7f3572e7c000 ---p 00003000 08:07 784914 /lib64/libdl-2.17.so 7f3572e7c000-7f3572e7d000 r--p 00002000 08:07 784914 /lib64/libdl-2.17.so 7f3572e7d000-7f3572e7e000 rw-p 00003000 08:07 784914 /lib64/libdl-2.17.so 7f3572e7e000-7f3572f7b000 r-xp 00000000 08:07 784916 /lib64/libm-2.17.so 7f3572f7b000-7f357317a000 ---p 000fd000 08:07 784916 /lib64/libm-2.17.so 7f357317a000-7f357317b000 r--p 000fc000 08:07 784916 /lib64/libm-2.17.so 7f357317b000-7f357317c000 rw-p 000fd000 08:07 784916 /lib64/libm-2.17.so 7f357317c000-7f357319d000 r-xp 00000000 08:07 784901 /lib64/ld-2.17.so 7f3573379000-7f357337d000 rw-p 00000000 00:00 0 7f357339b000-7f357339d000 rw-p 00000000 00:00 0 7f357339d000-7f357339e000 r--p 00021000 08:07 784901 /lib64/ld-2.17.so 7f357339e000-7f357339f000 rw-p 00022000 08:07 784901 /lib64/ld-2.17.so 7f357339f000-7f35733a0000 rw-p 00000000 00:00 0 7ffff3607000-7ffff3628000 rw-p 00000000 00:00 0 [stack] 7ffff371c000-7ffff371d000 r-xp 00000000 00:00 0 [vdso] ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall]
The script hasn't changed, so it must be due to a recent 'upgrade' to perl.
I somewhat doubt that, you're the first one to report such a problem.
/lib64/libc.so.6 is a symlink to libc-2.17.so which is also in /lib64/
Where should I start trying to solve this problem?
Please install the 'perl-debuginfo' and 'valgrind' packages and then use valgrind to narrow down the bug. Thanks, Michael. -- Michael Schroeder mls@suse.de SUSE LINUX Products GmbH, GF Jeff Hawn, HRB 16746 AG Nuernberg main(_){while(_=~getchar())putchar(~_-1/(~(_|32)/13*2-11)*13);} -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
On 08/04/13 10:08, Michael Schroeder wrote:
On Sat, Apr 06, 2013 at 10:31:07AM +0100, Bob Williams wrote:
For years I have run a weekly perl script that checks the integrity of some files (md5checksum comparisons), and then mails me a reassuring message.
Today I got the following error message: [snip]
Please install the 'perl-debuginfo' and 'valgrind' packages and then use valgrind to narrow down the bug.
Thanks, Michael.
Did you mean perl-Debug-Trace? There doesn't seem to be a perl-debuginfo in the openSUSE repos. valgrind now installed. I'm away for a few days, but I'll tackle this when I get back. Thank you for your interest. Bob -- Bob Williams System: Linux 3.7.10-1.1-desktop Distro: openSUSE 12.3 (x86_64) with KDE Development Platform: 4.10.2 "release 553" Uptime: 06:00am up 1 day 12:24, 3 users, load average: 0.17, 0.16, 0.24 -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
Bob Williams [08.04.2013 11:39]:
On 08/04/13 10:08, Michael Schroeder wrote:
On Sat, Apr 06, 2013 at 10:31:07AM +0100, Bob Williams wrote:
For years I have run a weekly perl script that checks the integrity of some files (md5checksum comparisons), and then mails me a reassuring message.
Today I got the following error message: [snip]
Please install the 'perl-debuginfo' and 'valgrind' packages and then use valgrind to narrow down the bug.
Thanks, Michael.
Did you mean perl-Debug-Trace? There doesn't seem to be a perl-debuginfo in the openSUSE repos. valgrind now installed.
Maybe you need to activate repo-debug first. The URL should be <http://download.opensuse.org/debug/distribution/12.3/repo/oss> HTH Werner -- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
Werner Flamme wrote:
Bob Williams [08.04.2013 11:39]:
On 08/04/13 10:08, Michael Schroeder wrote:
On Sat, Apr 06, 2013 at 10:31:07AM +0100, Bob Williams wrote:
For years I have run a weekly perl script that checks the integrity of some files (md5checksum comparisons), and then mails me a reassuring message.
Today I got the following error message: [snip] Please install the 'perl-debuginfo' and 'valgrind' packages and then use valgrind to narrow down the bug.
Thanks, Michael.
Did you mean perl-Debug-Trace? There doesn't seem to be a perl-debuginfo in the openSUSE repos. valgrind now installed.
Maybe you need to activate repo-debug first. The URL should be <http://download.opensuse.org/debug/distribution/12.3/repo/oss>
I suggest we wait until Bob reports the details of his perl version. If it is self-inflicted damage, as looks possible, there's no point in digging deeper to find the cause. Installing additional software before fixing the underlying cause may compound the problem. -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
Bob Williams wrote:
Hi,
For years I have run a weekly perl script that checks the integrity of some files (md5checksum comparisons), and then mails me a reassuring message.
Today I got the following error message:
*** Error in `/usr/bin/perl': double free or corruption (!prev):
Have you googled that? Do you use threads?
The script hasn't changed, so it must be due to a recent 'upgrade' to perl. /lib64/libc.so.6 is a symlink to libc-2.17.so which is also in /lib64/
Why do you point this out? Are you saying it is not the standard library? You must run perl with the library with which it was compiled. (Or recompile perl of course, but you probably want to leave the system untouched and install a local copy if you want/need to do that). Please show the result of perl -V
Where should I start trying to solve this problem?
-- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
On 08/04/13 11:46, Dave Howorth wrote:
Please show the result of perl -V
:~> perl -V Summary of my perl5 (revision 5 version 16 subversion 2) configuration: Platform: osname=linux, osvers=3.4.6-2.10-xen, archname=x86_64-linux-thread-multi uname='linux build05 3.4.6-2.10-xen #1 smp thu jul 26 09:36:26 utc 2012 (641c197) x86_64 x86_64 x86_64 gnulinux ' config_args='-ds -e -Dprefix=/usr -Dvendorprefix=/usr -Dinstallusrbinperl -Dusethreads -Di_db -Di_dbm -Di_ndbm -Di_gdbm -Dd_dbm_open -Duseshrplib=true -Doptimize=-fmessage-length=0 -O2 -Wall -D_FORTIFY_SOURCE=2 -fstack-protector -funwind-tables -fasynchronous-unwind-tables -g -Wall -pipe -Accflags=-DPERL_USE_SAFE_PUTENV -Dotherlibdirs=/usr/lib/perl5/site_perl' hint=recommended, useposix=true, d_sigaction=define useithreads=define, usemultiplicity=define useperlio=define, d_sfio=undef, uselargefiles=define, usesocks=undef use64bitint=define, use64bitall=define, uselongdouble=undef usemymalloc=n, bincompat5005=undef Compiler: cc='cc', ccflags ='-D_REENTRANT -D_GNU_SOURCE -DPERL_USE_SAFE_PUTENV -fno-strict-aliasing -pipe -fstack-protector -D_LARGEFILE_SOURCE -D_FILE_OFFSET_BITS=64', optimize='-fmessage-length=0 -O2 -Wall -D_FORTIFY_SOURCE=2 -fstack-protector -funwind-tables -fasynchronous-unwind-tables -g -Wall -pipe', cppflags='-D_REENTRANT -D_GNU_SOURCE -DPERL_USE_SAFE_PUTENV -fno-strict-aliasing -pipe -fstack-protector' ccversion='', gccversion='4.7.2 20130108 [gcc-4_7-branch revision 195012]', gccosandvers='' intsize=4, longsize=8, ptrsize=8, doublesize=8, byteorder=12345678 d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=16 ivtype='long', ivsize=8, nvtype='double', nvsize=8, Off_t='off_t', lseeksize=8 alignbytes=8, prototype=define Linker and Libraries: ld='cc', ldflags =' -L/usr/local/lib64 -fstack-protector' libpth=/lib64 /usr/lib64 /usr/local/lib64 libs=-lm -ldl -lcrypt -lpthread perllibs=-lm -ldl -lcrypt -lpthread libc=/lib64/libc-2.17.so, so=so, useshrplib=true, libperl=libperl.so gnulibc_version='2.17' Dynamic Linking: dlsrc=dl_dlopen.xs, dlext=so, d_dlsymun=undef, ccdlflags='-Wl,-E -Wl,-rpath,/usr/lib/perl5/5.16.2/x86_64-linux-thread-multi/CORE' cccdlflags='-fPIC', lddlflags='-shared -L/usr/local/lib64 -fstack-protector' Characteristics of this binary (from libperl): Compile-time options: HAS_TIMES MULTIPLICITY PERLIO_LAYERS PERL_DONT_CREATE_GVSV PERL_IMPLICIT_CONTEXT PERL_MALLOC_WRAP PERL_PRESERVE_IVUV PERL_USE_SAFE_PUTENV USE_64_BIT_ALL USE_64_BIT_INT USE_ITHREADS USE_LARGE_FILES USE_LOCALE USE_LOCALE_COLLATE USE_LOCALE_CTYPE USE_LOCALE_NUMERIC USE_PERLIO USE_PERL_ATOF USE_REENTRANT_API Built under linux Compiled at Mar 11 2013 11:06:30 @INC: /usr/lib/perl5/site_perl/5.16.2/x86_64-linux-thread-multi /usr/lib/perl5/site_perl/5.16.2 /usr/lib/perl5/vendor_perl/5.16.2/x86_64-linux-thread-multi /usr/lib/perl5/vendor_perl/5.16.2 /usr/lib/perl5/5.16.2/x86_64-linux-thread-multi /usr/lib/perl5/5.16.2 /usr/lib/perl5/site_perl/5.16.2/x86_64-linux-thread-multi /usr/lib/perl5/site_perl/5.16.2 /usr/lib/perl5/site_perl . Bob -- Bob Williams System: Linux 3.7.10-1.1-desktop Distro: openSUSE 12.3 (x86_64) with KDE Development Platform: 4.10.2 "release 553" Uptime: 06:00am up 2 days 12:55, 3 users, load average: 0.83, 0.83, 0.76 -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
Hi Bob, Am 06.04.2013 11:31, schrieb Bob Williams:
For years I have run a weekly perl script that checks the integrity of some files (md5checksum comparisons), and then mails me a reassuring message.
Today I got the following error message: ...
Where should I start trying to solve this problem?
I am curious about the output of rpm -qi perl and zypper se -s --match-exact perl Christopher -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
On 18/04/13 14:39, Christopher Hofmann wrote:
Hi Bob,
Am 06.04.2013 11:31, schrieb Bob Williams:
For years I have run a weekly perl script that checks the integrity of some files (md5checksum comparisons), and then mails me a reassuring message.
Today I got the following error message: ...
Where should I start trying to solve this problem?
I am curious about the output of
rpm -qi perl
:~> rpm -qi perl Name : perl Version : 5.16.2 Release : 2.5.1 Architecture: x86_64 Install Date: Sun 14 Apr 2013 12:49:18 BST Group : Development/Languages/Perl Size : 38299648 License : Artistic-1.0 or GPL-2.0+ Signature : RSA/SHA256, Wed 20 Mar 2013 09:47:44 GMT, Key ID b88b2fd43dbdc284 Source RPM : perl-5.16.2-2.5.1.src.rpm Build Date : Mon 11 Mar 2013 11:47:28 GMT Build Host : build05 Relocations : (not relocatable) Packager : http://bugs.opensuse.org Vendor : openSUSE URL : http://www.perl.org/ Summary : The Perl interpreter Description : perl - Practical Extraction and Report Language Perl is optimized for scanning arbitrary text files, extracting information from those text files, and printing reports based on that information. It is also good for many system management tasks. Perl is intended to be practical (easy to use, efficient, and complete) rather than beautiful (tiny, elegant, and minimal). Some of the modules available on CPAN can be found in the "perl" series. Distribution: openSUSE 12.3
and
zypper se -s --match-exact perl
S | Name | Type | Version | Arch | Repository --+------+------------+--------------+--------+--------------------- i | perl | package | 5.16.2-2.5.1 | x86_64 | openSUSE-12.3-Update v | perl | package | 5.16.2-2.1.4 | x86_64 | openSUSE-12.3-1.7 v | perl | package | 5.16.2-2.5.1 | i586 | openSUSE-12.3-Update v | perl | package | 5.16.2-2.1.4 | i586 | openSUSE-12.3-1.7 | perl | srcpackage | 5.16.2-2.5.1 | noarch | openSUSE-12.3-Update -- Bob Williams System: Linux 3.7.10-1.1-desktop Distro: openSUSE 12.3 (x86_64) with KDE Development Platform: 4.10.2 "release 553" Uptime: 06:00am up 2 days 12:55, 3 users, load average: 0.83, 0.83, 0.76 -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org To contact the owner, e-mail: opensuse+owner@opensuse.org
participants (5)
-
Bob Williams -
Christopher Hofmann -
Dave Howorth -
Michael Schroeder -
Werner Flamme