[icinga-users] Icinga 2.4.0 segfault on redhat 6.7

Zachary McGibbon zachary.mcgibbon at gmail.com
Mon Nov 16 18:42:33 CET 2015


I disabled the stock /etc/icinga2/conf.d/downtimes.conf file and it loads
now with no issues.

On Mon, Nov 16, 2015 at 12:30 PM, Zachary McGibbon <
zachary.mcgibbon at gmail.com> wrote:

> From my first gdb output it looks like it could be related to issue 10643
> as it mentioned the RegisterDowntime?
>
> https://dev.icinga.org/issues/10643
>
> On Mon, Nov 16, 2015 at 12:25 PM, Zachary McGibbon <
> zachary.mcgibbon at gmail.com> wrote:
>
>> Trying to get it to crash... but this keeps happening....
>>
>> information/ConfigItem: Instantiated 1 ExternalCommandListener.
>> information/ScriptGlobal: Dumping variables to file
>> '/var/cache/icinga2/icinga2.vars'
>> [Thread 0x7ffff4116700 (LWP 5847) exited]
>> [Thread 0x7ffff40d5700 (LWP 5848) exited]
>> [Thread 0x7ffff4094700 (LWP 5849) exited]
>> [Thread 0x7ffff4053700 (LWP 5850) exited]
>> information/cli: Finished validating the configuration file(s).
>> [Thread 0x7ffff4d07700 (LWP 5846) exited]
>> [Thread 0x7ffff4d48700 (LWP 5845) exited]
>> [Thread 0x7ffff4dca700 (LWP 5841) exited]
>> [Thread 0x7fffeffff700 (LWP 5843) exited]
>> [Thread 0x7ffff4d89700 (LWP 5842) exited]
>> [Thread 0x7fffeffbe700 (LWP 5844) exited]
>> [Thread 0x7fffee30d700 (LWP 5871) exited]
>>
>> Program exited normally.
>>
>>
>> On Mon, Nov 16, 2015 at 12:03 PM, Michael Friedrich <
>> Michael.Friedrich at netways.de> wrote:
>>
>>>
>>> > On 16 Nov 2015, at 17:41, Zachary McGibbon <zachary.mcgibbon at gmail.com>
>>> wrote:
>>> >
>>> > I installed the icinga2-debuginfo, ran gdb but getting stuck.  Tried
>>> installing the other debug packages without success...
>>> >
>>> > Cannot get thread event message: debugger service failed
>>> > Missing separate debuginfos, use: debuginfo-install
>>> glibc-2.12-1.166.el6_7.3.x86_64 keyutils-libs-1.4-5.el6.x86_64
>>> krb5-libs-1.10.3-42.el6.x86_64 libcom_err-1.41.12-22.el6.x86_64
>>> libedit-2.11-4.20080712cvs.1.el6.x86_64 libgcc-4.4.7-16.el6.x86_64
>>> libicu-4.2.1-12.el6.x86_64 libselinux-2.0.94-5.8.el6.x86_64
>>> libstdc++-4.4.7-16.el6.x86_64 mysql-libs-5.1.73-5.el6_6.x86_64
>>> ncurses-libs-5.7-4.20090207.el6.x86_64
>>> nss-softokn-freebl-3.14.3-23.el6_7.x86_64 openssl-1.0.1e-42.el6.x86_64
>>> zlib-1.2.3-29.el6.x86_64
>>> > (gdb) bt full
>>> > Target is executing.
>>>
>>> You need to trigger the crash again, otherwise you cannot generate a
>>> backtrace.
>>>
>>> It certainly helps to install the other debuginfo packages as well,
>>> using the exact same command line as shown above (“debuginfo-install ….”).
>>>
>>> Kind regards,
>>> Michael
>>> >
>>> >
>>> > On Mon, Nov 16, 2015 at 11:24 AM, Michael Friedrich <
>>> Michael.Friedrich at netways.de> wrote:
>>> >
>>> > > On 16 Nov 2015, at 17:22, Zachary McGibbon <
>>> zachary.mcgibbon at gmail.com> wrote:
>>> > >
>>> > > Ok I tried it a few more times with gdb and got it to crash, I'll
>>> open a ticket with this.  Thanks
>>> >
>>> > Mh. Please install the package icinga2-debuginfo and re-run it to
>>> generate a more verbose backtrace.
>>> >
>>> > Thanks,
>>> > Michael
>>> >
>>> > >
>>> > > Program received signal SIGSEGV, Segmentation fault.
>>> > > [Switching to Thread 0x7fffee2cc700 (LWP 5570)]
>>> > > 0x00000038ef609420 in pthread_mutex_lock () from
>>> /lib64/libpthread.so.0
>>> > > Missing separate debuginfos, use: debuginfo-install
>>> icinga2-bin-2.4.0-1.el6.x86_64
>>> > > (gdb) bt full
>>> > > #0  0x00000038ef609420 in pthread_mutex_lock () from
>>> /lib64/libpthread.so.0
>>> > > No symbol table info available.
>>> > > #1  0x00007fffefa8f9b8 in boost::unique_lock<boost::mutex>::lock()
>>> () from /usr/lib64/icinga2/libicinga.so
>>> > > No symbol table info available.
>>> > > #2  0x00007fffef9cff91 in
>>> icinga::Checkable::RegisterDowntime(boost::intrusive_ptr<icinga::Downtime>
>>> const&) () from /usr/lib64/icinga2/libicinga.so
>>> > > No symbol table info available.
>>> > > #3  0x00007fffefa6c2f9 in icinga::Downtime::Start(bool) () from
>>> /usr/lib64/icinga2/libicinga.so
>>> > > No symbol table info available.
>>> > > #4  0x00007ffff738c18e in icinga::ConfigObject::Activate(bool) ()
>>> from /usr/lib64/icinga2/libbase.so
>>> > > No symbol table info available.
>>> > > #5  0x00007ffff739062a in icinga::WorkQueue::WorkerThreadProc() ()
>>> from /usr/lib64/icinga2/libbase.so
>>> > > No symbol table info available.
>>> > > #6  0x00007ffff7de85c3 in ?? () from
>>> /usr/lib64/libboost_thread.so.1.53.0
>>> > > No symbol table info available.
>>> > > #7  0x00000038ef607a51 in start_thread () from /lib64/libpthread.so.0
>>> > > No symbol table info available.
>>> > > #8  0x00000038ef2e893d in clone () from /lib64/libc.so.6
>>> > >
>>> > >
>>> > > On Mon, Nov 16, 2015 at 11:20 AM, Michael Friedrich <
>>> Michael.Friedrich at netways.de> wrote:
>>> > >
>>> > > > On 16 Nov 2015, at 17:14, Zachary McGibbon <
>>> zachary.mcgibbon at gmail.com> wrote:
>>> > > >
>>> > > > Hi Michael, when running icinga2 daemon with gdb it doesn't crash,
>>> it only crashes when i start it with the 'service' command.
>>> > >
>>> > > How exactly does it look like?
>>> > > >
>>> > > > And since 'service' is a shell script it won't run through gdb…
>>> > >
>>> > > Please create a ticket and attach all information collected so far.
>>> > >
>>> > > Kind regards,
>>> > > Michael
>>> > >
>>> > > >
>>> > > > Any other ideas?
>>> > > >
>>> > > > On Mon, Nov 16, 2015 at 11:06 AM, Michael Friedrich <
>>> Michael.Friedrich at netways.de> wrote:
>>> > > >
>>> > > > > On 16 Nov 2015, at 16:35, Zachary McGibbon <
>>> zachary.mcgibbon at gmail.com> wrote:
>>> > > > >
>>> > > > > I'm getting a segfault on 2.4.0 running on redhat 6.7:
>>> > > > >
>>> > > > > [root at icinga-dev1 conf.d]# service icinga2 restart
>>> > > > > Checking configuration: /etc/init.d/icinga2: line 115:  9857
>>> Segmentation fault      $DAEMON daemon -c $ICINGA2_CONFIG_FILE -C >
>>> $ICINGA2_STARTUP_LOG 2>&1
>>> > > >
>>> > > > Please run it with gdb and generate a full back trace
>>> > > >
>>> > > > gdb —args /usr/lib64/icinga2/sbin/icinga2 daemon
>>> > > > r
>>> > > > bt full
>>> > > >
>>> > > > and attach it.
>>> > > >
>>> > > >
>>> > > > > Not restarting Icinga 2 due to configuration errors. Check
>>> '/var/log/icinga2/startup.log' for details.
>>> > > > >
>>> > > > > ... and no errors in the statup.log file
>>> > > > >
>>> > > > > [root at icinga-dev1 conf.d]# grep -i error
>>> /var/log/icinga2/startup.log | wc
>>> > > > >    0       0       0
>>> > > > >
>>> > > > > [root at icinga-dev1 conf.d]# icinga2 --version
>>> > > > > icinga2 - The Icinga 2 network monitoring daemon (version:
>>> v2.4.0)
>>> > > > >
>>> > > > > Copyright (c) 2012-2015 Icinga Development Team (
>>> https://www.icinga.org)
>>> > > > > License GPLv2+: GNU GPL version 2 or later <
>>> http://gnu.org/licenses/gpl2.html>
>>> > > > > This is free software: you are free to change and redistribute
>>> it.
>>> > > > > There is NO WARRANTY, to the extent permitted by law.
>>> > > > >
>>> > > > > Application information:
>>> > > > > Installation root: /usr
>>> > > > > Sysconf directory: /etc
>>> > > > > Run directory: /var/run
>>> > > > > Local state directory: /var
>>> > > > > Package data directory: /usr/share/icinga2
>>> > > > > State path: /var/lib/icinga2/icinga2.state
>>> > > > > Modified attributes path:
>>> /var/lib/icinga2/modified-attributes.conf
>>> > > > > Objects path: /var/cache/icinga2/icinga2.debug
>>> > > > > Vars path: /var/cache/icinga2/icinga2.vars
>>> > > > > PID path: /var/run/icinga2/icinga2.pid
>>> > > > >
>>> > > > > System information:
>>> > > > > Operating system: Linux
>>> > > > > Operating system version: 2.6.32-504.23.4.el6.x86_64
>>> > > > > Architecture: x86_64
>>> > > > > Distribution: "Red Hat Enterprise Linux Server release 6.7
>>> (Santiago)"
>>> > > > >
>>> > > > > _______________________________________________
>>> > > > > icinga-users mailing list
>>> > > > > icinga-users at lists.icinga.org
>>> > > > > https://lists.icinga.org/mailman/listinfo/icinga-users
>>> > > >
>>> > > >
>>> > > > --
>>> > > > Michael Friedrich, DI (FH)
>>> > > > Senior Developer
>>> > > >
>>> > > > NETWAYS GmbH | Deutschherrnstr. 15-19 | D-90429 Nuernberg
>>> > > > Tel: +49 911 92885-0 | Fax: +49 911 92885-77
>>> > > > GF: Julian Hein, Bernd Erk | AG Nuernberg HRB18461
>>> > > > http://www.netways.de | Michael.Friedrich at netways.de
>>> > > >
>>> > > > ** OSMC 2015 - November - netways.de/osmc **
>>> > > > ** OSDC 2016 - April – netways.de/osdc **
>>> > > > _______________________________________________
>>> > > > icinga-users mailing list
>>> > > > icinga-users at lists.icinga.org
>>> > > > https://lists.icinga.org/mailman/listinfo/icinga-users
>>> > > >
>>> > > > _______________________________________________
>>> > > > icinga-users mailing list
>>> > > > icinga-users at lists.icinga.org
>>> > > > https://lists.icinga.org/mailman/listinfo/icinga-users
>>> > >
>>> > >
>>> > > --
>>> > > Michael Friedrich, DI (FH)
>>> > > Senior Developer
>>> > >
>>> > > NETWAYS GmbH | Deutschherrnstr. 15-19 | D-90429 Nuernberg
>>> > > Tel: +49 911 92885-0 | Fax: +49 911 92885-77
>>> > > GF: Julian Hein, Bernd Erk | AG Nuernberg HRB18461
>>> > > http://www.netways.de | Michael.Friedrich at netways.de
>>> > >
>>> > > ** OSMC 2015 - November - netways.de/osmc **
>>> > > ** OSDC 2016 - April – netways.de/osdc **
>>> > > _______________________________________________
>>> > > icinga-users mailing list
>>> > > icinga-users at lists.icinga.org
>>> > > https://lists.icinga.org/mailman/listinfo/icinga-users
>>> > >
>>> > > _______________________________________________
>>> > > icinga-users mailing list
>>> > > icinga-users at lists.icinga.org
>>> > > https://lists.icinga.org/mailman/listinfo/icinga-users
>>> >
>>> >
>>> > --
>>> > Michael Friedrich, DI (FH)
>>> > Senior Developer
>>> >
>>> > NETWAYS GmbH | Deutschherrnstr. 15-19 | D-90429 Nuernberg
>>> > Tel: +49 911 92885-0 | Fax: +49 911 92885-77
>>> > GF: Julian Hein, Bernd Erk | AG Nuernberg HRB18461
>>> > http://www.netways.de | Michael.Friedrich at netways.de
>>> >
>>> > ** OSMC 2015 - November - netways.de/osmc **
>>> > ** OSDC 2016 - April – netways.de/osdc **
>>> > _______________________________________________
>>> > icinga-users mailing list
>>> > icinga-users at lists.icinga.org
>>> > https://lists.icinga.org/mailman/listinfo/icinga-users
>>> >
>>> > _______________________________________________
>>> > icinga-users mailing list
>>> > icinga-users at lists.icinga.org
>>> > https://lists.icinga.org/mailman/listinfo/icinga-users
>>>
>>>
>>> --
>>> Michael Friedrich, DI (FH)
>>> Senior Developer
>>>
>>> NETWAYS GmbH | Deutschherrnstr. 15-19 | D-90429 Nuernberg
>>> Tel: +49 911 92885-0 | Fax: +49 911 92885-77
>>> GF: Julian Hein, Bernd Erk | AG Nuernberg HRB18461
>>> http://www.netways.de | Michael.Friedrich at netways.de
>>>
>>> ** OSMC 2015 - November - netways.de/osmc **
>>> ** OSDC 2016 - April – netways.de/osdc **
>>> _______________________________________________
>>> icinga-users mailing list
>>> icinga-users at lists.icinga.org
>>> https://lists.icinga.org/mailman/listinfo/icinga-users
>>>
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.icinga.org/pipermail/icinga-users/attachments/20151116/a2e733e9/attachment-0001.html>


More information about the icinga-users mailing list