Notifications severely impacting Nagios performance. Ideas?

[Arlen Drina]

Hello Ryan,

I do not know what is organization of your network, but maybe you
could take a look into service/host dependency.
It depends on your network organization, but I think it could help

http://nagios.sourceforge.net/docs/2_0/dependencies.html

its purpose is to suppress notifications in case "main" host is down,
in such case you get only notification about that problem.

As I beleive that you have some gateway/router and in case it has some
problems you are getting many notifications, and I think it
is rara that many hosts have some local problem at same time

Hope this helps

Nice regards,

Arlen

On Tue, Aug 25, 2009 at 4:43 AM, Ryan Bowlby<rbowlby83 at yahoo.com> wrote:
> Hello Everyone,
>
> We are experiencing issues with Nagios notifications. Apparently when a large amount of services become critical and trigger notifications the system all but stops processing new service check results (passive). The "last check times" in the web interface stop updating until notifications are disabled.
>
> Tailing the nagios.log file during this issue shows mostly notifications and hardly any check results being processed. As soon as I temporarily disable notifications - system wide - the passive check results literally fly off the screen, and all the stale results in the web interface clear up quickly.
>
> How does everyone handle this issue? Obviously the notifications are a bottleneck. Has anyone configured notifications to be dropped in a file or fifo to be processed by an external daemon? Something like OCP daemon if anyone is familiar with it.
>
> Obviously parent child relationships would prove useful in curbing the notifications, but implementation of relationships is a while off (5 D.C.s lot's a data to have to collect). Any suggestions would be greatly appreciated!
>
> -Ryan B.
>
> ==========================================================================
>
> FreeBSD 7.0-RELEASE amd64, Nagios 3.0 w/ NDO2DB 1.4b7
> Total Hosts: 3741, Total Services: 9321
>
>
>
>
>
> ------------------------------------------------------------------------------
> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
> trial. Simplify your report design, integration and deployment - and focus on
> what you do best, core application coding. Discover what's new with
> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
> _______________________________________________
> Nagios-users mailing list
> Nagios-users at lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/nagios-users
> ::: Please include Nagios version, plugin version (-v) and OS when reporting any issue.
> ::: Messages without supporting info will risk being sent to /dev/null
>

------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day 
trial. Simplify your report design, integration and deployment - and focus on 
what you do best, core application coding. Discover what's new with 
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
Nagios-users mailing list
Nagios-users at lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nagios-users
::: Please include Nagios version, plugin version (-v) and OS when reporting any issue. 
::: Messages without supporting info will risk being sent to /dev/null