Nagios and Gearman - huge environment performance problem

[Daniel Wittenberg]

One simple thing that might help is just run vmstat for a couple minutes:

vmstat 5

That can help show if you are hitting some bottlenecks.  Are you using a lot of macros in your configs?

Dan

From: Rodney Ramos [mailto:rodneyra at gmail.com]
Sent: Friday, August 19, 2011 9:30 AM
To: Nagios Developers List
Subject: [Nagios-devel] Nagios and Gearman - huge environment performance problem

Hi everybody,

I´m testing Nagios and Gearman / Mod_Gearman. I´d like to change NSCA with this new approach, as it seems easier to configure and has a lot of advantages. Besides, NSCA and Nagios freshness mechanism have some problems.

Gearman and mod_gearman are working well. I have 30000 hosts and 60000 services, and it is increasing!

Now I´m having problem with Nagios performance, that eats 100% of CPU and the host and service latency is very big, around 300 seconds. I think that this a Nagios problem, as the gearman_top shows the Job Wainting queue empty almost all the time. It seems that Nagios do not send the active checks all the time, an once in while it sends a burst of active checks.

I have a physical central server, running RHEL, with 4 GB of ram, Intel(R) Xeon(R) CPU E5504  @ 2.00GHz (8 CPUs). For the workers I have 9 virtual servers running RHEL too.

I've already set the Nagios parameters to large environment, as recommended in the documentation, but it made no difference. Thanks.

Nagios Parameters to large environment:

- use_large_installation_tweaks=1

- enable_environment_macros=0

- max_concurrent_checks=0

- check_result_reaper_frequency=10
Could someone help me? How can I improve Nagios performance to make active checks faster?

Thank you very much.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.monitoring-lists.org/archive/developers/attachments/20110819/c0d90971/attachment.html>
-------------- next part --------------
------------------------------------------------------------------------------
Get a FREE DOWNLOAD! and learn more about uberSVN rich system, 
user administration capabilities and model configuration. Take 
the hassle out of deploying and managing Subversion and the 
tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2
-------------- next part --------------
_______________________________________________
Nagios-devel mailing list
Nagios-devel at lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nagios-devel