Fwd: Scheduling queue falling behind.

[Robert Stafford]

also
/usr/local/nagios/bin/nagios -s /usr/local/nagios/etc/nagios.cfg

Nagios 2.5
Copyright (c) 1999-2006 Ethan Galstad (http://www.nagios.org)
Last Modified: 07-13-2006
License: GPL

Warning: Contact group 'Adam' is not used in any host/service definitions or
host/service escalations!
Warning: Contact group 'Elaine' is not used in any host/service definitions
or host/service escalations!
Warning: Contact group 'SA_Page' is not used in any host/service definitions
or host/service escalations!
Warning: Contact group 'admins' is not used in any host/service definitions
or host/service escalations!
Projected scheduling information for host and service
checks is listed below.  This information assumes that
you are going to start running Nagios with your current
config files.

HOST SCHEDULING INFORMATION
---------------------------
Total hosts:                     49
Total scheduled hosts:           0
Host inter-check delay method:   SMART
Average host check interval:     0.00 sec
Host inter-check delay:          0.00 sec
Max host check spread:           5 min
First scheduled check:           N/A
Last scheduled check:            N/A


SERVICE SCHEDULING INFORMATION
-------------------------------
Total services:                     142
Total scheduled services:           107
Service inter-check delay method:   SMART
Average service check interval:     339.25 sec
Inter-check delay:                  2.80 sec
Interleave factor method:           SMART
Average services per host:          2.90
Service interleave factor:          3
Max service check spread:           5 min
First scheduled check:              Thu Feb 15 11:22:52 2007
Last scheduled check:               Thu Feb 15 11:27:50 2007


CHECK PROCESSING INFORMATION
----------------------------
Service check reaper interval:      10 sec
Max concurrent service checks:      100


PERFORMANCE SUGGESTIONS
-----------------------
I have no suggestions - things look okay.


---------- Forwarded message ----------
From: Robert Stafford <rdstafford at gmail.com>
Date: Feb 15, 2007 11:18 AM
Subject: Re: [Nagios-users] Scheduling queue falling behind.
To: Trask <trasko at gmail.com>

Performance wise the system isn't hit very hard (2 proc xenon system).  Load
averages over the past few days floats between 0.25 and 0.65.  Time matches
up with all my servers and the machine time in nagios itself.   checking on
how many nagios proccesses are running it seems to stay around 5-8 processes
related to nagios... I see mainly 1 nagios server process 3 or so send
sysylog services.  If i spam refresh top i'll see 2-5 ncsa a proccesses pop
out every once in a while, but they last less than a half a second.

Wow the latencies are bad:
MetricMin.Max.Average Check Execution Time:  0.00 sec0.56 sec0.133 sec Check
Latency:0.00 sec761.00 sec716.944 sec Percent State Change:0.00%0.00%0.00%
nagios.cfg: (took out all commented out fields
-----------------------------------------------------------------------------------

log_file=/usr/local/nagios/var/nagios.log

cfg_file=/usr/local/nagios/etc/checkcommands.cfg
cfg_file=/usr/local/nagios/etc/contact_templates.cfg
cfg_file=/usr/local/nagios/etc/contactgroups.cfg
cfg_file=/usr/local/nagios/etc/contacts.cfg
cfg_file=/usr/local/nagios/etc/escalations.cfg
cfg_file=/usr/local/nagios/etc/extended_host_info.cfg
cfg_file=/usr/local/nagios/etc/extended_host_info_templates.cfg
cfg_file=/usr/local/nagios/etc/host_templates.cfg
cfg_file=/usr/local/nagios/etc/hostgroups.cfg
cfg_file=/usr/local/nagios/etc/hosts_hosts.cfg
cfg_file=/usr/local/nagios/etc/misccommands.cfg
cfg_file=/usr/local/nagios/etc/service_templates.cfg
cfg_file=/usr/local/nagios/etc/servicegroups.cfg
cfg_file=/usr/local/nagios/etc/services.cfg
cfg_file=/usr/local/nagios/etc/time_periods.cfg

resource_file=/usr/local/nagios/etc/private/resource.cfg
temp_file=/usr/local/nagios/var/nagios.tmp
status_file=/usr/local/nagios/var/status.log
aggregate_status_updates=1
status_update_interval=15
nagios_user=nagios
nagios_group=nagios
enable_notifications=1
execute_service_checks=1
accept_passive_service_checks=1
execute_host_checks=0
accept_passive_host_checks=0
enable_event_handlers=1
log_rotation_method=d
log_archive_path=/usr/local/nagios/var/archives
check_external_commands=1
command_check_interval=-1
command_file=/usr/local/nagios/var/spool/nagios.cmd
downtime_file=/usr/local/nagios/var/nagiosdowntime.log
comment_file=/usr/local/nagios/var/nagioscomment.log
lock_file=/tmp/nagios.lock
retain_state_information=1
state_retention_file=/usr/local/nagios/var/nagiosstatus.sav
retention_update_interval=60
use_retained_program_state=1
use_retained_scheduling_info=0
use_syslog=1
log_notifications=1
log_service_retries=1
log_host_retries=1
log_event_handlers=1
log_initial_states=0
log_external_commands=1
log_passive_checks=1
sleep_time=1
service_inter_check_delay_method=s
max_service_check_spread=5
service_interleave_factor=s
max_concurrent_checks=100
service_reaper_frequency=10
max_host_check_spread=5
interval_length=60
low_service_flap_threshold=5.0
high_service_flap_threshold=20.0
low_host_flap_threshold=5.0
high_host_flap_threshold=20.0
service_check_timeout=60
host_check_timeout=30
event_handler_timeout=30
notification_timeout=30
ocsp_timeout=5
perfdata_timeout=5
process_performance_data=1
host_perfdata_command=process-host-perfdata
service_perfdata_command=process-service-perfdata
check_for_orphaned_services=1
check_service_freshness=1
freshness_check_interval=60
check_host_freshness=0
date_format=us
illegal_object_name_chars=`~!$%^&*|'"<>?,()'=
illegal_macro_output_chars=`~$&|'"<>
admin_email=nagios
admin_pager=pagenagios
----------------------------------------------------------------------------------------------------



On 2/15/07, Trask <trasko at gmail.com> wrote:
>
> > Nope.  Everything is on one box.  I do have syslog-ng installed and
> doing
> > passive to nagios on the machine.  I've tried setting
> max_concurent_checks
> > to 0 and changing it up throught 100 but it doesn't seem to make a
> > differance.
>
> Did nagios ever run on time or has it always been like this?
>
> Verify the time on the nagios machine.
>
> What sort of latencies are you seeing when you look at "Performance Info"?
>
> What is the load you are seeing (run "top")?
>
> Run something like the following command to see how many nagios
> related processes are running (this assumes the directory where nagios
> is installed includes the word "nagios").  If you don't have "watch",
> just run the command a bun manually or put it in a never-ending while
> loop.  Watch it for a few minutes (or get fancy and capture / graph
> the output) and get a feel for the numbers and any patterns you see.
> watch -n 1 'ps auxw | grep nagios | wc -l'
>
> Reply with your nagios.cfg.
>



-- 
---------------------------------------------------------
Robert Stafford
Systems Engineer - Xpressbet
robert.stafford at xpressbet.com
rdstafford at gmail.com
----------------------------------------------------------


-- 
---------------------------------------------------------
Robert Stafford
Systems Engineer - Xpressbet
robert.stafford at xpressbet.com
rdstafford at gmail.com
----------------------------------------------------------
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.monitoring-lists.org/archive/users/attachments/20070215/7e466b0d/attachment.html>
-------------- next part --------------
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys-and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
-------------- next part --------------
_______________________________________________
Nagios-users mailing list
Nagios-users at lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nagios-users
::: Please include Nagios version, plugin version (-v) and OS when reporting any issue. 
::: Messages without supporting info will risk being sent to /dev/null