High latencies problem.

[Alessandro Ren]

On 2/17/2009 2:14 PM, Alessandro Ren wrote:
> On 2/17/2009 1:50 PM, Gerhard Lausser wrote:
>    
>> Hi,
>>
>> we could lower the latency of a similar installation with these settings:
>> sleep_time=0.01
>> service_inter_check_delay_method=0.1
>> service_interleave_factor=2
>>      

     Latency is still high, I cound not noticed any change. Bellow the 
nagios -s output.

OBJECT CONFIG PROCESSING TIMES      (* = Potential for precache savings 
with -u option)
----------------------------------
Read:                 0.473605 sec
Resolve:              0.073667 sec  *
Recomb Contactgroups: 0.002955 sec  *
Recomb Hostgroups:    0.003250 sec  *
Dup Services:         0.046368 sec  *
Recomb Servicegroups: 0.001850 sec  *
Duplicate:            0.017076 sec  *
Inherit:              0.009637 sec  *
Recomb Contacts:      0.000001 sec  *
Sort:                 0.000001 sec  *
Register:             0.070498 sec
Free:                 0.009762 sec
                       ============
TOTAL:                0.733946 sec  * = 0.180081 sec (24.54%) estimated 
savings


RETENTION DATA TIMES
----------------------------------
Read and Process:     1.328613 sec
                       ============
TOTAL:                1.328613 sec


Timing information on configuration verification is listed below.

CONFIG VERIFICATION TIMES          (* = Potential for speedup with -x 
option)
----------------------------------
Object Relationships: 0.106222 sec
Circular Paths:       0.008335 sec  *
Misc:                 0.009630 sec
                       ============
TOTAL:                0.124187 sec  * = 0.008335 sec (6.7%) estimated 
savings


EVENT SCHEDULING TIMES
-------------------------------------
Get service info:        0.042879 sec
Get host info info:      0.000218 sec
Get service params:      0.000010 sec
Schedule service times:  0.132626 sec
Schedule service events: 0.507549 sec
Get host params:         0.000003 sec
Schedule host times:     0.001774 sec
Schedule host events:    0.197066 sec
                          ============
TOTAL:                   0.882125 sec


Projected scheduling information for host and service checks
is listed below.  This information assumes that you are going
to start running Nagios with your current config files.

HOST SCHEDULING INFORMATION
---------------------------
Total hosts:                     427
Total scheduled hosts:           427
Host inter-check delay method:   SMART
Average host check interval:     300.00 sec
Host inter-check delay:          0.70 sec
Max host check spread:           30 min
First scheduled check:           Tue Feb 17 14:39:59 2009
Last scheduled check:            Tue Feb 17 14:44:58 2009


SERVICE SCHEDULING INFORMATION
-------------------------------
Total services:                     11160
Total scheduled services:           11159
Service inter-check delay method:   USER-SUPPLIED VALUE
Inter-check delay:                  0.10 sec
Interleave factor method:           USER-SUPPLIED VALUE
Service interleave factor:          2
Max service check spread:           30 min
First scheduled check:              Tue Feb 17 14:49:17 2009
Last scheduled check:               Wed Feb 18 03:00:00 2009


CHECK PROCESSING INFORMATION
----------------------------
Check result reaper interval:       5 sec
Max concurrent service checks:      32384

[]s.

>>
>>      
>
>       I will try them and let you know.
>       Tks a lot.
>       I am wondering is theat event loop would not work better if we had
> some threads doing the high and low priority events?
>
>       []s.
>    
>> Gerhard
>>
>>
>>      
>>> -----Ursprüngliche Nachricht-----
>>> Von: Alessandro Ren [mailto:alessandro.ren at opservices.com.br]
>>> Gesendet: Dienstag, 17. Februar 2009 17:18
>>> An: Nagios Developers List
>>> Betreff: [Nagios-devel] High latencies problem.
>>>
>>>
>>>       Hello,
>>>
>>> I have a nagios system running with 427 hosts and 11160
>>> services and since I reached 8000 services, I am having
>>> problems with the latency beeing around 100s and 200s.
>>>       use_large_installation_tweaks is enabled,
>>> max_concurrent_checks have been tested with 0 and higher
>>> values and I have tested this setup in two different HWs, a
>>> dual core with 4GB RAM 32 bits a a Dual Xeon Dual core 64bits
>>> with 8GB of RAM. We are using REdHat enterprise 5.
>>>       Also reaper is already at 2s, host checks with cache
>>> horizon are enabled with a max retry of 3, all services check
>>> every 5min.
>>>       I have no service dependency set up.
>>>       I've noticed that nagios is not spawning too many
>>> processes as another nagios I have running which has far less
>>> servicexs and it seems that the event loop if lagging behing,
>>> in my debugs.
>>>       Any ideas what could I do to fix that? Have I reached a
>>> limit in nagios pooler code?
>>>
>>>       Tks.
>>>
>>> -- 
>>> Alessandro Ren
>>> http://www.opservices.com.br
>>> alessandro.ren at opservices.com.br
>>>
>>> --------------------------------------------------------------
>>> ----------------
>>> Open Source Business Conference (OSBC), March 24-25, 2009,
>>> San Francisco, CA
>>> -OSBC tackles the biggest issue in open source: Open Sourcing
>>> the Enterprise
>>> -Strategies to boost innovation and cut costs with open
>>> source participation
>>> -Receive a $600 discount off the registration fee with the
>>> source code: SFAD
>>> http://p.sf.net/sfu/XcvMzF8H
>>> _______________________________________________
>>> Nagios-devel mailing list
>>> Nagios-devel at lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/nagios-devel
>>>
>>>
>>>        
>> ------------------------------------------------------------------------------
>> Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
>> -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
>> -Strategies to boost innovation and cut costs with open source participation
>> -Receive a $600 discount off the registration fee with the source code: SFAD
>> http://p.sf.net/sfu/XcvMzF8H
>> _______________________________________________
>> Nagios-devel mailing list
>> Nagios-devel at lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/nagios-devel
>>
>>      
>
> ------------------------------------------------------------------------------
> Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
> -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
> -Strategies to boost innovation and cut costs with open source participation
> -Receive a $600 discount off the registration fee with the source code: SFAD
> http://p.sf.net/sfu/XcvMzF8H
> _______________________________________________
> Nagios-devel mailing list
> Nagios-devel at lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/nagios-devel
>    

------------------------------------------------------------------------------
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H