have you tried increasing the amount of pollers? 40 might be kind of few for 1300 devices if you have a lot of them are slow.

/Markus

2015-11-17 21:37 GMT+01:00 Alex Povolotsky <tarkhil@over.ru>:
I've started perl-based poller with much better performance, but not
working on it for long time now, more pressing matters persists.

https://github.com/tarkhil/observium-poller

feel free to improve

On 17.11.2015 23:24, Gediminas Karčmarinas wrote:
> so what do is will be 2000 device and more ? What solution for
> poller.php to run faster ? I already disable all modules but  still is
> take to long
>
> On 2015.11.17 22:12, Alex Povolotsky wrote:
>> poller.php is ugly, it uses external utilities and just cannot run more
>> or less fast.
>>
>> On 17.11.2015 17:22, Gediminas Karčmarinas wrote:
>>> Hello,
>>> Maybe is some way to get better performance with poller.php ?
>>> poller-wrapper.py(24406): /opt/observium/poller-wrapper.py: polled 1310
>>> devices in 270 seconds with 40 workers
>>>
>>> I already disable in what I don't need in
>>> '/opt/observium/includes/defaults.inc.php'
>>> $config['mibs']['SNMPv2-MIB']                        = 1;
>>> $config['mibs']['IF-MIB']                            = 1;
>>> $config['mibs']['OSPF-MIB']                          = 0;
>>> $config['mibs']['EIGRP-MIB']                         = 0;
>>> $config['mibs']['CISCO-MAC-ACCOUNTING-MIB']          = 0;
>>> $config['mibs']['JUNIPER-MAC-MIB']                   = 0;
>>> $config['mibs']['IP-MIB']                            = 1;
>>> $config['mibs']['IPV6-MIB']                          = 0;
>>> $config['mibs']['CISCO-IETF-IP-MIB']                 = 0;
>>> $config['mibs']['BGP4-V2-MIB-JUNIPER']               = 0;
>>> $config['mibs']['FORCE10-BGP4-V2-MIB']               = 0;
>>> $config['mibs']['BGP4-MIB']                          = 0;
>>> $config['mibs']['CISCO-BGP4-MIB']                    = 0;
>>> $config['mibs']['CISCO-CEF-MIB']                     = 0;
>>> $config['mibs']['ENTITY-MIB']                        = 0;
>>> $config['mibs']['CISCO-ENTITY-SENSOR-MIB']           = 0;
>>> $config['mibs']['ENTITY-SENSOR-MIB']                 = 0;
>>> $config['mibs']['CISCO-IETF-PW-MPLS-MIB']            = 0;
>>> $config['mibs']['CISCO-RTTMON-MIB']                  = 0;
>>> $config['mibs']['MPLS-L3VPN-STD-MIB']                = 0;
>>> $config['mibs']['MPLS-VPN-MIB']                      = 0;
>>> $config['mibs']['FOUNDRY-SN-SWITCH-GROUP-MIB']       = 0;
>>> $config['mibs']['LLDP-MIB']                          = 0;
>>> $config['mibs']['BRIDGE-MIB']                        = 0;
>>> $config['mibs']['HOST-RESOURCES-MIB']                = 0;
>>> $config['mibs']['Juniper-UNI-ATM-MIB']               = 0;
>>> $config['mibs']['UCD-SNMP-MIB']                      = 0;
>>> $config['mibs']['UCD-DISKIO-MIB']                    = 0;
>>> $config['mibs']['Q-BRIDGE-MIB']                      = 0;
>>> $config['mibs']['VMWARE-VMINFO-MIB']                 = 0;
>>> $config['mibs']['EtherLike-MIB']                     = 0;
>>>
>>> $config['poller_modules']['unix-agent']                   = 0;
>>> $config['poller_modules']['ipmi']                         = 0;
>>> $config['poller_modules']['sensors']                      = 1;
>>> $config['poller_modules']['status']                       = 1;
>>> $config['poller_modules']['processors']                   = 1;
>>> $config['poller_modules']['mempools']                     = 1;
>>> $config['poller_modules']['storage']                      = 1;
>>> $config['poller_modules']['netstats']                     = 1;
>>> $config['poller_modules']['hr-mib']                       = 0;
>>> $config['poller_modules']['ucd-mib']                      = 0;
>>> $config['poller_modules']['ipSystemStats']                = 1;
>>> $config['poller_modules']['ports']                        = 1;
>>> $config['poller_modules']['bgp-peers']                    = 0;
>>> $config['poller_modules']['junose-atm-vp']                = 0;
>>> $config['poller_modules']['toner']                        = 0;
>>> $config['poller_modules']['ucd-diskio']                   = 0;
>>> $config['poller_modules']['wifi']                         = 0;
>>> $config['poller_modules']['ospf']                         = 0;
>>> $config['poller_modules']['cisco-ipsec-flow-monitor']     = 0;
>>> $config['poller_modules']['cisco-remote-access-monitor']  = 0;
>>> $config['poller_modules']['cisco-cef']                    = 0;
>>> $config['poller_modules']['cisco-sla']                    = 0;
>>> $config['poller_modules']['mac-accounting']               = 0;
>>> $config['poller_modules']['arista-software-ip-forwarding']= 0;
>>> $config['poller_modules']['cipsec-tunnels']               = 0;
>>> $config['poller_modules']['loadbalancer']                 = 0;
>>> $config['poller_modules']['cisco-cbqos']                  = 0;
>>> $config['poller_modules']['cisco-eigrp']                  = 0;
>>> $config['poller_modules']['netscaler-vsvr']               = 0;
>>> $config['poller_modules']['aruba-controller']             = 0;
>>> $config['poller_modules']['entity-physical']              = 0;
>>> $config['poller_modules']['applications']                 = 0;
>>> $config['poller_modules']['fdb-table']                    = 1;
>>> $config['poller_modules']['graphs']                       = 1;
>>> $config['poller_modules']['cisco-vpdn']                   = 0;
>>> $config['poller_modules']['wmi']                          = 0;
>>>
>>>
>>>
>>> Hardware : SSD INTEL
>>> MEM : 14GB
>>> CPU : Intel(R) Xeon(R) CPU E3-1270 v3 @ 3.50GHz
>>>
>>>
>>> _______________________________________________
>>> observium mailing list
>>> observium@observium.org
>>> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
>>>
>> _______________________________________________
>> observium mailing list
>> observium@observium.org
>> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
>
> _______________________________________________
> observium mailing list
> observium@observium.org
> http://postman.memetic.org/cgi-bin/mailman/listinfo/observium
_______________________________________________
observium mailing list
observium@observium.org
http://postman.memetic.org/cgi-bin/mailman/listinfo/observium