Hi, So, AWS had a network failure over the weekend, and I got an email saying my VMs were affected. They were all frozen and one was off completely (the Pandora server was the VM that was off ! :-( ) I rebooted them all, but Pandora seems to be playing up. I have two issues, which might be related ?
- On boot, Pandora Server wont start. but if I start it a few minutes later, it seems to start ok?
- All my plugin server modules have stopped. Pandora is still receiving data from all the agents and logging / graphing it ok. But all the server side plugins say "Unknown" "20 hours"
Any ideas ?
[root@pandora centos]# cat /var/log/pandora/pandora_server.log
2019-01-13 17:34:21 pandora [V1] Launching 7.0NG.730 181217
2019-01-13 17:34:21 pandora [V1] Config options: Logfile at /var/log/pandora/pandora_server.log, Basepath is /etc/pandora/pandora_server.conf, Checksum is 0, Master is 1, SNMP Console is 0, Server Threshold at 5 sec, verbosity at 3, Alert Threshold at 60, ServerName is 'pandora'
2019-01-13 17:34:21 pandora [V1] Pandora FMS Enterprise module not available.
2019-01-13 17:34:21 pandora [V1] [E] 'pandora': DBI connect('pandora:127.0.0.1:3306','pandora',...) failed: Can't connect to MySQL server on '127.0.0.1' (111) at /usr/lib/perl5/PandoraFMS/DB.pm line 125.
2019-01-13 17:34:21 pandora [V1] Server 'pandora' unhandled error.
[root@pandora centos]# cat /var/log/pandora/pandora_server.error
2019-01-13 17:34:21 - pandora Starting Pandora FMS Server. Error logging activated.
Use of uninitialized value $Config{"rb_product_name"} in concatenation (.) or string at /usr/bin/pandora_server line 215.
DBI connect('pandora:127.0.0.1:3306','pandora',...) failed: Can't connect to MySQL server on '127.0.0.1' (111) at /usr/lib/perl5/PandoraFMS/DB.pm line 125.
[root@pandora centos]# systemctl status pandora_server
● pandora_server.service - LSB: Pandora FMS Server startup script
Loaded: loaded (/etc/rc.d/init.d/pandora_server; bad; vendor preset: disabled)
Active: failed (Result: exit-code) since Sun 2019-01-13 17:34:22 UTC; 2h 20min ago
Docs: man:systemd-sysv-generator(8)
Process: 3012 ExecStart=/etc/rc.d/init.d/pandora_server start (code=exited, status=7)
Jan 13 17:34:21 pandora.red-herring.co.uk pandora_server[3012]: Pandora FMS Server 7.0NG.730 Build 181217 Copyright (c) 2004-2018 Artica ST
Jan 13 17:34:21 pandora.red-herring.co.uk pandora_server[3012]: This program is OpenSource, licensed under the terms of GPL License version 2.
Jan 13 17:34:21 pandora.red-herring.co.uk pandora_server[3012]: You can download latest versions and documentation at official web page.
Jan 13 17:34:21 pandora.red-herring.co.uk pandora_server[3012]: Backgrounding Pandora FMS Server process.
Jan 13 17:34:22 pandora.red-herring.co.uk pandora_server[3012]: Cannot start Pandora FMS Server. Aborted.
Jan 13 17:34:22 pandora.red-herring.co.uk pandora_server[3012]: Check Pandora FMS log files at '/var/log/pandora/pandora_server.error & pandora_s...r.log'
Jan 13 17:34:22 pandora.red-herring.co.uk systemd[1]: pandora_server.service: control process exited, code=exited status=7
Jan 13 17:34:22 pandora.red-herring.co.uk systemd[1]: Failed to start LSB: Pandora FMS Server startup script.
Jan 13 17:34:22 pandora.red-herring.co.uk systemd[1]: Unit pandora_server.service entered failed state.
Jan 13 17:34:22 pandora.red-herring.co.uk systemd[1]: pandora_server.service failed.
mySQL *is* running. as the other agent data is being stored ? and when I run the plugins directly from the command line, they work fine. When the servers came up after the AWS network failure, I had some hostname issues. So, the hostnames have changed. I think I've corrected them all. Could that be related ? What part of Pandora runs the plugin scripts every 5 minutes ? Is it the Pandora Server ? How can I tell if it's attempting to run the scripts ? If Pandora server isn't running, would I still get the website and the agent data ? Thanks ! Jon.








