Welcome to Pandora FMS Community!

Find answers, ask questions, and connect with our community around the world.

Welcome to Pandora FMS Community Forums Community support Advanced troubleshooting Pandora agent daemon is not running //stops randomly

  • Pandora agent daemon is not running //stops randomly

    Posted by gadge on May 4, 2016 at 16:50

    Hi,
    I’ve installed Pandora FMS Server v5.1SP2.

    I’ve installed some agents on Ubuntu clients.

    My problem is, that on some client the agent daemon stops randomly.
    The log files dont say any information about the cause of stopping.

    If I restart the service it’s up and running again many hours until I have another crash.

    Sorry for my bad english

    antonio replied 7 years, 11 months ago 3 Members · 18 Replies
  • 18 Replies
  • AKevin

    Member
    May 4, 2016 at 20:06
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hello gadge,

    Could you please check /var/log/messages? Maybe you can find an error matching pandora_agent_daemon process’ stop.

    Kind regards,
    Kevin.

  • gadge

    Member
    May 5, 2016 at 10:26
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hello Kevin!

    There is no messages file in /var/log
    I’ve checked all of the log files in this directory, and there isnt any log message about pandora.

    I have also checked the agentname.data in /tmp directory, when i set the agent in debug mode, and i found everything is ok with the datas.

    Kind regards,
    Gadge (Thomas)

  • AKevin

    Member
    May 5, 2016 at 13:00
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hello gadge,

    Does the Ubuntu client have more than one agent installed? If that’s the case, there could be a conflict between both instances if their Pandora_path configuration were the same.

    Kind regards,
    Kevin.

  • gadge

    Member
    May 5, 2016 at 13:05
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hello!

    No, there is one agent installed on every clients.

    Kind regards,
    Gadge (Thomas)

  • AKevin

    Member
    May 5, 2016 at 14:39
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hi again,

    Is there some kind of regularity in the issue (e.g, spikes in CPU usage shortly before the agent daemon stops) or does it trigger randomly?
    Anyway, is this issue found in a single client, or in more than one? It might be a bad installation, which could be fixed by simply reinstalling the agent.

    Kind regards,
    Kevin.

  • gadge

    Member
    May 5, 2016 at 17:41
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hi!

    There is no any kind of regularity, CPU usage is ok, there is lot of available memory.
    It stopped running randomly. Sometimes the running time is over many days with no problem, then stopped or running just few hours and stopped.

    I’ve 10 agents with the same installing package, and all of the agents have got this problem.
    I’m using some bash script also on the agent, like special agent name (bash script generates the name), special modules (bash script gives the datas to this special modules).

    So its working well  through many days, then daemon stopped.

    I’ve installed agent with this intalling package to my pc (Lubuntu) and its work perfectly, never stopped for some weeks.

  • gadge

    Member
    May 9, 2016 at 12:25
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hi again!

    I’ve deleted my extra features from pandora agent, and installed again a “clear” pandora agent v6.0, but the agents still getting stopped after a few hour or day.

    If I create a cronjob which checking pandora agent daemon and if it stopps the cron starts it again, but that would be greater if i could found out what is the problem.

  • AKevin

    Member
    May 9, 2016 at 15:24
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hi gadge,

    That’s strange. It could be some configuration present in your Ubuntu system. Anyway, which version of Ubuntu are you running?
    As for the cron job, it’s a good fix until we find the reason of that issue.

    Kind regards,
    Kevin.

  • gadge

    Member
    May 9, 2016 at 16:42
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hi Kevin!

    I’m running Ubuntu 12.04.2 LTS
    Maybe one module is the reason, so i turn off the modules one by one, and listening when stoppes the agent daemon. But probably its not the reason, because it would cause always daemon’s stopping when the modules are refreshing.

    That’s strange that there isnt any log messages anywhere, that Ubuntu killed the daemon (syslog, kern.log)

    Kind regards,
    Gadge.

  • gadge

    Member
    May 9, 2016 at 20:02
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    When I reinstalled the agent, I realised some dependency errors, like snmp and perl packages (I’m using some perl scripts on the agents).
    The agents have no acces to the Internet, so I collected the dependencys and put them into the installing directory, where the agent installer deb is located also.
    Can they cause the stopping?

    Kind regards,
    Gadge.

  • gadge

    Member
    May 17, 2016 at 14:02
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hi,

    I extended the agent daemon log, and waited for stopping.
    TERM Handler kills the daemon, but I dont know the reason.

    2016/05/13 17:23:52 – [info] – Check for invalid modules
    2016/05/13 17:23:52 – [info] – Replace module macros

    2016/05/13 17:23:52 – [info] – Module def: # This plugin will get the network usage (bytes/sec)

    2016/05/13 17:23:52 – [info] – Module def: #module_plugin pandora_netusage

    2016/05/13 17:23:52 – [info] – Module def:

    2016/05/13 17:23:52 – [info] – Agent name cmd is defined
    2016/05/13 17:23:52 – [info] – Update the agent MD5 since agent name may have changed
    2016/05/13 17:23:52 – [info] – MD5 checksum
    2016/05/13 17:23:52 – [info] – Set the maximum number of threads
    2016/05/13 17:23:52 – [info] – Tentacle client options OK
    2016/05/13 17:23:52 – [log] – Thread is disabled.
    2016/05/13 17:23:52 – [info] – Startup delay
    2016/05/13 17:23:52 – [info] – Set nice of the pandora agent:
    2016/05/13 17:23:52 – [info] – PID: 6473
    2016/05/13 17:23:52 – [info] – Start UDP server
    2016/05/13 17:23:52 – [info] – Check server for remote configuration
    2016/05/13 17:23:52 – [info] – Delete old collections and download new collections
    2016/05/13 17:23:52 – [info] – Check if address is auto to get the local ip
    2016/05/13 17:23:52 – [info] – Execute the given module
    2016/05/13 17:23:52 – [info] – Check the module’s cron string
    2016/05/13 17:23:52 – [info] – Evaluate and execute module preconditions
    2016/05/13 17:23:52 – [info] – Execute the given command
    2016/05/13 17:23:52 – [info] – Check module parameters
    2016/05/13 17:23:52 – [info] – Execute the command
    2016/05/13 17:23:52 – [info] – TERM Handler – Kill tentacle

  • gadge

    Member
    June 13, 2016 at 14:42
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hi

    The randomly stops are still exist.
    The log file sais before daemon stopped: Interrupted system call, exit code 65280

    Do you have any idea what is that mean?
    The permissions are good, and all files are exist.

    Kind regards,
    Gadge.

  • AKevin

    Member
    June 13, 2016 at 16:16
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hello gadge,

    Did you get all the dependencies needed? Are they updated?

    Kind regards,
    Kevin.

  • gadge

    Member
    June 13, 2016 at 16:46
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hello!

    The agent has no access to the internet, so the dependencies were collected manually by one of my friend.
    He didnt say any problem or missing dependencies during installing, but i’m not sure that all of them is collected or updated.
    Does it cause the problem? Than why can run daemon and stopping after many minutes or days?

  • gadge

    Member
    June 20, 2016 at 14:59
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hi!

    My pandora agent is using a perl script, which sends the restart command every 30 minutes (its necesserey because of my alt config)
    The daemon stops during one of this restart period. The startup script (/etc/init.d/pandora_agent_daemon) makes stop than start command. The stop command is completed, then the script steps in the start command, where it returns whith the PID, which is not setted, so it has to start the pandora_agent. After the pandora_agent started, comes a sleep 2. In this place my script exist and pandora agent stops running

    Best regards,
    Gadge

  • antonio

    Member
    August 10, 2016 at 17:28
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hello Gadge,

    If the agents needs to make some specific tasks at some point, he may find issues if all the dependencies are not properly installed/resolved.

    Kind regards,
    Antonio.

  • gadge

    Member
    September 12, 2016 at 16:10
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hello Antonio,

    Thanks for your advice. I checked the dependencies, and all of them are ok.
    The problem is solved if I make the pandora agent daemon auto-restart off.
    Since I turned it off, the agents keep running without crashes..

    Best regards,
    Gadge

  • antonio

    Member
    November 21, 2016 at 18:57
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hello gadge,

    The agent may need to make use of some of its dependencies after some time, for executing certain tasks, and that may cause the agent to stop working if the dependencies are not properly resolved.

    Kind regards,
    Antonio.