Welcome to Pandora FMS Community!

Find answers, ask questions, and connect with our community around the world.

Welcome to Pandora FMS Community Forums Community support yum update to FMS v7.0NG.734 – Build 191231 – MR 25 broke the system

  • yum update to FMS v7.0NG.734 – Build 191231 – MR 25 broke the system

    Posted by jwthomson on May 24, 2019 at 07:36

    I ran yum update on the server today which update PandoraFMS to 
    pandorafms_console-7.0NG.734-1.noarch
    pandorafms_server-7.0NG.734-1.noarch

    After a restart the stylesheets appear to be broken in the console 

    And none of the agents are updating either via remote checks, plugins or remote install agents. Effectively the system is broken

    I’ve checked the MR directory and have ensured that all *.sql are applied

    I also search for release notes and found that .734 is not mentioned at all. So perhaps this slipped into the repository as an error?

    Any assistance or news of a nightly fix would be appreciated

    Cheers
    Jodi

    Partial logs below
    [root@pandora ~]# tail /var/log/pandora/pandora_server.log
    2019-05-24 15:37:57 pandora [V1] [E] ‘pandora’: DBD::mysql::db do failed: Unknown column ‘ff_normal’ in ‘field list’ at /usr/lib/perl5/PandoraFMS/DB.pm line 1146.

    2019-05-24 15:37:57 pandora [V1] Pandora FMS Server ‘pandora’ unhandled error.
    2019-05-24 15:37:57 pandora [V1] [E] ‘pandora’: 21 at /usr/lib/perl5/PandoraFMS/DB.pm line 1154.

    2019-05-24 15:37:57 pandora [V1] Pandora FMS Server ‘pandora’ unhandled error.
    2019-05-24 15:38:01 pandora [V1] [E] ‘pandora’: 21 at /usr/lib/perl5/PandoraFMS/DB.pm line 1154.

    2019-05-24 15:38:01 pandora [V1] Pandora FMS Server ‘pandora’ unhandled error.
    2019-05-24 15:38:01 pandora [V1] Pandora FMS Server restarting () in 60 seconds.

    [root@pandora ~]# tail /var/log/pandora/pandora_server.error
    DBD::mysql::db do failed: Unknown column ‘ff_normal’ in ‘field list’ at /usr/lib/perl5/PandoraFMS/DB.pm line 1146.
    Use of uninitialized value in numeric eq (==) at /usr/lib/perl5/PandoraFMS/Core.pm line 1626.
    Use of uninitialized value in numeric eq (==) at /usr/lib/perl5/PandoraFMS/Core.pm line 1648.
    DBD::mysql::db do failed: Unknown column ‘ff_normal’ in ‘field list’ at /usr/lib/perl5/PandoraFMS/DB.pm line 1146.
    Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
    Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
    Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
    Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
    Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
    Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.

    jwthomson replied 5 years, 11 months ago 2 Members · 3 Replies
  • 3 Replies
  • eduardo-corral

    Member
    May 24, 2019 at 15:15
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    I ran yum update on the server today which update PandoraFMS to 
    pandorafms_console-7.0NG.734-1.noarch
    pandorafms_server-7.0NG.734-1.noarch

    After a restart the stylesheets appear to be broken in the console 

    And none of the agents are updating either via remote checks, plugins or remote install agents. Effectively the system is broken

    I’ve checked the MR directory and have ensured that all *.sql are applied

    I also search for release notes and found that .734 is not mentioned at all. So perhaps this slipped into the repository as an error?

    Any assistance or news of a nightly fix would be appreciated

    Cheers
    Jodi

    Partial logs below
    [root@pandora ~]# tail /var/log/pandora/pandora_server.log
    2019-05-24 15:37:57 pandora [V1] [E] ‘pandora’: DBD::mysql::db do failed: Unknown column ‘ff_normal’ in ‘field list’ at /usr/lib/perl5/PandoraFMS/DB.pm line 1146.

    2019-05-24 15:37:57 pandora [V1] Pandora FMS Server ‘pandora’ unhandled error.
    2019-05-24 15:37:57 pandora [V1] [E] ‘pandora’: 21 at /usr/lib/perl5/PandoraFMS/DB.pm line 1154.

    2019-05-24 15:37:57 pandora [V1] Pandora FMS Server ‘pandora’ unhandled error.
    2019-05-24 15:38:01 pandora [V1] [E] ‘pandora’: 21 at /usr/lib/perl5/PandoraFMS/DB.pm line 1154.

    2019-05-24 15:38:01 pandora [V1] Pandora FMS Server ‘pandora’ unhandled error.
    2019-05-24 15:38:01 pandora [V1] Pandora FMS Server restarting () in 60 seconds.

    [root@pandora ~]# tail /var/log/pandora/pandora_server.error
    DBD::mysql::db do failed: Unknown column ‘ff_normal’ in ‘field list’ at /usr/lib/perl5/PandoraFMS/DB.pm line 1146.
    Use of uninitialized value in numeric eq (==) at /usr/lib/perl5/PandoraFMS/Core.pm line 1626.
    Use of uninitialized value in numeric eq (==) at /usr/lib/perl5/PandoraFMS/Core.pm line 1648.
    DBD::mysql::db do failed: Unknown column ‘ff_normal’ in ‘field list’ at /usr/lib/perl5/PandoraFMS/DB.pm line 1146.
    Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
    Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
    Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
    Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
    Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.
    Use of uninitialized value in concatenation (.) or string at /usr/lib/perl5/PandoraFMS/Core.pm line 5059.

    Greetings, jwthomson

    Our interface changes in version 734, so you will have to delete cache to properly see the new environment. 

    However, please access console’s Update Manager to check that every package is up to date and send us a screenshot of the footer to check which version and MR you have applied. 

    Kind regards, 

    Eduardo.

  • jwthomson

    Member
    May 27, 2019 at 00:06
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hello

    Refreshing cache did resolve stylesheet issue. However that was a minor problem

    The real issue is that none of the checks are working. Attached are screenshots showing last contact being 3-days ago, which is when I did update. And also from online update manager showing latest package installed

    Also attached is latest log file showing errors and restarts – partial shown below

    [root@pandora ~]# tail /var/log/pandora/pandora_server.log
    2019-05-24 17:28:10 pandora [V1] [E] ‘pandora’: Can’t call method “disconnect” on an undefined value at /usr/lib/perl5/PandoraFMS/DB.pm line 202.

    2019-05-24 17:28:10 pandora [V1] Pandora FMS Server ‘pandora’ unhandled error.
    2019-05-24 17:28:15 pandora [V1] [E] ‘pandora’: DBI connect(‘pandora:127.0.0.1:3306′,’pandora’,…) failed: Too many connections at /usr/lib/perl5/PandoraFMS/DB.pm line 128 thread 4321.

    2019-05-24 17:28:15 pandora [V1] Pandora FMS Server ‘pandora’ unhandled error.
    2019-05-24 17:28:15 pandora [V1] Pandora FMS Server restarting () in 60 seconds.
    2019-05-24 17:29:21 pandora [V1] [E] ‘pandora’: DBI connect(‘pandora:127.0.0.1:3306′,’pandora’,…) failed: Too many connections at /usr/lib/perl5/PandoraFMS/DB.pm line 128.

    2019-05-24 17:29:21 pandora [V1] Pandora FMS Server ‘pandora’ unhandled error.

  • jwthomson

    Member
    May 27, 2019 at 05:02
    0 Karma points
    Community rank: tentacle-noob-1 Tentacle noob
    Like it
    Up
    0
    Down
    Drop it
    ::

    Hello

    Refreshing cache did resolve stylesheet issue. However that was a minor problem

    The real issue is that none of the checks are working. Attached are screenshots showing last contact being 3-days ago, which is when I did update. And also from online update manager showing latest package installed

    Also attached is latest log file showing errors and restarts – partial shown below

    [root@pandora ~]# tail /var/log/pandora/pandora_server.log
    2019-05-24 17:28:10 pandora [V1] [E] ‘pandora’: Can’t call method “disconnect” on an undefined value at /usr/lib/perl5/PandoraFMS/DB.pm line 202.

    2019-05-24 17:28:10 pandora [V1] Pandora FMS Server ‘pandora’ unhandled error.
    2019-05-24 17:28:15 pandora [V1] [E] ‘pandora’: DBI connect(‘pandora:127.0.0.1:3306′,’pandora’,…) failed: Too many connections at /usr/lib/perl5/PandoraFMS/DB.pm line 128 thread 4321.

    2019-05-24 17:28:15 pandora [V1] Pandora FMS Server ‘pandora’ unhandled error.
    2019-05-24 17:28:15 pandora [V1] Pandora FMS Server restarting () in 60 seconds.
    2019-05-24 17:29:21 pandora [V1] [E] ‘pandora’: DBI connect(‘pandora:127.0.0.1:3306′,’pandora’,…) failed: Too many connections at /usr/lib/perl5/PandoraFMS/DB.pm line 128.

    2019-05-24 17:29:21 pandora [V1] Pandora FMS Server ‘pandora’ unhandled error.

    I should also note that I have checked connection to MySQL DB as pandora user and it is successful


    So it turns out there were 2 more minor release *.sql files
    26.sql & 27.sql
    which hadn’t been applied automatically with the RPM during then initial ‘yum update’ but appeared after I ran a ‘yum reinstall pandorafms-server’

    I have applied those and now everything appears to be back to normal

    Note the MR value in the console still appeared as 25 – I had to manually update tconfig table to reflect change