Pandora FMS Community

Unable to process XML file

rcouchman · 16 sept 2012, 19:14 · 7 mensajes · 148 visitas

  1. Inicio del debate

    Hello,   We get the below event sporadically about once every 6-8 hours: Unable to process XML data file '/var/spool/pandora/data_in/Oldbury-Telecoms-Linux[…]ne 59, column 13, byte 2018 at /usr/lib/perl5/XML/Parser.pm line 187 thread 4  Unable to process XML data file '/var/spool/pandora/data_in/Oldbury-Telecoms-Linux.1347749783.data': junk after document element at line 59, column 13, byte 2018 at /usr/lib/perl5/XML/Parser.pm line 187 thread 4   What causes this?   Thanks.

  2. Anyone?

  3. Hello Do you get that message from the same agent (Oldbury-Telecoms-Linux) every 6-8 hour? or do you get a different error message from different agents? If is always the same agent it should be something wrong in the pandora_agent.conf or at the time it generate the xml file. Put your pandora_agent.conf file and the xml file that generate and I will try to look at it to see if I can see some kind of error. Regard

  4. Hello Do you get that message from the same agent (Oldbury-Telecoms-Linux) every 6-8 hour? or do you get a different error message from different agents? If is always the same agent it should be something wrong in the pandora_agent.conf or at the time it generate the xml file. Put your pandora_agent.conf file and the xml file that generate and I will try to look at it to see if I can see some kind of error. Regard

    Hi,   Thanks for the reply.  We get the error from the same agent yes, its actually an agent running on the Pandora server, we use this in conjuction with Self Monitoring.   The alert comes through sometimes 3 times in an hour, then nothing for 2-3 days, then 3 more errors again.   Below are the files you asked for.  Look forward to your reply.  Thanks.   Below is the pandora_agent.conf: # Base config file for Pandora FMS agents # Version 4.0.2, GNU/Linux # Licensed under GPL license v2, # Copyright (c) 2003-2009 Artica Soluciones Tecnologicas # http://www.pandorafms.com # General Parameters # ================== server_ip localhost server_path /var/spool/pandora/data_in temporal /tmp logfile /var/log/pandora/pandora_agent.log #include /etc/pandora/pandora_agent_alt.conf #broker_agent name_agent # Interval in seconds, 300 by default interval    300 # Debug mode only generate XML, and stop after first execution, # and does not copy XML to server. debug 0 # Optional. UDP Server to receive orders from outside # By default is disabled, set 1 to enable # Set port (41122 by default) # Set address to restrict who can order a agent restart (0.0.0.0 = anybody) # udp_server 0 udp_server_port 41122 udp_server_auth_address 0.0.0.0 # By default, agent takes machine name agent_name    Oldbury-Telecoms-Linux #Parent agent_name #parent_agent_name caprica # Agent description #description This is a demo agent for Linux # Group assigned for this agent (descriptive, p.e: Servers) #group Servers # address: Enforce to server a ip address to this agent # You can also try to detect the first IP using "auto", for example #address auto # or setting a fixed IP address, like for example: #address 192.168.36.73 # Autotime: Enforce to server to ignore timestamp coming from this # agent, used when agents has no timer or it's inestable. 1 to enable # this feature #autotime 1 # Timezone offset: Difference with the server timezone #timezone_offset 0 # Agent position paramters # Those parameters define the geographical position of the agent # gis_exec: Call a script that returns a string with a fixed # format of latitude,longitude,altitude # i.e.: 41.377,-5.105,2.365 #gis_exec /tmp/gis.sh # This sets the GIS coordinates as fixed values: # latitude #latitude 0 # longitude #longitude 0 # altitude #altitude 0 #GPS Position description #position_description Madrid, centro # By default agent try to take default encoding defined in host. #encoding UTF-8 # Listening TCP port for remote server. By default is 41121 (for tentacle) # if you want to use SSH use 22, and FTP uses 21. server_port 41121 # Transfer mode: tentacle, ftp, ssh or local transfer_mode tentacle # Server password (Tentacle or FTP). Leave empty for no password (default). #server_pwd mypassword # Set to yes/no to enable/disable OpenSSL support for Tentacle (disabled by default). #server_ssl no # Extra options for the Tentacle client (for example, server_opts "-v -r 5"). #server_opts # delayed_startup defines number of seconds before start execution # for first time when startup Pandora FMS Agent #delayed_startup 10 # Pandora nice defines priority of execution. Less priority means more intensive execution # A recommended value is 10. 0 priority means no Pandora CPU protection enabled (default) #pandora_nice 0 # Cron mode replace Pandora FMS own task schedule each XX interval seconds by the use # of old style cron. You should add to crontab Pandora FMS agent script to use this mode. # This is disabled by default, and is not recommended.  Use Pandora FMS internal scheduler # is much more safe #cron_mode # If set to 1 allows the agent to be configured via the web console (Only Enterprise version) #remote_config 1 # If set to 1 start Drone Agent's Proxy Mode # proxy_mode 1 # Max number of simmultaneus connection for proxy (by default 10) # proxy_max_connection 10 # Proxy timeout (by default 1s) # proxy_timeout 1 # Number of threads to execute modules in parallel #agent_threads 1 # User the agent will run as #pandora_user root # Enable or disable XML buffer. # If you are in a secured environment and want to enable the XML buffer you # should consider changing the temporal directory, since /tmp is world writable. #xml_buffer 0 # Minimum available bytes in the temporal directory to enable the XML buffer #temporal_min_size 1024 # Secondary server configuration # ============================== # If secondary_mode is set to on_error, data files are copied to the secondary # server only if the primary server fails. If set to always, data files are # always copied to the secondary server. #secondary_mode on_error #secondary_server_ip localhost #secondary_server_path /var/spool/pandora/data_in #secondary_server_port 41121 #secondary_transfer_mode tentacle #secondary_server_pwd mypassword #secondary_server_ssl no #secondary_server_opts # Module Definition # ================= # System information # vmstat syntax depends on linux distro and vmstat command version, please check before use it module_begin module_name cpu_user module_type generic_data module_interval 1 module_exec vmstat 1 2 | tail -1 | awk '{ print $13 }' module_max 100 module_min 0 module_description User CPU Usage (%) module_min_warning 70 module_max_warning 90 module_min_critical 91 module_max_critical 100 module_end #Get load average module_begin module_name Load Average module_type generic_data module_exec cat /proc/loadavg | cut -d' ' -f1 module_description Average process in CPU (Last minute) module_end #Get free memory in MB module_begin module_name Cache mem free module_type generic_data module_exec free -m | grep buffers/cache | awk '{print $4}' module_description Free cache memory in MB module_min_warning 249 module_max_warning 250 module_min_critical 149 module_max_critical 150 module_end #Count total number of processes module_begin module_name proctotal module_type generic_data module_exec ps -A | tail --lines=+5 | wc -l module_description Total processes module_min_warning 325 module_max_warning 350 module_min_critical 425 module_max_critical 450 module_end # Process information module_begin module_name sshDaemon module_type generic_proc module_exec ps -Af | grep sshd | grep -v "grep" | wc -l module_description Check ssh service module_end # Async data example module_begin module_name LastLogin module_type async_string module_exec last | head -1 module_description Monitor last user loggin module_end # Module that get the number or cron file # This module uses a precondition, if cron is running the # module will check the folder /etc/cron.d to get the number of files module_begin module_name Cron task files module_type async_string module_precondition =~ .*cron.* ps aux | grep cron module_exec ls -l /etc/cron.d | awk 'NR>1 {print $0}' | wc -l module_description Number of cron task files module_end # Plugin example # This plugin detects all disk partitions and monitor the free spaces module_plugin pandora_df # This parses /var/log/syslog file, under the module name "syslog" # And search for "ssh" string into it, sending only that information. module_plugin grep_log /var/log/syslog Syslog ssh # Get disk space free in MB #module_begin #module_name disk_root_free #module_type generic_data #module_exec df -kh / | tail -1 | awk '{ print 100-$5 }' #module_max 100 #module_min 0 #module_description Free disk Percentage of root partition #module_min_warning 70 #module_max_warning 90 #module_min_critical 91 #module_max_critical 100 #module_end # This module uses postprocess feature to unit conversion #module_begin #module_name memused #module_type generic_data #module_exec free -k | grep buffers/cache | awk '{print $3}' #module_postprocess 0,000976 #module_description Used memory in KB postprocessed to be in MB #module_end # Plugin for inventory on the agent (Only Enterprise) # module_plugin inventory 1 cpu ram video nic hd cdrom software init_services filesystem users process ip route # Example of preconditions #module_begin #module_name Test Precondicion #module_type generic_data #module_precondition 10 echo 15 #module_precondition = 10 echo 10 #module_precondition != 10 echo 5 #module_precondition =~ 10 echo 10 #module_precondition (5,15) echo 10 #module_freepercentmemory #module_description Precondition test module #module_end # Example of postconditions #module_begin #module_name Test Postcondicion #module_type generic_data #module_condition > /tmp/log.txt #module_condition > 3 echo max >> /tmp/log.txt #module_condition = 5 echo equal >> /tmp/log.txt #module_condition != 10 echo diff >> /tmp/log.txt #module_condition =~ 5 echo regexp >> /tmp/log.txt #module_condition (3,8) echo range >> /tmp/log.txt #module_exec echo 5 #module_description Postcondition test module #module_end   Below is the bad XML file generated generic_data 0 100 91 100 70 90 generic_data generic_data 149 150 249 250 generic_data 425 450 325 350 generic_proc async_string async_string Status generic_proc 1 Database Maintenance generic_proc 1 Queued_Modules generic_data 0 Agents_Unknown generic_data 0 System_Load_AVG generic_data 0.06 Free_RAM generic_data 2860960 FreeDisk_SpoolDir generic_data 31210.2

  5. Check if XML is malformed with xmllint to see where the problem is

  6. I have the same problem with the same timing. I found there are two pairs of ... generated in a single file. I could only get the server to take the file if I removed the repeated pair. (If I brought all the modules into the one pair, it worked fine, too.) By the way, the content of your second pair is the same as I have coincidentally. The first set of module data is created from the pandora_agent.conf and the other set through configuring the server modules. I guess when the timing of each set coincides this problem occurs. I am not sure how to resolve this other than removing the modules from the agent. UPDATE: On a Spanish language thread, it seems this is an identified bug and there is a fix in an upcoming release (assuming I read it right.) ...

  7. Hello everyone Yes, this problem is solved in the last agent versión, but if problems remain,  the solution is to uncomment the agent's name and replace it. This XML is generated when self-monitoring and agent interval running at the same instant. Regards

Entra en tu cuenta para publicar.