Apache Spark plugin
Plugin to grab metrics from all executors of all running or finished apps on your Spark server.
Introduction
Ver. 03-09-2021Plugin to grab metrics from all executors of all running or finished apps on your ...
Compatibility matrix
Systems where it has been tested CentOS 7, Fedora Systems where it should work Any linux...
Prerequisites
Required: A Spark server Spark history server enabled Pandora FMS Data Server enabled Have th...
Configuration
The plugin makes use of some Spark rest api endpoints, in order to access them from the plugin we...
Plugin general parameters
./pandora_spark -i <ip-with-port> -[ -g <group> ] [ --data_dir <data dir> ] If the execution...
Plugin specific parameters
The plugin has the following parameters: Parameter Description -i <ip-with-port> --ip <ip-with...
Configuration in Pandora
Installation from the console To register the plugin, from the console, go to the "register plug...
Modules generated
An agent will be created for each application of our server with data of all its executors, the n...