You can find the answers to these questions on the FAQ page.
  • It doesn't work. Where can I find diagnostic output?
    Version 3.* writes warnings and error messages using the syslog(3) facility. Depending on your system the syslog-daemon writes these messages to files and/or sends them to another host. On most GNU/Linux distributions the place to look at is either /var/log/syslog or /var/log/messages.
    Version 4.0 and later comes with the logfile and syslog plugins which can be used to write status messages to a file or send it to the syslog daemon.
  • Some lines of the config seem to be ignored..?
    Yes, that's a known bug. You probably have one or more white spaces at the end of the lines being ignored.
    This is a bug in the library used by collectd 3.* to parse the configfile. Versions 4.0 and later use a different library and don't have this problem.
  • Can I adjust the interval in which data is collected?
    Yes, since version 3.9.0 this can be set at compiletime. Keep in mind, though, that this will change the layout of the generated RRD-files. Also, clients and servers should have the same setting here to avoid interesting results.
    Version 4.0 allows this setting to be adjusted in the configfile.
  • I try to use the ping-plugin, but keep getting the message "`ping_host_add' failed.". What's the matter?
    In order to generate ICMP packets one needs to open a so called "RAW socket". On most UNIX systems only the superuser (root) may open such sockets.
    In addition, some virtualization environments, such as VServer and Solaris Zones have been reported to cause some trouble.
  • Who receives the multicast traffic?
    I don't know. That entirely depends on your network setup. By default collectd uses "site local" addresses, that should not be routed to outside your AS. If that's really the case is up to you.
  • What does "Invalid value for config option `Mode': `Local'" mean?
    Is means that the mode "Local" is not available. Most likely the "librrd" library wasn't found. If you want to write to RRD-files install "librrd" or, if you already did that, use the --with-rrdtool option of the ./configure-script to point to the right direction.
  • How to I use --with-rrdtool?
    If you installed libraries in a non-standard (or non-system) path you need to specify them when running the configure script. Otherwise it will not find them and build the binaries without linking against the library.
    You need to set the PATH as given to the --prefix option when compiling the library. The script actually looks for the two subdirectories PATH/include and PATH/lib, so check for their existence if things don't work. If, for example, you installed RRDTool in /opt/rrdtool-x.y.z you need to run configure like this:
    $ ./configure --with-rrdtool=/opt/rrdtool-x.y.z
  • The apache-plugin reports the following error: apache: curl_easy_perform failed: Failed writing body. What's wrong?
    The response received was too big and didn't fit into the buffer. Check the URL-option in the configfile. Especially check that the URL ends in "?auto": collectd requires the machine readable output generated by the Apache-plugin mod_status and will not work with anything else.
  • What do the version numbers mean?
    The version numbers consist of three numbers: The major- and minor-number and the patchlevel.
    • Versions with different major-numbers are basically not compatible. This means that the definitions of RRD-files or config-options have been changed or, in general, that the user has to do something in addition to install the new version. This is not nice and avoided when possible, but sometimes necessary to prevent old mistakes to become ancient mistakes. We try to provide migration scripts, though, to make a switch as easy as possible. See the v3 to v4 migration guide for details.
    • Versions with differing minor-numbers are backwards compatible, i. e. you can replace the lower version with the higher one and everything should still work. This means that features are added, but not removed or changed and that the default behavior does not change.
    • Versions with different patchlevels are both, forward- and backwards-compatible, because no new features have been introduced. The only difference between the two versions is one or more bugfixes, so you should generally install the higher version of the two.
  • I enabled the foo plugin using --enable-foo but now the build process fails. What's wrong?
    Since version 4.0.0 a server process doesn't need to load the plugins from which data should be received - in contrast to versions 3.*. This means, that plugins with unmet dependencies no longer have any purpose. So, we moved dependency checking into the configure script, starting with version 4.1.0. I. e. the configure script now automatically disables all plugins with unmet dependencies and enables all plugins whose dependencies are met.
    So, if a plugin is displayed as disabled, it's dependencies are not met. The normal way to get a plugin compiled is to install the missing dependencies and re-run the configure script.
    You can force it to be build using --enable-foo, but you need to know exactly what you are doing. If you do this you're out in the dark, cold woods and totally on your own!
  • The build process fails with "relocation R_X86_64_32 against `a local symbol' can not be used when making a shared object; recompile with -fPIC". What's wrong?
    Many plugins have to be linked against libraries. A few of them (currently iptables, netlink and nut are known to be affected) link against libraries that are only available as "static libraries" in many distributions. Most distributions (e. g. Debian and SuSE GNU/Linux) do not compile static libraries with the "-fPIC" option. Thus they cannot be linked with shared objects compiled with "-fPIC". Some architectures (among them i386) do not seem to care about that and handle it in some (probably magic) way. However, other architectures (mostly 64bit like amd64 or hppa) cannot handle that and thus the compiler aborts with the error message mentioned above.
    To fix this issue, you need a version of the static library compiled with "-fPIC" (or a shared library). Ask your distributor to provide a suitable version of the library or compile it yourself.
    For more detailed information please refer to:
  • Solaris support is broken! The build aborts! Help!
    There are two known issues with Solaris, but both can be fixed relatively easy:
    If you build a 32bit binary, the configure script will (try to) enable LFS. This will result in an error which looks somehow like this:
    config.h:832:1: error: "_FILE_OFFSET_BITS" redefined
    Also, the swap-plugin has some problems of it's own with this:
    swap.c:197: warning: implicit declaration of function 'swapctl'
    swap.c:197: error: 'SC_AINFO' undeclared (first use in this function)
    The solution is to build a 64bit binary! If you build a 64bit binary LFS is not needed and the swap plugin works as intended. To do this, pass the -m64 flag to the compiler (assuming you're using the Sun C compiler.
    Another problem is that by default Sun defines a version of getgrnam_r that isn't POSIX-compatible. To enable POSIX-compatibility pass the _POSIX_PTHREAD_SEMANTICS define to the compiler.
    Putting all together you need to pass the following flags to the configure-script:
    # Sun CC
    $ ./configure CFLAGS="-m64 -mt -D_POSIX_PTHREAD_SEMANTICS"
    Please note that we only test the Sun C compiler ourselves, but GCC may work, too. When using the GCC you need to substitute the -mt flag with the -pthreads flag. So if you use GCC the above invokation of ./configure becomes:
    # GCC
    $ ./configure CFLAGS="-m64 -pthreads -D_POSIX_PTHREAD_SEMANTICS"
    Thanks to Christophe Kalt for sharing his insights :)
  • Why is the CPU usage split up in so many files? Can I change that?
    The short answer is: That is because otherwise backwards compatibility would be impossible and you would have to re-create your files from scratch regularly. And, "no".
    The long answer and explanation of the short answer is: collectd runs on a variety of operating systems. Each operating system has it's own method for accounting CPU states, memory consumption, swap usage, and so on. If all these data sources where in one data set, every new supported operating system or any addition to an already supported operating system would mean that we need to modify the data set. This cannot be done without breaking backwards compatibility.
    To give you a few examples: Sometime in mid-2.6 the Linux kernel added some Xen-patches which provided a new CPU state: "steal time". When adding support for BSD systems we had to add "wired" memory. NFSv4 added some new procedures that NFSv3 didn't have, etc pp.
    That interface traffic has two data sources is different, because every operating system will account received and transmitted bytes. Likewise for the system load: The 1, 5, and 15 minute averages have been like that for ages and it's very unlikely that any weird UNIX does this different.
    Changing the layout of the data is not just a matter of changing the types.db file. That file describes the layout of the data submitted by plugins. The plugins don't need it - they know what data they submit. It's needed by the daemon and writing plugin to know how to store the data. If you mess with the file without knowing what you do, you will most likely end up with the data not being collected at all anymore.
  • Why doesn't collection.cgi draw foo graphs correctly?
    That script is meant as a starting point for own developments, not as a ready to use web frontend for RRD files written by collectd.
    It is just an example, because it's not really usable as it is. And it's not really useable, because we are UNIX developers and don't enjoy doing web stuff much. Working on the daemon is just so much more fun.. ;) So in the best of free / open source traditions: Patches welcome!
    There are alternatives, though. We've heard from various people using Cacti to render the graphs. Sergiusz Pawlowicz of the BBC has written CollectGraph, a macro for the MoinMoin wiki. And of course there's drraw.

Manpage collectd-perl(5)


NAME

collectd-perl - Documentation of collectd's perl plugin


SYNOPSIS

  LoadPlugin perl
  # ...
  <Plugin perl>
    IncludeDir "/path/to/perl/plugins"
    BaseName "Collectd::Plugin"
    EnableDebugger ""
    LoadPlugin "FooBar"
  </Plugin>


DESCRIPTION

The perl plugin embeds a Perl-interpreter into collectd and provides an interface to collectd's plugin system. This makes it possible to write plugins for collectd in Perl. This is a lot more efficient than executing a Perl-script every time you want to read a value with the exec plugin (see collectd-exec(5)) and provides a lot more functionality, too.


CONFIGURATION

LoadPlugin Plugin

Loads the Perl plugin Plugin. This does basically the same as use would do in a Perl program. As a side effect, the first occurrence of this option causes the Perl-interpreter to be initialized.

BaseName Name

Prepends Name:: to all plugin names loaded after this option. This is provided for convenience to keep plugin names short.

EnableDebugger Package[=option,...]

Run collectd under the control of the Perl source debugger. If Package is not the empty string, control is passed to the debugging, profiling, or tracing module installed as Devel::Package. A comma-separated list of options may be specified after the ``='' character. Please note that you may not leave out the Package option even if you specify ``''. This is the same as using the -d:Package command line option.

See perldebug for detailed documentation about debugging Perl.

This option does not prevent collectd from daemonizing, so you should start collectd with the -f command line option. Else you will not be able to use the command line driven interface of the debugger.

IncludeDir Dir

Adds Dir to the @INC array. This is the same as using the -IDir command line option or use lib Dir in the source code. Please note that it only has effect on plugins loaded after this option.


WRITING YOUR OWN PLUGINS

Writing your own plugins is quite simple. collectd manages plugins by means of dispatch functions which call the appropriate callback functions registered by the plugins. Any plugin basically consists of the implementation of these callback functions and initializing code which registers the functions with collectd. See the section ``EXAMPLES'' below for a really basic example. The following types of callback functions are known to collectd (all of them are optional):

init functions

This type of functions is called once after loading the module and before any calls to the read and write functions. It should be used to initialize the internal state of the plugin (e. g. open sockets, ...). If the return value evaluates to false, the plugin will be disabled.

read functions

This type of function is used to collect the actual data. It is called once per interval (see the Interval configuration option of collectd). Usually it will call plugin_dispatch_values to dispatch the values to collectd which will pass them on to all registered write functions. If the return value evaluates to false the plugin will be skipped for an increasing amount of time until it returns true again.

write functions

This type of function is used to write the dispatched values. It is called once for each call to plugin_dispatch_values.

flush functions

This type of function is used to flush internal caches of plugins. It is usually triggered by the user only. Any plugin which caches data before writing it to disk should provide this kind of callback function.

log functions

This type of function is used to pass messages of plugins or the daemon itself to the user.

notification function

This type of function is used to act upon notifications. In general, a notification is a status message that may be associated with a data instance. Usually, a notification is generated by the daemon if a configured threshold has been exceeded (see the section ``THRESHOLD CONFIGURATION'' in collectd.conf(5) for more details), but any plugin may dispatch notifications as well.

shutdown functions

This type of function is called once before the daemon shuts down. It should be used to clean up the plugin (e.g. close sockets, ...).

Any function (except log functions) may set the $@ variable to describe errors in more detail. The message will be passed on to the user using collectd's logging mechanism.

See the documentation of the plugin_register method in the section ``METHODS'' below for the number and types of arguments passed to each callback function. This section also explains how to register callback functions with collectd.

To enable a plugin, copy it to a place where Perl can find it (i. e. a directory listed in the @INC array) just as any other Perl plugin and add an appropriate LoadPlugin option to the configuration file. After restarting collectd you're done.


DATA TYPES

The following complex types are used to pass values between the Perl plugin and collectd:

Data-Set

A data-set is a list of one or more data-sources. Each data-source defines a name, type, min- and max-value and the data-set wraps them up into one structure. The general layout looks like this:

  [{
    name => 'data_source_name',
    type => DS_TYPE_COUNTER || DS_TYPE_GAUGE,
    min  => value || undef,
    max  => value || undef
  }, ...]
Value-List

A value-list is one structure which features an array of values and fields to identify the values, i. e. time and host, plugin name and plugin-instance as well as a type and type-instance. Since the ``type'' is not included in the value-list but is passed as an extra argument, the general layout looks like this:

  {
    values => [123, 0.5],
    time   => time (),
    host   => $hostname_g,
    plugin => 'myplugin',
    plugin_instance => '',
    type_instance   => ''
  }
Notification

A notification is one structure defining the severity, time and message of the status message as well as an identification of a data instance:

  {
    severity => NOTIF_FAILURE || NOTIF_WARNING || NOTIF_OKAY,
    time     => time (),
    message  => 'status message',
    host     => $hostname_g,
    plugin   => 'myplugin',
    type     => 'mytype',
    plugin_instance => '',
    type_instance   => ''
  }


METHODS

The following functions provide the C-interface to Perl-modules. They are exported by the ``:plugin'' export tag (see the section ``EXPORTS'' below).

plugin_register (type, name, data)

Registers a callback-function or data-set.

type can be one of:

TYPE_INIT
TYPE_READ
TYPE_WRITE
TYPE_FLUSH
TYPE_LOG
TYPE_NOTIF
TYPE_SHUTDOWN
TYPE_DATASET

name is the name of the callback-function or the type of the data-set, depending on the value of type. (Please note that the type of the data-set is the value passed as name here and has nothing to do with the type argument which simply tells plugin_register what is being registered.)

The last argument, data, is either a function name or an array-reference. If type is TYPE_DATASET, then the data argument must be an array-reference which points to an array of hashes. Each hash describes one data-set. For the exact layout see Data-Set above. Please note that there is a large number of predefined data-sets available in the types.db file which are automatically registered with collectd - see types.db(5) for a description of the format of this file.

If the type argument is any of the other types (TYPE_INIT, TYPE_READ, ...) then data is expected to be a function name. If the name is not prefixed with the plugin's package name collectd will add it automatically. The interface slightly differs from the C interface (which expects a function pointer instead) because Perl does not support to share references to subroutines between threads.

These functions are called in the various stages of the daemon (see the section ``WRITING YOUR OWN PLUGINS'' above) and are passed the following arguments:

TYPE_INIT
TYPE_READ
TYPE_SHUTDOWN

No arguments are passed.

TYPE_WRITE

The arguments passed are type, data-set, and value-list. type is a string. For the layout of data-set and value-list see above.

TYPE_FLUSH

The only argument passed is timeout which indicates that only data older than timeout seconds is to be flushed.

TYPE_LOG

The arguments are log-level and message. The log level is small for important messages and high for less important messages. The least important level is LOG_DEBUG, the most important level is LOG_ERR. In between there are (from least to most important): LOG_INFO, LOG_NOTICE, and LOG_WARNING. message is simply a string without a newline at the end.

TYPE_NOTIF

The only argument passed is notification. See above for the layout of this data type.

plugin_unregister (type, plugin)

Removes a callback or data-set from collectd's internal list of functions / datasets.

plugin_dispatch_values (type, value-list)

Submits a value-list of type type to the daemon. If the data-set type is found (and the number of values matches the number of data-sources) then the type, data-set and value-list is passed to all write-callbacks that are registered with the daemon.

plugin_flush ([timeout => timeout,] [plugins => ...])

Flush one or more plugins. timeout is passed on to the registered flush-callbacks. If omitted, -1 is used. If the plugins argument has been specified, only named plugins will be flushed. The argument's value may either be a string or a reference to an array of strings.

plugin_flush_one (timeout, plugin)

This is identical to using ``plugin_flush (timeout => timeout, plugins => plugin''.

plugin_flush_all (timeout)

This is identical to using ``plugin_flush (timeout => timeout)''.

plugin_dispatch_notification (notification)

Submits a notification to the daemon which will then pass it to all notification-callbacks that are registered.

plugin_log (log-level, message)

Submits a message of level log-level to collectd's logging mechanism. The message is passed to all log-callbacks that are registered with collectd.

ERROR, WARNING, NOTICE, INFO, DEBUG (message)

Wrappers around plugin_log, using LOG_ERR, LOG_WARNING, LOG_NOTICE, LOG_INFO and LOG_DEBUG respectively as log-level.


GLOBAL VARIABLES

$hostname_g

As the name suggests this variable keeps the hostname of the system collectd is running on. The value might be influenced by the Hostname or FQDNLookup configuration options (see collectd.conf(5) for details).

$interval_g

This variable keeps the interval in seconds in which the read functions are queried (see the Interval configuration option).

Any changes to these variables will be globally visible in collectd.


EXPORTS

By default no symbols are exported. However, the following export tags are available (:all will export all of them):

:plugin
plugin_register ()
plugin_unregister ()
plugin_dispatch_values ()
plugin_flush ()
plugin_flush_one ()
plugin_flush_all ()
plugin_dispatch_notification ()
plugin_log ()
:types
TYPE_INIT
TYPE_READ
TYPE_WRITE
TYPE_FLUSH
TYPE_SHUTDOWN
TYPE_LOG
:ds_types
DS_TYPE_COUNTER
DS_TYPE_GAUGE
:log
ERROR ()
WARNING ()
NOTICE ()
INFO ()
DEBUG ()
LOG_ERR
LOG_WARNING
LOG_NOTICE
LOG_INFO
LOG_DEBUG
:notif
NOTIF_FAILURE
NOTIF_WARNING
NOTIF_OKAY
:globals
$hostname_g
$interval_g


EXAMPLES

Any Perl plugin will start similar to:

  package Collectd::Plugins::FooBar;
  use strict;
  use warnings;
  use Collectd qw( :all );

A very simple read function will look like:

  sub foobar_read
  {
    my $vl = { plugin => 'foobar' };
    $vl->{'values'} = [ rand(42) ];
    plugin_dispatch_values ('gauge', $vl);
    return 1;
  }

A very simple write function will look like:

  sub foobar_write
  {
    my ($type, $ds, $vl) = @_;
    for (my $i = 0; $i < scalar (@$ds); ++$i) {
      print "$vl->{'plugin'} ($vl->{'type'}): $vl->{'values'}->[$i]\n";
    }
    return 1;
  }

To register those functions with collectd:

  plugin_register (TYPE_READ, "foobar", "foobar_read");
  plugin_register (TYPE_WRITE, "foobar", "foobar_write");

See the section ``DATA TYPES'' above for a complete documentation of the data types used by the read and write functions.


NOTES

Please feel free to send in new plugins to collectd's mailinglist at <collectd at verplant.org> for review and, possibly, inclusion in the main distribution. In the latter case, we will take care of keeping the plugin up to date and adapting it to new versions of collectd.

Before submitting your plugin, please take a look at http://collectd.org/dev-info.shtml.


CAVEATS

collectd is heavily multi-threaded. Each collectd thread accessing the perl plugin will be mapped to a Perl interpreter thread (see threads(3perl)). Any such thread will be created and destroyed transparently and on-the-fly.

Hence, any plugin has to be thread-safe if it provides several entry points from collectd (i. e. if it registers more than one callback or if a registered callback may be called more than once in parallel). Please note that no data is shared between threads by default. You have to use the threads::shared module to do so.

Each function name registered with collectd has to be available before the first thread has been created (i. e. basically at compile time). This basically means that hacks (yes, I really consider this to be a hack) like *foo = \&bar; plugin_register (TYPE_READ, "plugin", "foo"); most likely will not work. This is due to the fact that the symbol table is not shared across different threads.

Each plugin is usually only loaded once and kept in memory for performance reasons. Therefore, END blocks are only executed once when collectd shuts down. You should not rely on END blocks anyway - use shutdown functions instead.


KNOWN BUGS

Currently, it is not possible to flush a single Perl plugin only. You can either flush all Perl plugins or none at all and you have to use perl as plugin name when doing so.


SEE ALSO

collectd(1), collectd.conf(5), collectd-exec(5), types.db(5), perl(1), threads(3perl), the threads::shared(3perl) manpage, perldebug(1)


AUTHOR

The perl plugin has been written by Sebastian Harl <sh at tokkee.org>.

This manpage has been written by Florian Forster <octo at verplant.org> and Sebastian Harl <sh at tokkee.org>.