Heka Formula

Heka is an open source stream processing software system developed by Mozilla. Heka is a Swiss Army Knife type tool for data processing.

Sample pillars

Log collector service

heka:
  log_collector:
    automatic_starting: true
    elasticsearch_host: 172.16.10.253
    elasticsearch_port: 9200
    enabled: true
    metric_collector_host: 127.0.0.1
    metric_collector_port: 5567
    poolsize: 100
    max_message_size: 262144

Default values:

  • automatic_starting: true
  • elastisearch_port: 9200
  • enabled: false
  • metric_collector_host: 127.0.0.1
  • metric_collector_port: 5567
  • poolsize: 100
  • max_message_size: 262144

Local Metric collector service

heka:
  metric_collector:
    aggregator_host: 172.16.20.253
    aggregator_port: 5565
    automatic_starting: true
    enabled: true
    influxdb_database: lma
    influxdb_host: 172.16.10.101
    influxdb_password: lmapass
    influxdb_port: 8086
    influxdb_time_precision: ms
    influxdb_timeout: 500
    influxdb_username: lma
    nagios_host: 172.16.20.253
    nagios_host_dimension_key: nagios_host
    nagios_password: secret
    nagios_port: 5601
    nagios_username: nagiosadmin
    poolsize: 100
    max_message_size: 262144

Default values:

  • aggregator_port: 5565
  • automatic_starting: true
  • enabled: false
  • influxdb_port: 8086
  • influxdb_time_precision: ms
  • influxdb_timeout: 5000
  • nagios_port: 8001
  • poolsize: 100
  • max_message_size: 262144

Remote Metric Collector service

heka:
  remote_collector:
    aggregator_host: 172.16.20.253
    aggregator_port: 5565
    amqp_exchange: nova
    amqp_host: 172.16.10.254
    amqp_password: workshop
    amqp_port: 5672
    amqp_user: openstack
    amqp_vhost: /openstack
    automatic_starting: false
    elasticsearch_host: 172.16.10.253
    elasticsearch_port: 9200
    enabled: true
    influxdb_database: lma
    influxdb_host: 172.16.10.101
    influxdb_password: lmapass
    influxdb_port: 8086
    influxdb_time_precision: ms
    influxdb_username: lma
    poolsize: 100
    max_message_size: 262144

Default values:

  • aggregator_port: 5565
  • amqp_exchange: nova
  • amqp_port: 5672
  • amqp_vhost: ''
  • automatic_starting: true
  • elastisearch_port: 9200
  • enabled: false
  • influxdb_port: 8086
  • influxdb_time_precision: ms
  • influxdb_timeout: 5000
  • poolsize: 100
  • max_message_size: 262144

Aggregator service

heka:
  aggregator:
    automatic_starting: false
    enabled: true
    influxdb_database: lma
    influxdb_host: 172.16.10.101
    influxdb_password: lmapass
    influxdb_port: 8086
    influxdb_time_precision: ms
    influxdb_username: lma
    nagios_default_host_alarm_clusters: 00-clusters
    nagios_host: 172.16.20.253
    nagios_host_dimension_key: nagios_host
    nagios_password: secret
    nagios_port: 5601
    nagios_username: nagiosadmin
    poolsize: 100
    max_message_size: 262144

Default values:

  • automatic_starting: true
  • enabled: false
  • influxdb_port: 8086
  • influxdb_time_precision: ms
  • influxdb_timeout: 5000
  • nagios_port: 8001
  • nagios_default_host_alarm_clusters: 00-clusters
  • poolsize: 100
  • max_message_size: 262144

Ceilometer service

heka:
  ceilometer_collector:
    elasticsearch_host: 172.16.10.253
    elasticsearch_port: 9200
    enabled: true
    influxdb_database: lma
    influxdb_host: 172.16.10.101
    influxdb_password: lmapass
    influxdb_port: 8086
    influxdb_time_precision: ms
    influxdb_username: lma
    resource_decoding: false
    amqp_exchange: ceilometer
    amqp_host: 172.16.10.253
    amqp_port: 5672
    amqp_queue: metering.sample
    amqp_vhost: /openstack

Default values:

  • automatic_starting: true
  • elastisearch_port: 9200
  • enabled: false
  • influxdb_port: 8086
  • influxdb_time_precision: ms
  • influxdb_timeout: 5000
  • poolsize: 100
  • amqp_exchange: ceilometer
  • amqp_port: 5672
  • amqp_queue: metering.sample
  • amqp_vhost: /openstack
  • resource_decoding: false

Documentation and Bugs

To learn how to install and update salt-formulas, consult the documentation available online at:

In the unfortunate event that bugs are discovered, they should be reported to the appropriate issue tracker. Use Github issue tracker for specific salt formula:

For feature requests, bug reports or blueprints affecting entire ecosystem, use Launchpad salt-formulas project:

You can also join salt-formulas-users team and subscribe to mailing list:

Developers wishing to work on the salt-formulas projects should always base their work on master branch and submit pull request against specific formula.

Any questions or feedback is always welcome so feel free to join our IRC channel:

#salt-formulas @ irc.freenode.net