blob: 3c9cc8c6f9cefba04b2b8871fbaf848ac2068d7d [file] [log] [blame]
Jakub Pavlike7d12cd2015-09-03 19:02:45 +02001
2============
3Heka Formula
4============
5
Ales Komarekc9a3eb12016-10-12 11:17:55 +02006Heka is an open source stream processing software system developed by Mozilla. Heka is a Swiss Army Knife type tool for data processing.
Jakub Pavlike7d12cd2015-09-03 19:02:45 +02007
8Sample pillars
9==============
10
Ales Komarekc9a3eb12016-10-12 11:17:55 +020011Log collector service
jan kaufman1002cd92015-09-16 16:30:48 +020012
Jakub Pavlike7d12cd2015-09-03 19:02:45 +020013.. code-block:: yaml
14
15 heka:
Ales Komarekc9a3eb12016-10-12 11:17:55 +020016 log_collector:
Éric Lemoine0aba3fd2016-12-06 10:36:39 +000017 automatic_starting: true
18 elasticsearch_host: 172.16.10.253
19 elasticsearch_port: 9200
Jakub Pavlike7d12cd2015-09-03 19:02:45 +020020 enabled: true
Éric Lemoine0aba3fd2016-12-06 10:36:39 +000021 poolsize: 100
jan kaufman1002cd92015-09-16 16:30:48 +020022
Éric Lemoine0aba3fd2016-12-06 10:36:39 +000023Default values:
24
25* ``automatic_starting: true``
26* ``elastisearch_port: 9200``
27* ``enabled: false``
28* ``poolsize: 100``
29
30Local Metric collector service
jan kaufman1002cd92015-09-16 16:30:48 +020031
32.. code-block:: yaml
33
jan kaufman1002cd92015-09-16 16:30:48 +020034 heka:
Ales Komarekc9a3eb12016-10-12 11:17:55 +020035 metric_collector:
Éric Lemoine0aba3fd2016-12-06 10:36:39 +000036 aggregator_host: 172.16.20.253
37 aggregator_port: 5565
38 automatic_starting: true
jan kaufman1002cd92015-09-16 16:30:48 +020039 enabled: true
Éric Lemoine0aba3fd2016-12-06 10:36:39 +000040 influxdb_database: lma
41 influxdb_host: 172.16.10.101
42 influxdb_password: lmapass
43 influxdb_port: 8086
44 influxdb_time_precision: ms
45 influxdb_timeout: 500
46 influxdb_username: lma
47 nagios_host: 172.16.20.253
48 nagios_host_dimension_key: nagios_host
49 nagios_password: secret
50 nagios_port: 5601
51 nagios_username: nagiosadmin
52 poolsize: 100
53
54Default values:
55
56* ``aggregator_port: 5565``
57* ``automatic_starting: true``
58* ``enabled: false``
59* ``influxdb_port: 8086``
60* ``influxdb_time_precision: ms``
61* ``influxdb_timeout: 5000``
62* ``nagios_port: 8001``
63* ``poolsize: 100``
64
65Remote Metric Collector service
66
67.. code-block:: yaml
68
69 heka:
70 remote_collector:
71 aggregator_host: 172.16.20.253
72 aggregator_port: 5565
73 amqp_exchange: nova
74 amqp_host: 172.16.10.254
75 amqp_password: workshop
76 amqp_port: 5672
77 amqp_user: openstack
78 amqp_vhost: /openstack
79 automatic_starting: false
80 elasticsearch_host: 172.16.10.253
81 elasticsearch_port: 9200
82 enabled: true
83 influxdb_database: lma
84 influxdb_host: 172.16.10.101
85 influxdb_password: lmapass
86 influxdb_port: 8086
87 influxdb_time_precision: ms
88 influxdb_username: lma
89 poolsize: 100
90
91Default values:
92
93* ``aggregator_port: 5565``
94* ``amqp_exchange: nova``
95* ``automatic_starting: true``
96* ``elastisearch_port: 9200``
97* ``enabled: false``
98* ``influxdb_port: 8086``
99* ``influxdb_time_precision: ms``
100* ``influxdb_timeout: 5000``
101* ``poolsize: 100``
Ales Komarekc9a3eb12016-10-12 11:17:55 +0200102
103Aggregator service
104
105.. code-block:: yaml
106
107 heka:
108 aggregator:
Éric Lemoine0aba3fd2016-12-06 10:36:39 +0000109 automatic_starting: false
Ales Komarekc9a3eb12016-10-12 11:17:55 +0200110 enabled: true
Éric Lemoine0aba3fd2016-12-06 10:36:39 +0000111 influxdb_database: lma
112 influxdb_host: 172.16.10.101
113 influxdb_password: lmapass
114 influxdb_port: 8086
115 influxdb_time_precision: ms
116 influxdb_username: lma
117 nagios_default_host_alarm_clusters: 00-clusters
118 nagios_host: 172.16.20.253
119 nagios_host_dimension_key: nagios_host
120 nagios_password: secret
121 nagios_port: 5601
122 nagios_username: nagiosadmin
123 poolsize: 100
Ales Komarekc9a3eb12016-10-12 11:17:55 +0200124
Éric Lemoine0aba3fd2016-12-06 10:36:39 +0000125Default values:
126
127* ``automatic_starting: true``
128* ``enabled: false``
129* ``influxdb_port: 8086``
130* ``influxdb_time_precision: ms``
131* ``influxdb_timeout: 5000``
132* ``nagios_port: 8001``
133* ``nagios_default_host_alarm_clusters: 00-clusters``
134* ``poolsize: 100``
135
136Ceilometer service
137
138.. code-block:: yaml
139
140 heka:
141 ceilometer_collector:
142 elasticsearch_host: 172.16.10.253
143 elasticsearch_port: 9200
144 enabled: true
145 influxdb_database: lma
146 influxdb_host: 172.16.10.101
147 influxdb_password: lmapass
148 influxdb_port: 8086
149 influxdb_time_precision: ms
150 influxdb_username: lma
151 resource_decoding: false
152 rabbit_host: 172.16.10.253
153 rabbit_port: 5672
154 rabbit_queue: metering.sample
155 rabbit_vhost: /openstack
156
157Default values:
158
159* ``elastisearch_port: 9200``
160* ``enabled: false``
161* ``influxdb_port: 8086``
162* ``influxdb_time_precision: ms``
163* ``influxdb_timeout: 5000``
164* ``rabbit_port: 5672``
165* ``rabbit_vhost: /openstack``
166* ``rabbit_queue: metering.sample``
167* ``resource_decoding: false``
Jakub Pavlike7d12cd2015-09-03 19:02:45 +0200168
169Read more
170=========
171
jan kaufman1002cd92015-09-16 16:30:48 +0200172* https://hekad.readthedocs.org/en/latest/index.html