blob: 827ddc186fca01689558d44cd6d3227b2886fadc [file] [log] [blame]
Aleš Komáreka3314b22017-04-11 13:46:06 +02001====================
2OpenContrail Formula
3====================
Filip Pytloun27930402015-10-06 16:28:32 +02004
Jakub Pavlik01fe5372016-05-20 11:23:28 +02005Contrail Controller is an open, standards-based software solution that
6delivers network virtualization and service automation for federated cloud
7networks. It provides self-service provisioning, improves network
8troubleshooting and diagnostics, and enables service chaining for dynamic
9application environments across enterprise virtual private cloud (VPC),
10managed Infrastructure as a Service (IaaS), and Networks Functions
11Virtualization (NFV) use cases.
Filip Pytloun27930402015-10-06 16:28:32 +020012
Jiri Konecny463dee52016-03-03 11:08:46 +010013
Petr Michalec579e64d2017-03-24 12:54:29 +010014Package source
15==============
Aleš Komáreka3314b22017-04-11 13:46:06 +020016
Petr Michalec579e64d2017-03-24 12:54:29 +010017Formula support OpenContrail as well as Juniper Contrail package repository in the backend.
18
19Differences withing the configuration and state run are controlled by
20``opencontrail.common.vendor: [opencontrail|juniper]`` pillar attribute.
21
22Default value is set to ``opencontrail``.
23
24Juniper releases tested with this formula:
25 - 3.0.2.x
26
27To use Juniper Contrail repository as a source of packages override pillar as in this example:
28
29.. code-block:: yaml
30
31 opencontrail:
32 common:
33 vendor: juniper
34
35
Aleš Komáreka3314b22017-04-11 13:46:06 +020036Sample Pillars
Filip Pytloun27930402015-10-06 16:28:32 +020037==============
38
Jiri Konecny463dee52016-03-03 11:08:46 +010039Controller nodes
40----------------
41
42There are several scenarios for OpenContrail control plane.
43
44All-in-one single
45~~~~~~~~~~~~~~~~~
46
47Config, control, analytics, database, web -- altogether on one node.
48
49.. code-block:: yaml
50
51 opencontrail:
52 common:
53 version: 2.2
54 source:
55 engine: pkg
56 address: http://mirror.robotice.cz/contrail-havana/
57 identity:
58 engine: keystone
59 host: 127.0.0.1
60 port: 35357
61 token: token
62 password: password
63 network:
64 engine: neutron
65 host: 127.0.0.1
66 port: 9696
67 config:
68 version: 2.2
69 enabled: true
70 network:
71 engine: neutron
72 host: 127.0.0.1
73 port: 9696
74 discovery:
75 host: 127.0.0.1
76 analytics:
77 host: 127.0.0.1
78 bind:
79 address: 127.0.0.1
80 message_queue:
81 engine: rabbitmq
82 host: 127.0.0.1
83 port: 5672
84 database:
85 members:
86 - host: 127.0.0.1
87 port: 9160
88 cache:
Jakub Pavlikd1a059e2016-07-13 23:08:33 +020089 members:
90 - host: 127.0.0.1
91 port: 11211
Jiri Konecny463dee52016-03-03 11:08:46 +010092 identity:
93 engine: keystone
94 version: '2.0'
95 region: RegionOne
96 host: 127.0.0.1
97 port: 35357
98 user: admin
99 password: password
100 token: token
101 tenant: admin
102 members:
103 - host: 127.0.0.1
104 id: 1
Dmitry Stremkovskiy841fee32017-09-01 18:08:41 +0300105 rootlogger: "INFO, CONSOLE"
Jiri Konecny463dee52016-03-03 11:08:46 +0100106 control:
107 version: 2.2
108 enabled: true
109 bind:
110 address: 127.0.0.1
111 discovery:
112 host: 127.0.0.1
113 master:
114 host: 127.0.0.1
115 members:
116 - host: 127.0.0.1
117 id: 1
118 collector:
119 version: 2.2
120 enabled: true
121 bind:
122 address: 127.0.0.1
123 master:
124 host: 127.0.0.1
125 discovery:
126 host: 127.0.0.1
127 data_ttl: 2
128 database:
129 members:
130 - host: 127.0.0.1
131 port: 9160
Sergey Kreysfd017c12018-05-04 18:35:37 +0300132 message_queue:
133 members:
134 - host: 127.0.0.1
135 - host: 127.0.0.1
136 - host: 127.0.0.1
Jiri Konecny463dee52016-03-03 11:08:46 +0100137 database:
138 version: 2.2
139 cassandra:
140 version: 2
141 enabled: true
142 minimum_disk: 10
143 name: 'Contrail'
144 original_token: 0
Dmitry Stremkovskiy2a079c72017-07-12 23:11:18 +0300145 compaction_throughput_mb_per_sec: 16
Dmitry Stremkovskiy71b310a2017-08-11 20:39:11 +0300146 concurrent_compactors: 1
Jiri Konecny463dee52016-03-03 11:08:46 +0100147 data_dirs:
148 - /var/lib/cassandra
149 id: 1
150 discovery:
151 host: 127.0.0.1
152 bind:
153 host: 127.0.0.1
154 port: 9042
155 rpc_port: 9160
156 members:
157 - host: 127.0.0.1
158 id: 1
159 web:
160 version: 2.2
161 enabled: True
162 bind:
163 address: 127.0.0.1
164 analytics:
165 host: 127.0.0.1
166 master:
167 host: 127.0.0.1
168 cache:
169 engine: redis
170 host: 127.0.0.1
171 port: 6379
172 members:
173 - host: 127.0.0.1
174 id: 1
175 identity:
176 engine: keystone
177 version: '2.0'
178 host: 127.0.0.1
179 port: 35357
180 user: admin
181 password: password
182 token: token
183 tenant: admin
184
185
186All-in-one cluster
187~~~~~~~~~~~~~~~~~~
188
Jakub Pavlik01fe5372016-05-20 11:23:28 +0200189Config, control, analytics, database, web -- altogether, clustered on multiple
190nodes.
Jiri Konecny463dee52016-03-03 11:08:46 +0100191
192.. code-block:: yaml
193
194 opencontrail:
195 common:
196 version: 2.2
197 source:
198 engine: pkg
199 address: http://mirror.robotice.cz/contrail-havana/
200 identity:
201 engine: keystone
202 host: 127.0.0.1
203 port: 35357
204 token: token
205 password: password
206 network:
207 engine: neutron
208 host: 127.0.0.1
209 port: 9696
210 config:
211 version: 2.2
212 enabled: true
213 network:
214 engine: neutron
215 host: 127.0.0.1
216 port: 9696
217 discovery:
218 host: 127.0.0.1
219 analytics:
220 host: 127.0.0.1
221 bind:
222 address: 127.0.0.1
223 message_queue:
224 engine: rabbitmq
225 host: 127.0.0.1
226 port: 5672
227 database:
228 members:
229 - host: 127.0.0.1
230 port: 9160
231 - host: 127.0.0.1
232 port: 9160
233 - host: 127.0.0.1
234 port: 9160
235 cache:
Jakub Pavlikd1a059e2016-07-13 23:08:33 +0200236 members:
237 - host: 127.0.0.1
238 port: 11211
239 - host: 127.0.0.1
240 port: 11211
241 - host: 127.0.0.1
242 port: 11211
Jiri Konecny463dee52016-03-03 11:08:46 +0100243 identity:
244 engine: keystone
245 version: '2.0'
246 region: RegionOne
247 host: 127.0.0.1
248 port: 35357
249 user: admin
250 password: password
251 token: token
252 tenant: admin
253 members:
254 - host: 127.0.0.1
255 id: 1
256 - host: 127.0.0.1
257 id: 2
258 - host: 127.0.0.1
259 id: 3
260 control:
261 version: 2.2
262 enabled: true
263 bind:
264 address: 127.0.0.1
265 discovery:
266 host: 127.0.0.1
267 master:
268 host: 127.0.0.1
269 members:
270 - host: 127.0.0.1
271 id: 1
272 - host: 127.0.0.1
273 id: 2
274 - host: 127.0.0.1
275 id: 3
276 collector:
277 version: 2.2
278 enabled: true
279 bind:
280 address: 127.0.0.1
281 master:
282 host: 127.0.0.1
283 discovery:
284 host: 127.0.0.1
285 data_ttl: 1
286 database:
287 members:
288 - host: 127.0.0.1
289 port: 9160
290 - host: 127.0.0.1
291 port: 9160
292 - host: 127.0.0.1
293 port: 9160
Sergey Kreysfd017c12018-05-04 18:35:37 +0300294 message_queue:
295 members:
296 - host: 127.0.0.1
297 - host: 127.0.0.1
298 - host: 127.0.0.1
Jiri Konecny463dee52016-03-03 11:08:46 +0100299 database:
300 version: 2.2
301 cassandra:
302 version: 2
303 enabled: true
304 name: 'Contrail'
305 minimum_disk: 10
306 original_token: 0
307 data_dirs:
308 - /var/lib/cassandra
309 id: 1
310 discovery:
311 host: 127.0.0.1
312 bind:
313 host: 127.0.0.1
314 port: 9042
315 rpc_port: 9160
316 members:
317 - host: 127.0.0.1
318 id: 1
319 - host: 127.0.0.1
320 id: 2
321 - host: 127.0.0.1
322 id: 3
323 web:
324 version: 2.2
325 enabled: True
326 bind:
327 address: 127.0.0.1
328 master:
329 host: 127.0.0.1
330 analytics:
331 host: 127.0.0.1
332 cache:
333 engine: redis
334 host: 127.0.0.1
335 port: 6379
336 members:
337 - host: 127.0.0.1
338 id: 1
339 - host: 127.0.0.1
340 id: 2
341 - host: 127.0.0.1
342 id: 3
343 identity:
344 engine: keystone
345 version: '2.0'
346 host: 127.0.0.1
347 port: 35357
348 user: admin
349 password: password
350 token: token
351 tenant: admin
352
353
354Separated analytics from control and config
355~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
356
357Config, control, database, web.
358
359.. code-block:: yaml
360
361 opencontrail:
362 common:
363 version: 2.2
364 identity:
365 engine: keystone
366 host: 127.0.0.1
367 port: 35357
368 token: token
369 password: password
370 network:
371 engine: neutron
372 host: 127.0.0.1
373 port: 9696
374 config:
375 version: 2.2
376 enabled: true
377 network:
378 engine: neutron
379 host: 127.0.0.1
380 port: 9696
381 discovery:
382 host: 127.0.0.1
383 analytics:
384 host: 127.0.0.1
385 bind:
386 address: 127.0.0.1
387 message_queue:
388 engine: rabbitmq
389 host: 127.0.0.1
390 port: 5672
391 database:
392 members:
393 - host: 127.0.0.1
394 port: 9160
395 - host: 127.0.0.1
396 port: 9160
397 - host: 127.0.0.1
398 port: 9160
399 cache:
Jakub Pavlikd1a059e2016-07-13 23:08:33 +0200400 members:
401 - host: 127.0.0.1
402 port: 11211
403 - host: 127.0.0.1
404 port: 11211
405 - host: 127.0.0.1
406 port: 11211
Jiri Konecny463dee52016-03-03 11:08:46 +0100407 identity:
408 engine: keystone
409 version: '2.0'
410 region: RegionOne
411 host: 127.0.0.1
412 port: 35357
413 user: admin
414 password: password
415 token: token
416 tenant: admin
417 members:
418 - host: 127.0.0.1
419 id: 1
420 - host: 127.0.0.1
421 id: 2
422 - host: 127.0.0.1
423 id: 3
424 control:
425 version: 2.2
426 enabled: true
427 bind:
428 address: 127.0.0.1
429 discovery:
430 host: 127.0.0.1
431 master:
432 host: 127.0.0.1
433 members:
434 - host: 127.0.0.1
435 id: 1
436 - host: 127.0.0.1
437 id: 2
438 - host: 127.0.0.1
439 id: 3
440 database:
441 version: 127.0.0.1
442 cassandra:
443 version: 2
444 enabled: true
445 name: 'Contrail'
446 minimum_disk: 10
447 original_token: 0
448 data_dirs:
449 - /var/lib/cassandra
450 id: 1
451 discovery:
452 host: 127.0.0.1
453 bind:
454 host: 127.0.0.1
455 port: 9042
456 rpc_port: 9160
457 members:
458 - host: 127.0.0.1
459 id: 1
460 - host: 127.0.0.1
461 id: 2
462 - host: 127.0.0.1
463 id: 3
464 web:
465 version: 2.2
466 enabled: True
467 bind:
468 address: 127.0.0.1
469 analytics:
470 host: 127.0.0.1
471 master:
472 host: 127.0.0.1
473 cache:
474 engine: redis
475 host: 127.0.0.1
476 port: 6379
477 members:
478 - host: 127.0.0.1
479 id: 1
480 - host: 127.0.0.1
481 id: 2
482 - host: 127.0.0.1
483 id: 3
484 identity:
485 engine: keystone
486 version: '2.0'
487 host: 127.0.0.1
488 port: 35357
489 user: admin
490 password: password
491 token: token
492 tenant: admin
493
Jiri Konecny463dee52016-03-03 11:08:46 +0100494Analytic nodes
Jiri Konecny463dee52016-03-03 11:08:46 +0100495
496Analytics and database on an analytic node(s)
497
498.. code-block:: yaml
499
500 opencontrail:
501 common:
502 version: 2.2
503 identity:
504 engine: keystone
505 host: 127.0.0.1
506 port: 35357
507 token: token
508 password: password
509 network:
510 engine: neutron
511 host: 127.0.0.1
512 port: 9696
513 collector:
514 version: 2.2
515 enabled: true
516 bind:
517 address: 127.0.0.1
518 master:
519 host: 127.0.0.1
520 discovery:
521 host: 127.0.0.1
522 data_ttl: 1
523 database:
524 members:
525 - host: 127.0.0.1
526 port: 9160
527 - host: 127.0.0.1
528 port: 9160
529 - host: 127.0.0.1
530 port: 9160
Sergey Kreysfd017c12018-05-04 18:35:37 +0300531 message_queue:
532 members:
533 - host: 127.0.0.1
534 - host: 127.0.0.1
535 - host: 127.0.0.1
Jiri Konecny463dee52016-03-03 11:08:46 +0100536 database:
537 version: 2.2
538 cassandra:
539 version: 2
540 enabled: true
541 name: 'Contrail'
542 minimum_disk: 10
543 original_token: 0
544 data_dirs:
545 - /var/lib/cassandra
546 id: 1
547 discovery:
548 host: 127.0.0.1
549 bind:
550 host: 127.0.0.1
551 port: 9042
552 rpc_port: 9160
553 members:
554 - host: 127.0.0.1
555 id: 1
556 - host: 127.0.0.1
557 id: 2
558 - host: 127.0.0.1
559 id: 3
560
561
562Compute nodes
Aleš Komáreka3314b22017-04-11 13:46:06 +0200563-------------
Jiri Konecny463dee52016-03-03 11:08:46 +0100564
565Vrouter configuration on a compute node(s)
566
567.. code-block:: yaml
568
569 opencontrail:
570 common:
571 version: 2.2
572 identity:
573 engine: keystone
574 host: 127.0.0.1
575 port: 35357
576 token: token
577 password: password
578 network:
579 engine: neutron
580 host: 127.0.0.1
581 port: 9696
582 compute:
583 version: 2.2
584 enabled: True
Dmitry Stremkovskiy0cb5c562017-07-26 00:32:51 +0300585 hostname: node-12.domain.tld
Danysa144f292018-06-26 16:08:50 +0200586 flow_hold_limit: 0
Jiri Konecny463dee52016-03-03 11:08:46 +0100587 discovery:
588 host: 127.0.0.1
589 interface:
590 address: 127.0.0.1
591 dev: eth0
592 gateway: 127.0.0.1
593 mask: /24
594 dns: 127.0.0.1
595 mtu: 9000
596
Petr Jediný5f3008a2017-07-31 15:04:05 +0200597
598Compute nodes with gateway_mode
599-------------------------------
600
601Gateway mode: can be server/ vcpe (default is none)
602
603.. code-block:: yaml
604
605 opencontrail:
606 compute:
607 gateway_mode: server
608
Vasyl Saienkob10b7202017-09-05 14:19:03 +0300609TSN nodes
610---------
611
612Configure TSN nodes
613
614.. code-block:: yaml
615
616 opencontrail:
617 compute:
618 enabled: true
619 tor:
620 enabled: true
621 bind:
622 port: 8086
623 agent:
624 tor01:
625 id: 0
626 port: 6632
627 host: 127.0.0.1
628 address: 127.0.0.1
629
Petr Jediný5f3008a2017-07-31 15:04:05 +0200630
Andreyeff77ac2017-08-25 12:14:06 -0500631Set up metadata secret for the Vrouter
Petr Jedinýfe51c6a2017-09-05 18:30:31 +0200632--------------------------------------
Andreyeff77ac2017-08-25 12:14:06 -0500633
Petr Jedinýfe51c6a2017-09-05 18:30:31 +0200634In order to get cloud-init within the instance to properly fetch
Andreyeff77ac2017-08-25 12:14:06 -0500635instance metadata, metadata_proxy_secret in the Vrouter agent config
636should match the value in nova.conf. The administrator should define
637it in the pillar:
638
639.. code-block:: yaml
640
641 opencontrail:
642 compute:
643 metadata:
644 secret: opencontrail
645
Petr Jedinýfe51c6a2017-09-05 18:30:31 +0200646Add auth info for Barbican on compute nodes
647-------------------------------------------
648
649.. code-block:: yaml
650
651 opencontrail:
652 compute:
653 lbaas:
654 enabled: true
655 secret_manager:
656 engine: barbican
657 identity:
658 user: admin
659 password: "supersecretpassword123"
660 tenant: admin
661
662
Jakub Pavlik735005f2016-02-26 15:54:53 +0100663Keystone v3
Aleš Komáreka3314b22017-04-11 13:46:06 +0200664-----------
Jakub Pavlik735005f2016-02-26 15:54:53 +0100665
Jakub Pavlik01fe5372016-05-20 11:23:28 +0200666To enable support for keystone v3 in opencontrail, there must be defined
667version for config and web role.
Jakub Pavlik735005f2016-02-26 15:54:53 +0100668
669.. code-block:: yaml
670
671 opencontrail:
672 config:
673 version: 2.2
674 enabled: true
675 ...
676 identity:
677 engine: keystone
678 version: '3'
679 ...
680
681 opencontrail:
682 web:
683 version: 2.2
684 enabled: true
685 ...
686 identity:
687 engine: keystone
688 version: '3'
689 ...
690
marco10cc2212016-04-03 14:21:54 +0200691Without Keystone
692----------------
693
694.. code-block:: yaml
695
696 opencontrail:
697 ...
698 common:
699 ...
700 identity:
701 engine: none
702 token: none
703 password: none
704 ...
705 config:
706 ...
707 identity:
708 engine: none
709 password: none
710 token: none
711 ...
712 web:
713 ...
714 identity:
715 engine: none
716 password: none
717 token: none
718 ...
marcof5461712016-04-04 20:49:36 +0200719
Aleš Komáreka3314b22017-04-11 13:46:06 +0200720Kubernetes support
721------------------
722
marcof5461712016-04-04 20:49:36 +0200723Kubernetes vrouter nodes
marcof5461712016-04-04 20:49:36 +0200724
725Vrouter configuration on a kubernetes node(s)
726
727.. code-block:: yaml
728
729 opencontrail:
730 ...
731 compute:
732 engine: kubernetes
733 ...
734
Jakub Pavlik0d1f67e2016-11-30 10:04:13 +0100735vRouter with separated control plane
Jakub Pavlik0d1f67e2016-11-30 10:04:13 +0100736
737Separate XMPP traffic from dataplane interface.
738
739.. code-block:: yaml
740
741 opencontrail:
742 compute:
743 bind:
744 address: 172.16.0.50
745 ...
746
Petr Jediný439fab32017-07-10 14:33:09 +0200747Override RPF default in Contrail API
748------------------------------------
749
750From MCP1.1 with OpenContrail >= 3.1.1 you can override RPF default for newly
751created virtual networks. This can be useful for usecases like running
752Calico and K8S in overlay. The `override_rpf_default_by` has valid values
753`disable`, `enable`. If not defined, the configuration fallbacks to Contrail
754default - currently `enable`.
755
756.. code-block:: yaml
757
758 opencontrail:
759 ...
760 config:
761 override_rpf_default_by: 'disable'
762 ...
763
Petr Jediný01c18822017-11-15 12:30:53 +0100764Cassandra GC logging
765--------------------
766
767From Contrail version 3 you can set a way you want to handle Cassandra GC logs.
768The behavior is controlled by `cassandra_gc_logging`. Valid values are
769'rotation' (default), 'legacy' and false.
770
771- 'rotation' is supported by JDK 6u34 7u2 or later and handles rotation of log
772files automatically.
773- 'legacy' is a way to support older JDKs and you will need to handle logs by
774other means. This can be handled for example by using
775`- service.opencontrail.database.cassandra_log_cleanup` in your reclass model.
776- false will disable the cassandra gc logging
777
778.. code-block:: yaml
779
780 opencontrail:
781 ...
782 database:
783 cassandra_gc_logging: false
784 ...
785
Petr Jediný439fab32017-07-10 14:33:09 +0200786
Jakub Pavlik6d90f362016-04-19 20:34:37 +0200787Disable Contrail API authentication
788-----------------------------------
789
Petr Jediný78e6f422017-06-01 13:24:49 +0200790Contrail version must >= 3.0. It is useful especially for Keystone v3.
Jakub Pavlik6d90f362016-04-19 20:34:37 +0200791
792.. code-block:: yaml
793
794 opencontrail:
795 ...
796 config:
797 multi_tenancy: false
798 ...
799
Marek Celoudae98c642018-01-31 12:43:42 +0100800Enable RBAC
801-----------
802
803
804.. code-block:: yaml
805
806 opencontrail:
807 ...
808 config:
809 aaa_mode: rbac
810 cloud_admin_role: admin
811 global_read_only_role: member
812 ...
813
Petr Jediný78e6f422017-06-01 13:24:49 +0200814Switch from on demand to periodic keystone sync
815-----------------------------------------------
816
817This can be useful when you want to sync projects from OpenStack to Contrail
818automatically. The period of sync is 60s.
819
820.. code-block:: yaml
821
822 opencontrail:
823 ...
824 config:
825 identity:
826 sync_on_demand: false
827 ...
828
Petr Jediný03027902018-07-17 20:32:52 +0200829Cassandra listen configuration
830------------------------------
831
832Interface example:
marco2502e052016-05-31 22:53:54 +0200833
834.. code-block:: yaml
Vasyl Saienkob10b7202017-09-05 14:19:03 +0300835
marco2502e052016-05-31 22:53:54 +0200836 database:
837 ....
838 bind:
839 interface: eth0
840 port: 9042
841 rpc_port: 9160
842 ....
Jakub Pavlik6d90f362016-04-19 20:34:37 +0200843
Petr Jediný03027902018-07-17 20:32:52 +0200844For running config and analytics db clusters on same hosts, you will need to
845change ports not to collide. The host is required.
846
847 database:
848 ....
849 bind:
850 host: 127.0.0.1
851 port: 9042
852 rpc_port: 9160
853 # for containers we need to move configdb to neighbouring ports
854 port_configdb: 9041
855 rpc_port_configdb: 9161
856 ....
857
858
Petr Jedinýffbe2082017-03-07 00:56:47 +0100859OpenContrail WebUI version >= 3.1.1
860-----------------------------------
Petr Jediný78e6f422017-06-01 13:24:49 +0200861For OpenContrail version >= 3.1.1 and Cassandra >= 2.1 we should override WebUI's cassandra port from 9160 to 9042.
Petr Jedinýffbe2082017-03-07 00:56:47 +0100862
863For appropriate node at class level:
864
865.. code-block:: yaml
Aleš Komáreka3314b22017-04-11 13:46:06 +0200866
Petr Jedinýffbe2082017-03-07 00:56:47 +0100867 opencontrail:
868 ....
869 web:
870 database:
871 port: 9042
872 ....
873
874
Jakub Pavlik9a4de012016-12-14 13:23:55 +0100875RabbitMQ HA hosts
876------------------
877
878.. code-block:: yaml
879
880 opencontrail:
881 config:
882 message_queue:
883 engine: rabbitmq
884 members:
885 - host: 10.0.16.1
886 - host: 10.0.16.2
887 - host: 10.0.16.3
888 port: 5672
889
890.. code-block:: yaml
891
892 database:
893 ....
894 bind:
895 interface: eth0
896 port: 9042
897 rpc_port: 9160
898 ....
899
Jakub Pavlike3590062017-02-20 23:32:57 +0100900DPDK vRouter
901-------------
902
903.. code-block:: yaml
904
905 opencontrail:
906 compute:
907 dpdk:
908 enabled: true
Jakub Pavlik54761d82017-03-08 11:22:37 +0100909 taskset: "0x0000003C00003C"
910 socket_mem: "1024,1024"
Jakub Pavlike3590062017-02-20 23:32:57 +0100911 interface:
912 mac_address: 90:e2:ba:7c:22:e1
913 pci: 0000:81:00.1
914 ...
915
Petr Jedinýe9960762018-05-04 17:36:59 +0200916Increase number of contrail-api workers
917---------------------------------------
918
919.. code-block:: yaml
920
921 opencontrail:
922 ...
923 config:
Svimbaca9fa5b2018-09-19 14:31:34 +0200924 api:
925 workers_count: 3
Petr Jedinýe9960762018-05-04 17:36:59 +0200926 ...
927
Marek Celouddbba7ed2017-12-07 10:36:24 +0100928Increase number of alarm-gen workers
929------------------------------------
930
931Port prefix will increment used ports by workers starting with 5901.
932
933.. code-block:: yaml
934
935 collector:
936 alarm_gen:
937 workers: 1
938 port_prefix: 59
939
Ales Komarekad46d2e2017-03-09 17:16:38 +0100940Contrail client
941---------------
942
943Basic parameters with identity and host configs
944
Petr Jediný78e6f422017-06-01 13:24:49 +0200945.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +0100946
947 opencontrail:
948 client:
949 identity:
950 user: admin
951 project: admin
952 password: adminpass
953 host: keystone_host
954 config:
955 host: contrail_api_host
956 port: contrail_api_ort
957
958Enforcing virtual routers
959
Petr Jediný78e6f422017-06-01 13:24:49 +0200960.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +0100961
962 opencontrail:
963 client:
964 ...
965 virtual_router:
966 cmp01:
967 ip_address: 172.16.0.11
968 dpdk_enabled: True
969 cmp02:
970 ip_address: 172.16.0.12
971 dpdk_enabled: True
972
psvimbersky3c84e272018-01-02 10:34:29 +0100973
974Enforcing global system config
975
976.. code-block:: yaml
977
978 opencontrail:
979 client:
980 ...
981 global_system_config:
982 name: default-global-system-config
983 asn: 64512
984 grp:
985 enable: true
986 restart_time: 60
987 end_of_rib_timeout: 30
988 bgp_helper_enable: false
989 xmpp_helper_enable: false
990 long_lived_restart_time: 300
991
992
Pavel Svimbersky13cda442017-09-14 14:46:13 +0200993Enforcing global vrouter config
994
995.. code-block:: yaml
996
997 opencontrail:
998 client:
999 ...
1000 global_vrouter_config:
Petr Jediný554d0412018-01-04 22:35:48 +01001001 name: default-global-vrouter-config
Pavel Svimbersky13cda442017-09-14 14:46:13 +02001002 parent_type: global-system-config
1003 encap_priority: "MPLSoUDP,MPLSoGRE"
1004 vxlan_vn_id_mode: automatic
1005 fq_names:
1006 - 'default-global-system-config'
1007 - 'default-global-vrouter-config'
1008
psvimbersky3c84e272018-01-02 10:34:29 +01001009
1010
Ales Komarekad46d2e2017-03-09 17:16:38 +01001011Enforcing control nodes
1012
Petr Jediný78e6f422017-06-01 13:24:49 +02001013.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +01001014
1015 opencontrail:
1016 client:
1017 ...
1018 bgp_router:
1019 ntw01:
1020 type: control-node
1021 ip_address: 172.16.0.11
1022 nwt02:
1023 type: control-node
1024 ip_address: 172.16.0.12
1025 nwt03:
1026 type: control-node
1027 ip_address: 172.16.0.13
1028
1029
1030Enforcing edge BGP routers
1031
Petr Jediný78e6f422017-06-01 13:24:49 +02001032.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +01001033
1034 opencontrail:
1035 client:
1036 ...
1037 bgp_router:
1038 mx01:
1039 type: router
1040 ip_address: 172.16.0.21
1041 asn: 64512
1042 mx02:
1043 type: router
1044 ip_address: 172.16.0.22
1045 asn: 64512
Marek Celoud3097e5b2018-01-09 13:52:14 +01001046 key_type: md5
1047 key: password
Ales Komarekad46d2e2017-03-09 17:16:38 +01001048
1049Enforcing config nodes
1050
Petr Jediný78e6f422017-06-01 13:24:49 +02001051.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +01001052
1053 opencontrail:
1054 client:
1055 ...
1056 config_node:
1057 ctl01:
1058 ip_address: 172.16.0.21
1059 ctl02:
1060 ip_address: 172.16.0.22
1061
1062Enforcing database nodes
1063
Petr Jediný78e6f422017-06-01 13:24:49 +02001064.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +01001065
1066 opencontrail:
1067 client:
1068 ...
1069 database_node:
1070 ntw01:
1071 ip_address: 172.16.0.21
1072 ntw02:
1073 ip_address: 172.16.0.22
1074
1075Enforcing analytics nodes
1076
Petr Jediný78e6f422017-06-01 13:24:49 +02001077.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +01001078
1079 opencontrail:
1080 client:
1081 ...
1082 analytics_node:
1083 nal01:
1084 ip_address: 172.16.0.31
1085 nal02:
1086 ip_address: 172.16.0.32
1087
Petr Jediný5f3efe32017-05-26 17:55:09 +02001088Enforcing Link Local Services
1089
1090.. code-block:: yaml
1091
1092 opencontrail:
1093 client:
1094 ...
1095 linklocal_service:
1096 # example with dns name address (only one permited)
1097 meta1:
1098 lls_ip: 10.0.0.23
1099 lls_port: 80
1100 ipf_addresses: "meta.example.com"
1101 ipf_port: 80
1102 # example with multiple ip addresses
1103 meta2:
1104 lls_ip: 10.0.0.23
1105 lls_port: 80
1106 ipf_addresses:
1107 - 10.10.10.10
1108 - 10.20.20.20
1109 - 10.30.30.30
1110 ipf_port: 80
1111 # example with one ip address
1112 meta3:
1113 lls_ip: 10.0.0.23
1114 lls_port: 80
1115 ipf_addresses:
1116 - 10.10.10.10
1117 ipf_port: 80
1118 # example with name override
1119 lls_meta4:
1120 name: meta4
1121 lls_ip: 10.0.0.23
1122 lls_port: 80
1123 ipf_addresses:
1124 - 10.10.10.10
1125 ipf_port: 80
1126
Vasyl Saienkob10b7202017-09-05 14:19:03 +03001127
Michel Nederloff5bccda2017-11-20 13:31:38 +01001128Configuring OpenStack default quotasx
1129
1130.. code-block:: yaml
1131 config:
1132 quota:
1133 network: 5
1134 subnet: 10
1135 router: 10
1136 floating_ip: 100
1137 secgroup: 1000
1138 secgroup_rule: 1000
1139 port: 1000
1140 pool: -1
1141 member: -1
1142 health_monitor: -1
1143 vip: -1
1144
1145Enforcing physical routers
Petr Jediný04bed9b2018-05-03 19:44:10 +02001146
Vasyl Saienkob10b7202017-09-05 14:19:03 +03001147.. code-block:: yaml
1148
1149 opencontrail:
1150 client:
1151 ...
1152 physical_router:
1153 router1:
1154 name: router1
1155 dataplane_ip: 1.2.3.4
1156 management_ip: 1.2.3.4
1157 vendor_name: ovs
1158 product_name: ovs
1159 agents:
1160 - tsn0-0
1161 - tsn0
1162
1163Enforcing physical/logical interfaces for routers
1164
1165
1166.. code-block:: yaml
1167
1168 opencontrail
1169 client:
1170 ...
1171 physical_router:
1172 router1:
1173 ...
1174 interface:
1175 port1:
1176 name: port1
1177 logical_interface:
1178 port1_l:
1179 name: 'port1.0'
1180 vlan_tag: 0
1181 interface_type: L2
1182 virtual_machine_interface:
1183 port1_port:
1184 name: port1_port
1185 ip_address: 192.168.90.107
1186 mac_address: '2e:92:a8:af:c2:21'
1187 security_group: 'default'
1188 virtual_network: 'virtual-network'
1189
Jan Cachebfed1c2018-01-09 17:21:35 +01001190Enforcing virtual networks
1191
1192
1193.. code-block:: yaml
1194
1195 opencontrail:
1196 client:
1197 virtual_networks:
1198 net01:
1199 name: 'network01'
1200 ip_address: '172.16.111.0'
1201 ip_prefix: 24
1202 asn: 64512
1203 route_target: 10000
1204 external: True
1205 allow_transit: False
1206 forwarding_mode: 'l2_l3'
1207 rpf: 'disable'
1208 mirror_destination: False
1209 domain: 'default-domain'
1210 project: 'admin'
1211 ipam_domain: 'default-domain'
1212 ipam_project: 'default-project'
1213 ipam_name: 'default-network-ipam'
1214 net02:
1215 name: 'network02'
1216 net03:
1217 name: 'network03'
1218
Ales Komarekad46d2e2017-03-09 17:16:38 +01001219
Jan Cachb3092722018-01-31 12:46:16 +01001220Enforcing floating ip pool setings.
1221
1222Virtual network with flag external needs to be created before managing the floating ip pool.
1223Param vn_name is the name of the external network.
1224
1225.. code-block:: yaml
1226
1227 opencontrail:
1228 client:
1229 floating_ip_pools:
1230 pool1:
1231 vn_name: external-network
1232 vn_project: admin
1233 vn_domain: default-domain
1234 owner_access: 7
1235 global_access: 0
1236 list_of_projects:
1237 - [tenant1, 7]
1238 - [tenant2, 7]
1239 - [tenant3, 7]
1240 pool2:
1241 vn_name: floating-ips
1242 vn_project: admin
1243 vn_domain: default-domain
1244 owner_access: 7
1245 global_access: 0
1246 list_of_projects:
1247 - [tenant3, 7]
1248
1249
1250If you want to remove all shares from the ip floating pool, define only empty list in
1251list of projects, like this:
1252
1253.. code-block:: yaml
1254
1255 opencontrail:
1256 client:
1257 floating_ip_pools:
1258 pool1:
1259 vn_name: external-network
1260 vn_project: admin
1261 vn_domain: default-domain
1262 owner_access: 7
1263 global_access: 0
1264 list_of_projects: []
1265
1266
Michel Nederlof5364ab62017-12-11 15:02:25 +01001267Contrail DNS custom forwarders
1268------------------------------
1269
1270By default Contrail uses the /etc/resolv.conf file to determine the upstream DNS servers.
1271This can have some side-affects, like resolving internal DNS entries on you public instances.
1272
1273In order to overrule this default set, you can configure nameservers using pillar data.
1274The formula is then responsible for configuring and generating a alternate resolv.conf file.
1275
1276Note: this has been patched recently in the Contrail distribution of Mirantis:
1277https://github.com/Mirantis/contrail-controller/commit/ed9a25ccbcfebd7d079a93aecc5a1a7bf1265ea4
1278https://github.com/Mirantis/contrail-controller/commit/94c844cf2e9bcfcd48587aec03d10b869e737ade
1279
1280
1281To change forwarders for the default-dns option (which is handled by compute nodes):
1282
1283.. code-block:: yaml
1284
1285 compute:
1286 ....
1287 dns:
1288 forwarders:
1289 - 8.8.8.8
1290 - 8.8.4.4
1291 ....
1292
1293To change forwarders for vDNS zones (handled by control nodes):
1294
1295.. code-block:: yaml
1296
1297 control:
1298 ....
1299 dns:
1300 forwarders:
1301 - 8.8.8.8
1302 - 8.8.4.4
1303 ....
1304
Petr Jediný04bed9b2018-05-03 19:44:10 +02001305Contrail IF-MAP server configuration
1306------------------------------------
1307
1308Contrail 3.2 contains internal IF-MAP server implementation. This implementation can be enabled
1309by setting ``config:ifmap:engine`` to internal. Currently supported engines are ``internal`` and
1310``irond`` (default). The ``internal`` will configure contrail-api to run as a IF-MAP server in the
1311same process as contrail-api and will generate security certificates in specified folder.
1312
1313.. code-block:: yaml
1314
1315 config:
1316 ....
1317 ifmap:
1318 engine: internal
1319 cert_dir: /etc/contrail/ssl/certs/ # default
1320 basename_cert: ifmap.crt # default
1321 basename_key: ifmap.key # default
1322 ....
1323
1324To set static configuration of the IF-MAP server for contrail-control instead of using
1325discovery service, you can use ``control:ifmap:bind:host`` and ``port``. The static configuration
1326is triggered by existence of non-empty value of ``control:ifmap:bind`` key.
1327
1328.. code-block:: yaml
1329 control:
1330 ....
1331 ifmap
1332 bind:
1333 host: 127.0.0.1
1334 port: 8443
1335 ....
1336
Jan Cach2f99ae82018-10-03 19:50:09 +02001337Configure TCP_TW_RECYCLE in kernel
1338------------------------------------
Petr Jediný04bed9b2018-05-03 19:44:10 +02001339
Jan Cach2f99ae82018-10-03 19:50:09 +02001340Enable fast recycling of TIME-WAIT sockets. To enable set parameter to 1, which is
1341default value in formula. To turn off this option set parameter to 0:
1342
1343.. code-block:: yaml
1344
1345 opencontrail:
1346 ....
1347 common
1348 ....
1349 tcp_tw_recycle: 0
1350 ....
Michel Nederloff5bccda2017-11-20 13:31:38 +01001351
Filip Pytloun27930402015-10-06 16:28:32 +02001352Usage
1353=====
1354
1355Basic installation
Ales Komarekad46d2e2017-03-09 17:16:38 +01001356------------------
Filip Pytloun27930402015-10-06 16:28:32 +02001357
1358Add control BGP
Ales Komarekad46d2e2017-03-09 17:16:38 +01001359
1360.. code-block:: bash
Filip Pytloun27930402015-10-06 16:28:32 +02001361
1362 python /etc/contrail/provision_control.py --api_server_ip 192.168.1.11 --api_server_port 8082 --host_name network1.contrail.domain.com --host_ip 192.168.1.11 --router_asn 64512
1363
Ales Komarekad46d2e2017-03-09 17:16:38 +01001364Install compute node
Filip Pytloun27930402015-10-06 16:28:32 +02001365
Ales Komarekad46d2e2017-03-09 17:16:38 +01001366.. code-block:: bash
Filip Pytloun27930402015-10-06 16:28:32 +02001367
1368 yum install contrail-vrouter contrail-openstack-vrouter
1369
1370 salt-call state.sls nova,opencontrail
1371
1372Add virtual router
Filip Pytloun27930402015-10-06 16:28:32 +02001373
Ales Komarekad46d2e2017-03-09 17:16:38 +01001374.. code-block:: bash
Filip Pytloun27930402015-10-06 16:28:32 +02001375
1376 python /etc/contrail/provision_vrouter.py --host_name hostnode1.intra.domain.com --host_ip 10.0.100.101 --api_server_ip 10.0.100.30 --oper add --admin_user admin --admin_password cloudlab --admin_tenant_name admin
1377
1378 /etc/sysconfig/network-scripts/ifcfg-bond0 -- comment GATEWAY,NETMASK,IPADDR
1379
1380 reboot
1381
Aleš Komáreka3314b22017-04-11 13:46:06 +02001382Debugging
1383---------
Filip Pytloun27930402015-10-06 16:28:32 +02001384
1385Display vhost XMPP connection status
1386
1387You should see the correct controller_ip and state should be established.
1388
1389 http://<compute-node>:8085/Snh_AgentXmppConnectionStatusReq?
1390
1391Display vrouter interface status
1392
1393When vrf_name = ---ERROR--- then something goes wrong
1394
1395 http://<compute-node>:8085/Snh_ItfReq?name=
1396
1397Display IF MAP table
1398
Vasyl Saienkob10b7202017-09-05 14:19:03 +03001399Look for neighbours, if VM has 2, it's ok
Filip Pytloun27930402015-10-06 16:28:32 +02001400
1401 http://<control-node>:8083/Snh_IFMapTableShowReq?table_name=
1402
1403Trace XMPP requests
1404
1405 http://<compute-node>:8085/Snh_SandeshTraceRequest?x=XmppMessageTrace
1406
Filip Pytlounf6b79d42017-02-02 13:02:03 +01001407
1408Documentation and Bugs
1409======================
1410
1411To learn how to install and update salt-formulas, consult the documentation
1412available online at:
1413
1414 http://salt-formulas.readthedocs.io/
1415
1416In the unfortunate event that bugs are discovered, they should be reported to
1417the appropriate issue tracker. Use Github issue tracker for specific salt
1418formula:
1419
1420 https://github.com/salt-formulas/salt-formula-opencontrail/issues
1421
1422For feature requests, bug reports or blueprints affecting entire ecosystem,
1423use Launchpad salt-formulas project:
1424
1425 https://launchpad.net/salt-formulas
1426
1427You can also join salt-formulas-users team and subscribe to mailing list:
1428
1429 https://launchpad.net/~salt-formulas-users
1430
1431Developers wishing to work on the salt-formulas projects should always base
1432their work on master branch and submit pull request against specific formula.
1433
1434 https://github.com/salt-formulas/salt-formula-opencontrail
1435
1436Any questions or feedback is always welcome so feel free to join our IRC
1437channel:
1438
1439 #salt-formulas @ irc.freenode.net