blob: e285e13502e5aadb3bd634cc91d0b8f04989687e [file] [log] [blame]
Aleš Komáreka3314b22017-04-11 13:46:06 +02001====================
2OpenContrail Formula
3====================
Filip Pytloun27930402015-10-06 16:28:32 +02004
Jakub Pavlik01fe5372016-05-20 11:23:28 +02005Contrail Controller is an open, standards-based software solution that
6delivers network virtualization and service automation for federated cloud
7networks. It provides self-service provisioning, improves network
8troubleshooting and diagnostics, and enables service chaining for dynamic
9application environments across enterprise virtual private cloud (VPC),
10managed Infrastructure as a Service (IaaS), and Networks Functions
11Virtualization (NFV) use cases.
Filip Pytloun27930402015-10-06 16:28:32 +020012
Jiri Konecny463dee52016-03-03 11:08:46 +010013
Petr Michalec579e64d2017-03-24 12:54:29 +010014Package source
15==============
Aleš Komáreka3314b22017-04-11 13:46:06 +020016
Petr Michalec579e64d2017-03-24 12:54:29 +010017Formula support OpenContrail as well as Juniper Contrail package repository in the backend.
18
19Differences withing the configuration and state run are controlled by
20``opencontrail.common.vendor: [opencontrail|juniper]`` pillar attribute.
21
22Default value is set to ``opencontrail``.
23
24Juniper releases tested with this formula:
25 - 3.0.2.x
26
27To use Juniper Contrail repository as a source of packages override pillar as in this example:
28
29.. code-block:: yaml
30
31 opencontrail:
32 common:
33 vendor: juniper
34
35
Aleš Komáreka3314b22017-04-11 13:46:06 +020036Sample Pillars
Filip Pytloun27930402015-10-06 16:28:32 +020037==============
38
Jiri Konecny463dee52016-03-03 11:08:46 +010039Controller nodes
40----------------
41
42There are several scenarios for OpenContrail control plane.
43
44All-in-one single
45~~~~~~~~~~~~~~~~~
46
47Config, control, analytics, database, web -- altogether on one node.
48
49.. code-block:: yaml
50
51 opencontrail:
52 common:
53 version: 2.2
54 source:
55 engine: pkg
56 address: http://mirror.robotice.cz/contrail-havana/
57 identity:
58 engine: keystone
59 host: 127.0.0.1
60 port: 35357
61 token: token
62 password: password
63 network:
64 engine: neutron
65 host: 127.0.0.1
66 port: 9696
67 config:
68 version: 2.2
69 enabled: true
70 network:
71 engine: neutron
72 host: 127.0.0.1
73 port: 9696
74 discovery:
75 host: 127.0.0.1
76 analytics:
77 host: 127.0.0.1
78 bind:
79 address: 127.0.0.1
80 message_queue:
81 engine: rabbitmq
82 host: 127.0.0.1
83 port: 5672
84 database:
85 members:
86 - host: 127.0.0.1
87 port: 9160
88 cache:
Jakub Pavlikd1a059e2016-07-13 23:08:33 +020089 members:
90 - host: 127.0.0.1
91 port: 11211
Jiri Konecny463dee52016-03-03 11:08:46 +010092 identity:
93 engine: keystone
94 version: '2.0'
95 region: RegionOne
96 host: 127.0.0.1
97 port: 35357
98 user: admin
99 password: password
100 token: token
101 tenant: admin
102 members:
103 - host: 127.0.0.1
104 id: 1
Dmitry Stremkovskiy841fee32017-09-01 18:08:41 +0300105 rootlogger: "INFO, CONSOLE"
Jiri Konecny463dee52016-03-03 11:08:46 +0100106 control:
107 version: 2.2
108 enabled: true
109 bind:
110 address: 127.0.0.1
111 discovery:
112 host: 127.0.0.1
113 master:
114 host: 127.0.0.1
115 members:
116 - host: 127.0.0.1
117 id: 1
118 collector:
119 version: 2.2
120 enabled: true
121 bind:
122 address: 127.0.0.1
123 master:
124 host: 127.0.0.1
125 discovery:
126 host: 127.0.0.1
127 data_ttl: 2
128 database:
129 members:
130 - host: 127.0.0.1
131 port: 9160
Sergey Kreysfd017c12018-05-04 18:35:37 +0300132 message_queue:
133 members:
134 - host: 127.0.0.1
135 - host: 127.0.0.1
136 - host: 127.0.0.1
Jiri Konecny463dee52016-03-03 11:08:46 +0100137 database:
138 version: 2.2
139 cassandra:
140 version: 2
141 enabled: true
142 minimum_disk: 10
143 name: 'Contrail'
144 original_token: 0
Dmitry Stremkovskiy2a079c72017-07-12 23:11:18 +0300145 compaction_throughput_mb_per_sec: 16
Dmitry Stremkovskiy71b310a2017-08-11 20:39:11 +0300146 concurrent_compactors: 1
Jiri Konecny463dee52016-03-03 11:08:46 +0100147 data_dirs:
148 - /var/lib/cassandra
149 id: 1
150 discovery:
151 host: 127.0.0.1
152 bind:
153 host: 127.0.0.1
154 port: 9042
155 rpc_port: 9160
156 members:
157 - host: 127.0.0.1
158 id: 1
159 web:
160 version: 2.2
161 enabled: True
162 bind:
163 address: 127.0.0.1
164 analytics:
165 host: 127.0.0.1
166 master:
167 host: 127.0.0.1
168 cache:
169 engine: redis
170 host: 127.0.0.1
171 port: 6379
172 members:
173 - host: 127.0.0.1
174 id: 1
175 identity:
176 engine: keystone
177 version: '2.0'
178 host: 127.0.0.1
179 port: 35357
180 user: admin
181 password: password
182 token: token
183 tenant: admin
184
185
186All-in-one cluster
187~~~~~~~~~~~~~~~~~~
188
Jakub Pavlik01fe5372016-05-20 11:23:28 +0200189Config, control, analytics, database, web -- altogether, clustered on multiple
190nodes.
Jiri Konecny463dee52016-03-03 11:08:46 +0100191
192.. code-block:: yaml
193
194 opencontrail:
195 common:
196 version: 2.2
197 source:
198 engine: pkg
199 address: http://mirror.robotice.cz/contrail-havana/
200 identity:
201 engine: keystone
202 host: 127.0.0.1
203 port: 35357
204 token: token
205 password: password
206 network:
207 engine: neutron
208 host: 127.0.0.1
209 port: 9696
210 config:
211 version: 2.2
212 enabled: true
213 network:
214 engine: neutron
215 host: 127.0.0.1
216 port: 9696
217 discovery:
218 host: 127.0.0.1
219 analytics:
220 host: 127.0.0.1
221 bind:
222 address: 127.0.0.1
223 message_queue:
224 engine: rabbitmq
225 host: 127.0.0.1
226 port: 5672
227 database:
228 members:
229 - host: 127.0.0.1
230 port: 9160
231 - host: 127.0.0.1
232 port: 9160
233 - host: 127.0.0.1
234 port: 9160
235 cache:
Jakub Pavlikd1a059e2016-07-13 23:08:33 +0200236 members:
237 - host: 127.0.0.1
238 port: 11211
239 - host: 127.0.0.1
240 port: 11211
241 - host: 127.0.0.1
242 port: 11211
Jiri Konecny463dee52016-03-03 11:08:46 +0100243 identity:
244 engine: keystone
245 version: '2.0'
246 region: RegionOne
247 host: 127.0.0.1
248 port: 35357
249 user: admin
250 password: password
251 token: token
252 tenant: admin
253 members:
254 - host: 127.0.0.1
255 id: 1
256 - host: 127.0.0.1
257 id: 2
258 - host: 127.0.0.1
259 id: 3
260 control:
261 version: 2.2
262 enabled: true
263 bind:
264 address: 127.0.0.1
265 discovery:
266 host: 127.0.0.1
267 master:
268 host: 127.0.0.1
269 members:
270 - host: 127.0.0.1
271 id: 1
272 - host: 127.0.0.1
273 id: 2
274 - host: 127.0.0.1
275 id: 3
276 collector:
277 version: 2.2
278 enabled: true
279 bind:
280 address: 127.0.0.1
281 master:
282 host: 127.0.0.1
283 discovery:
284 host: 127.0.0.1
285 data_ttl: 1
286 database:
287 members:
288 - host: 127.0.0.1
289 port: 9160
290 - host: 127.0.0.1
291 port: 9160
292 - host: 127.0.0.1
293 port: 9160
Sergey Kreysfd017c12018-05-04 18:35:37 +0300294 message_queue:
295 members:
296 - host: 127.0.0.1
297 - host: 127.0.0.1
298 - host: 127.0.0.1
Jiri Konecny463dee52016-03-03 11:08:46 +0100299 database:
300 version: 2.2
301 cassandra:
302 version: 2
303 enabled: true
304 name: 'Contrail'
305 minimum_disk: 10
306 original_token: 0
307 data_dirs:
308 - /var/lib/cassandra
309 id: 1
310 discovery:
311 host: 127.0.0.1
312 bind:
313 host: 127.0.0.1
314 port: 9042
315 rpc_port: 9160
316 members:
317 - host: 127.0.0.1
318 id: 1
319 - host: 127.0.0.1
320 id: 2
321 - host: 127.0.0.1
322 id: 3
323 web:
324 version: 2.2
325 enabled: True
326 bind:
327 address: 127.0.0.1
328 master:
329 host: 127.0.0.1
330 analytics:
331 host: 127.0.0.1
332 cache:
333 engine: redis
334 host: 127.0.0.1
335 port: 6379
336 members:
337 - host: 127.0.0.1
338 id: 1
339 - host: 127.0.0.1
340 id: 2
341 - host: 127.0.0.1
342 id: 3
343 identity:
344 engine: keystone
345 version: '2.0'
346 host: 127.0.0.1
347 port: 35357
348 user: admin
349 password: password
350 token: token
351 tenant: admin
352
353
354Separated analytics from control and config
355~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
356
357Config, control, database, web.
358
359.. code-block:: yaml
360
361 opencontrail:
362 common:
363 version: 2.2
364 identity:
365 engine: keystone
366 host: 127.0.0.1
367 port: 35357
368 token: token
369 password: password
370 network:
371 engine: neutron
372 host: 127.0.0.1
373 port: 9696
374 config:
375 version: 2.2
376 enabled: true
377 network:
378 engine: neutron
379 host: 127.0.0.1
380 port: 9696
381 discovery:
382 host: 127.0.0.1
383 analytics:
384 host: 127.0.0.1
385 bind:
386 address: 127.0.0.1
387 message_queue:
388 engine: rabbitmq
389 host: 127.0.0.1
390 port: 5672
391 database:
392 members:
393 - host: 127.0.0.1
394 port: 9160
395 - host: 127.0.0.1
396 port: 9160
397 - host: 127.0.0.1
398 port: 9160
399 cache:
Jakub Pavlikd1a059e2016-07-13 23:08:33 +0200400 members:
401 - host: 127.0.0.1
402 port: 11211
403 - host: 127.0.0.1
404 port: 11211
405 - host: 127.0.0.1
406 port: 11211
Jiri Konecny463dee52016-03-03 11:08:46 +0100407 identity:
408 engine: keystone
409 version: '2.0'
410 region: RegionOne
411 host: 127.0.0.1
412 port: 35357
413 user: admin
414 password: password
415 token: token
416 tenant: admin
417 members:
418 - host: 127.0.0.1
419 id: 1
420 - host: 127.0.0.1
421 id: 2
422 - host: 127.0.0.1
423 id: 3
424 control:
425 version: 2.2
426 enabled: true
427 bind:
428 address: 127.0.0.1
429 discovery:
430 host: 127.0.0.1
431 master:
432 host: 127.0.0.1
433 members:
434 - host: 127.0.0.1
435 id: 1
436 - host: 127.0.0.1
437 id: 2
438 - host: 127.0.0.1
439 id: 3
440 database:
441 version: 127.0.0.1
442 cassandra:
443 version: 2
444 enabled: true
445 name: 'Contrail'
446 minimum_disk: 10
447 original_token: 0
448 data_dirs:
449 - /var/lib/cassandra
450 id: 1
451 discovery:
452 host: 127.0.0.1
453 bind:
454 host: 127.0.0.1
455 port: 9042
456 rpc_port: 9160
457 members:
458 - host: 127.0.0.1
459 id: 1
460 - host: 127.0.0.1
461 id: 2
462 - host: 127.0.0.1
463 id: 3
464 web:
465 version: 2.2
466 enabled: True
467 bind:
468 address: 127.0.0.1
469 analytics:
470 host: 127.0.0.1
471 master:
472 host: 127.0.0.1
473 cache:
474 engine: redis
475 host: 127.0.0.1
476 port: 6379
477 members:
478 - host: 127.0.0.1
479 id: 1
480 - host: 127.0.0.1
481 id: 2
482 - host: 127.0.0.1
483 id: 3
484 identity:
485 engine: keystone
486 version: '2.0'
487 host: 127.0.0.1
488 port: 35357
489 user: admin
490 password: password
491 token: token
492 tenant: admin
493
Jiri Konecny463dee52016-03-03 11:08:46 +0100494Analytic nodes
Jiri Konecny463dee52016-03-03 11:08:46 +0100495
496Analytics and database on an analytic node(s)
497
498.. code-block:: yaml
499
500 opencontrail:
501 common:
502 version: 2.2
503 identity:
504 engine: keystone
505 host: 127.0.0.1
506 port: 35357
507 token: token
508 password: password
509 network:
510 engine: neutron
511 host: 127.0.0.1
512 port: 9696
513 collector:
514 version: 2.2
515 enabled: true
516 bind:
517 address: 127.0.0.1
518 master:
519 host: 127.0.0.1
520 discovery:
521 host: 127.0.0.1
522 data_ttl: 1
523 database:
524 members:
525 - host: 127.0.0.1
526 port: 9160
527 - host: 127.0.0.1
528 port: 9160
529 - host: 127.0.0.1
530 port: 9160
Sergey Kreysfd017c12018-05-04 18:35:37 +0300531 message_queue:
532 members:
533 - host: 127.0.0.1
534 - host: 127.0.0.1
535 - host: 127.0.0.1
Jiri Konecny463dee52016-03-03 11:08:46 +0100536 database:
537 version: 2.2
538 cassandra:
539 version: 2
540 enabled: true
541 name: 'Contrail'
542 minimum_disk: 10
543 original_token: 0
544 data_dirs:
545 - /var/lib/cassandra
546 id: 1
547 discovery:
548 host: 127.0.0.1
549 bind:
550 host: 127.0.0.1
551 port: 9042
552 rpc_port: 9160
553 members:
554 - host: 127.0.0.1
555 id: 1
556 - host: 127.0.0.1
557 id: 2
558 - host: 127.0.0.1
559 id: 3
560
561
562Compute nodes
Aleš Komáreka3314b22017-04-11 13:46:06 +0200563-------------
Jiri Konecny463dee52016-03-03 11:08:46 +0100564
565Vrouter configuration on a compute node(s)
566
567.. code-block:: yaml
568
569 opencontrail:
570 common:
571 version: 2.2
572 identity:
573 engine: keystone
574 host: 127.0.0.1
575 port: 35357
576 token: token
577 password: password
578 network:
579 engine: neutron
580 host: 127.0.0.1
581 port: 9696
582 compute:
583 version: 2.2
584 enabled: True
Dmitry Stremkovskiy0cb5c562017-07-26 00:32:51 +0300585 hostname: node-12.domain.tld
Danysa144f292018-06-26 16:08:50 +0200586 flow_hold_limit: 0
Jiri Konecny463dee52016-03-03 11:08:46 +0100587 discovery:
588 host: 127.0.0.1
589 interface:
590 address: 127.0.0.1
591 dev: eth0
592 gateway: 127.0.0.1
593 mask: /24
594 dns: 127.0.0.1
595 mtu: 9000
596
Petr Jediný5f3008a2017-07-31 15:04:05 +0200597
598Compute nodes with gateway_mode
599-------------------------------
600
601Gateway mode: can be server/ vcpe (default is none)
602
603.. code-block:: yaml
604
605 opencontrail:
606 compute:
607 gateway_mode: server
608
Vasyl Saienkob10b7202017-09-05 14:19:03 +0300609TSN nodes
610---------
611
612Configure TSN nodes
613
614.. code-block:: yaml
615
616 opencontrail:
617 compute:
618 enabled: true
619 tor:
620 enabled: true
621 bind:
622 port: 8086
623 agent:
624 tor01:
625 id: 0
626 port: 6632
627 host: 127.0.0.1
628 address: 127.0.0.1
629
Petr Jediný5f3008a2017-07-31 15:04:05 +0200630
Andreyeff77ac2017-08-25 12:14:06 -0500631Set up metadata secret for the Vrouter
Petr Jedinýfe51c6a2017-09-05 18:30:31 +0200632--------------------------------------
Andreyeff77ac2017-08-25 12:14:06 -0500633
Petr Jedinýfe51c6a2017-09-05 18:30:31 +0200634In order to get cloud-init within the instance to properly fetch
Andreyeff77ac2017-08-25 12:14:06 -0500635instance metadata, metadata_proxy_secret in the Vrouter agent config
636should match the value in nova.conf. The administrator should define
637it in the pillar:
638
639.. code-block:: yaml
640
641 opencontrail:
642 compute:
643 metadata:
644 secret: opencontrail
645
Petr Jedinýfe51c6a2017-09-05 18:30:31 +0200646Add auth info for Barbican on compute nodes
647-------------------------------------------
648
649.. code-block:: yaml
650
651 opencontrail:
652 compute:
653 lbaas:
654 enabled: true
655 secret_manager:
656 engine: barbican
657 identity:
658 user: admin
659 password: "supersecretpassword123"
660 tenant: admin
661
662
Jakub Pavlik735005f2016-02-26 15:54:53 +0100663Keystone v3
Aleš Komáreka3314b22017-04-11 13:46:06 +0200664-----------
Jakub Pavlik735005f2016-02-26 15:54:53 +0100665
Jakub Pavlik01fe5372016-05-20 11:23:28 +0200666To enable support for keystone v3 in opencontrail, there must be defined
667version for config and web role.
Jakub Pavlik735005f2016-02-26 15:54:53 +0100668
669.. code-block:: yaml
670
671 opencontrail:
672 config:
673 version: 2.2
674 enabled: true
675 ...
676 identity:
677 engine: keystone
678 version: '3'
679 ...
680
681 opencontrail:
682 web:
683 version: 2.2
684 enabled: true
685 ...
686 identity:
687 engine: keystone
688 version: '3'
689 ...
690
marco10cc2212016-04-03 14:21:54 +0200691Without Keystone
692----------------
693
694.. code-block:: yaml
695
696 opencontrail:
697 ...
698 common:
699 ...
700 identity:
701 engine: none
702 token: none
703 password: none
704 ...
705 config:
706 ...
707 identity:
708 engine: none
709 password: none
710 token: none
711 ...
712 web:
713 ...
714 identity:
715 engine: none
716 password: none
717 token: none
718 ...
marcof5461712016-04-04 20:49:36 +0200719
Aleš Komáreka3314b22017-04-11 13:46:06 +0200720Kubernetes support
721------------------
722
marcof5461712016-04-04 20:49:36 +0200723Kubernetes vrouter nodes
marcof5461712016-04-04 20:49:36 +0200724
725Vrouter configuration on a kubernetes node(s)
726
727.. code-block:: yaml
728
729 opencontrail:
730 ...
731 compute:
732 engine: kubernetes
733 ...
734
Jakub Pavlik0d1f67e2016-11-30 10:04:13 +0100735vRouter with separated control plane
Jakub Pavlik0d1f67e2016-11-30 10:04:13 +0100736
737Separate XMPP traffic from dataplane interface.
738
739.. code-block:: yaml
740
741 opencontrail:
742 compute:
743 bind:
744 address: 172.16.0.50
745 ...
746
Petr Jediný439fab32017-07-10 14:33:09 +0200747Override RPF default in Contrail API
748------------------------------------
749
750From MCP1.1 with OpenContrail >= 3.1.1 you can override RPF default for newly
751created virtual networks. This can be useful for usecases like running
752Calico and K8S in overlay. The `override_rpf_default_by` has valid values
753`disable`, `enable`. If not defined, the configuration fallbacks to Contrail
754default - currently `enable`.
755
756.. code-block:: yaml
757
758 opencontrail:
759 ...
760 config:
761 override_rpf_default_by: 'disable'
762 ...
763
Petr Jediný01c18822017-11-15 12:30:53 +0100764Cassandra GC logging
765--------------------
766
767From Contrail version 3 you can set a way you want to handle Cassandra GC logs.
768The behavior is controlled by `cassandra_gc_logging`. Valid values are
769'rotation' (default), 'legacy' and false.
770
771- 'rotation' is supported by JDK 6u34 7u2 or later and handles rotation of log
772files automatically.
773- 'legacy' is a way to support older JDKs and you will need to handle logs by
774other means. This can be handled for example by using
775`- service.opencontrail.database.cassandra_log_cleanup` in your reclass model.
776- false will disable the cassandra gc logging
777
778.. code-block:: yaml
779
780 opencontrail:
781 ...
782 database:
783 cassandra_gc_logging: false
784 ...
785
Petr Jediný439fab32017-07-10 14:33:09 +0200786
Jakub Pavlik6d90f362016-04-19 20:34:37 +0200787Disable Contrail API authentication
788-----------------------------------
789
Petr Jediný78e6f422017-06-01 13:24:49 +0200790Contrail version must >= 3.0. It is useful especially for Keystone v3.
Jakub Pavlik6d90f362016-04-19 20:34:37 +0200791
792.. code-block:: yaml
793
794 opencontrail:
795 ...
796 config:
797 multi_tenancy: false
798 ...
799
Marek Celoudae98c642018-01-31 12:43:42 +0100800Enable RBAC
801-----------
802
803
804.. code-block:: yaml
805
806 opencontrail:
807 ...
808 config:
809 aaa_mode: rbac
810 cloud_admin_role: admin
811 global_read_only_role: member
812 ...
813
Petr Jediný78e6f422017-06-01 13:24:49 +0200814Switch from on demand to periodic keystone sync
815-----------------------------------------------
816
817This can be useful when you want to sync projects from OpenStack to Contrail
818automatically. The period of sync is 60s.
819
820.. code-block:: yaml
821
822 opencontrail:
823 ...
824 config:
825 identity:
826 sync_on_demand: false
827 ...
828
Petr Jediný03027902018-07-17 20:32:52 +0200829Cassandra listen configuration
830------------------------------
831
832Interface example:
marco2502e052016-05-31 22:53:54 +0200833
834.. code-block:: yaml
Vasyl Saienkob10b7202017-09-05 14:19:03 +0300835
marco2502e052016-05-31 22:53:54 +0200836 database:
837 ....
838 bind:
839 interface: eth0
840 port: 9042
841 rpc_port: 9160
842 ....
Jakub Pavlik6d90f362016-04-19 20:34:37 +0200843
Petr Jediný03027902018-07-17 20:32:52 +0200844For running config and analytics db clusters on same hosts, you will need to
845change ports not to collide. The host is required.
846
847 database:
848 ....
849 bind:
850 host: 127.0.0.1
851 port: 9042
852 rpc_port: 9160
853 # for containers we need to move configdb to neighbouring ports
854 port_configdb: 9041
855 rpc_port_configdb: 9161
856 ....
857
858
Petr Jedinýffbe2082017-03-07 00:56:47 +0100859OpenContrail WebUI version >= 3.1.1
860-----------------------------------
Petr Jediný78e6f422017-06-01 13:24:49 +0200861For OpenContrail version >= 3.1.1 and Cassandra >= 2.1 we should override WebUI's cassandra port from 9160 to 9042.
Petr Jedinýffbe2082017-03-07 00:56:47 +0100862
863For appropriate node at class level:
864
865.. code-block:: yaml
Aleš Komáreka3314b22017-04-11 13:46:06 +0200866
Petr Jedinýffbe2082017-03-07 00:56:47 +0100867 opencontrail:
868 ....
869 web:
870 database:
871 port: 9042
872 ....
873
874
Jakub Pavlik9a4de012016-12-14 13:23:55 +0100875RabbitMQ HA hosts
876------------------
877
878.. code-block:: yaml
879
880 opencontrail:
881 config:
882 message_queue:
883 engine: rabbitmq
884 members:
885 - host: 10.0.16.1
886 - host: 10.0.16.2
887 - host: 10.0.16.3
888 port: 5672
889
890.. code-block:: yaml
891
892 database:
893 ....
894 bind:
895 interface: eth0
896 port: 9042
897 rpc_port: 9160
898 ....
899
Jakub Pavlike3590062017-02-20 23:32:57 +0100900DPDK vRouter
901-------------
902
903.. code-block:: yaml
904
905 opencontrail:
906 compute:
907 dpdk:
908 enabled: true
Jakub Pavlik54761d82017-03-08 11:22:37 +0100909 taskset: "0x0000003C00003C"
910 socket_mem: "1024,1024"
Jakub Pavlike3590062017-02-20 23:32:57 +0100911 interface:
912 mac_address: 90:e2:ba:7c:22:e1
913 pci: 0000:81:00.1
914 ...
915
Petr Jedinýe9960762018-05-04 17:36:59 +0200916Increase number of contrail-api workers
917---------------------------------------
918
919.. code-block:: yaml
920
921 opencontrail:
922 ...
923 config:
924 api_workers: 3
925 ...
926
Marek Celouddbba7ed2017-12-07 10:36:24 +0100927Increase number of alarm-gen workers
928------------------------------------
929
930Port prefix will increment used ports by workers starting with 5901.
931
932.. code-block:: yaml
933
934 collector:
935 alarm_gen:
936 workers: 1
937 port_prefix: 59
938
Ales Komarekad46d2e2017-03-09 17:16:38 +0100939Contrail client
940---------------
941
942Basic parameters with identity and host configs
943
Petr Jediný78e6f422017-06-01 13:24:49 +0200944.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +0100945
946 opencontrail:
947 client:
948 identity:
949 user: admin
950 project: admin
951 password: adminpass
952 host: keystone_host
953 config:
954 host: contrail_api_host
955 port: contrail_api_ort
956
957Enforcing virtual routers
958
Petr Jediný78e6f422017-06-01 13:24:49 +0200959.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +0100960
961 opencontrail:
962 client:
963 ...
964 virtual_router:
965 cmp01:
966 ip_address: 172.16.0.11
967 dpdk_enabled: True
968 cmp02:
969 ip_address: 172.16.0.12
970 dpdk_enabled: True
971
psvimbersky3c84e272018-01-02 10:34:29 +0100972
973Enforcing global system config
974
975.. code-block:: yaml
976
977 opencontrail:
978 client:
979 ...
980 global_system_config:
981 name: default-global-system-config
982 asn: 64512
983 grp:
984 enable: true
985 restart_time: 60
986 end_of_rib_timeout: 30
987 bgp_helper_enable: false
988 xmpp_helper_enable: false
989 long_lived_restart_time: 300
990
991
Pavel Svimbersky13cda442017-09-14 14:46:13 +0200992Enforcing global vrouter config
993
994.. code-block:: yaml
995
996 opencontrail:
997 client:
998 ...
999 global_vrouter_config:
Petr Jediný554d0412018-01-04 22:35:48 +01001000 name: default-global-vrouter-config
Pavel Svimbersky13cda442017-09-14 14:46:13 +02001001 parent_type: global-system-config
1002 encap_priority: "MPLSoUDP,MPLSoGRE"
1003 vxlan_vn_id_mode: automatic
1004 fq_names:
1005 - 'default-global-system-config'
1006 - 'default-global-vrouter-config'
1007
psvimbersky3c84e272018-01-02 10:34:29 +01001008
1009
Ales Komarekad46d2e2017-03-09 17:16:38 +01001010Enforcing control nodes
1011
Petr Jediný78e6f422017-06-01 13:24:49 +02001012.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +01001013
1014 opencontrail:
1015 client:
1016 ...
1017 bgp_router:
1018 ntw01:
1019 type: control-node
1020 ip_address: 172.16.0.11
1021 nwt02:
1022 type: control-node
1023 ip_address: 172.16.0.12
1024 nwt03:
1025 type: control-node
1026 ip_address: 172.16.0.13
1027
1028
1029Enforcing edge BGP routers
1030
Petr Jediný78e6f422017-06-01 13:24:49 +02001031.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +01001032
1033 opencontrail:
1034 client:
1035 ...
1036 bgp_router:
1037 mx01:
1038 type: router
1039 ip_address: 172.16.0.21
1040 asn: 64512
1041 mx02:
1042 type: router
1043 ip_address: 172.16.0.22
1044 asn: 64512
Marek Celoud3097e5b2018-01-09 13:52:14 +01001045 key_type: md5
1046 key: password
Ales Komarekad46d2e2017-03-09 17:16:38 +01001047
1048Enforcing config nodes
1049
Petr Jediný78e6f422017-06-01 13:24:49 +02001050.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +01001051
1052 opencontrail:
1053 client:
1054 ...
1055 config_node:
1056 ctl01:
1057 ip_address: 172.16.0.21
1058 ctl02:
1059 ip_address: 172.16.0.22
1060
1061Enforcing database nodes
1062
Petr Jediný78e6f422017-06-01 13:24:49 +02001063.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +01001064
1065 opencontrail:
1066 client:
1067 ...
1068 database_node:
1069 ntw01:
1070 ip_address: 172.16.0.21
1071 ntw02:
1072 ip_address: 172.16.0.22
1073
1074Enforcing analytics nodes
1075
Petr Jediný78e6f422017-06-01 13:24:49 +02001076.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +01001077
1078 opencontrail:
1079 client:
1080 ...
1081 analytics_node:
1082 nal01:
1083 ip_address: 172.16.0.31
1084 nal02:
1085 ip_address: 172.16.0.32
1086
Petr Jediný5f3efe32017-05-26 17:55:09 +02001087Enforcing Link Local Services
1088
1089.. code-block:: yaml
1090
1091 opencontrail:
1092 client:
1093 ...
1094 linklocal_service:
1095 # example with dns name address (only one permited)
1096 meta1:
1097 lls_ip: 10.0.0.23
1098 lls_port: 80
1099 ipf_addresses: "meta.example.com"
1100 ipf_port: 80
1101 # example with multiple ip addresses
1102 meta2:
1103 lls_ip: 10.0.0.23
1104 lls_port: 80
1105 ipf_addresses:
1106 - 10.10.10.10
1107 - 10.20.20.20
1108 - 10.30.30.30
1109 ipf_port: 80
1110 # example with one ip address
1111 meta3:
1112 lls_ip: 10.0.0.23
1113 lls_port: 80
1114 ipf_addresses:
1115 - 10.10.10.10
1116 ipf_port: 80
1117 # example with name override
1118 lls_meta4:
1119 name: meta4
1120 lls_ip: 10.0.0.23
1121 lls_port: 80
1122 ipf_addresses:
1123 - 10.10.10.10
1124 ipf_port: 80
1125
Vasyl Saienkob10b7202017-09-05 14:19:03 +03001126
Michel Nederloff5bccda2017-11-20 13:31:38 +01001127Configuring OpenStack default quotasx
1128
1129.. code-block:: yaml
1130 config:
1131 quota:
1132 network: 5
1133 subnet: 10
1134 router: 10
1135 floating_ip: 100
1136 secgroup: 1000
1137 secgroup_rule: 1000
1138 port: 1000
1139 pool: -1
1140 member: -1
1141 health_monitor: -1
1142 vip: -1
1143
1144Enforcing physical routers
Petr Jediný04bed9b2018-05-03 19:44:10 +02001145
Vasyl Saienkob10b7202017-09-05 14:19:03 +03001146.. code-block:: yaml
1147
1148 opencontrail:
1149 client:
1150 ...
1151 physical_router:
1152 router1:
1153 name: router1
1154 dataplane_ip: 1.2.3.4
1155 management_ip: 1.2.3.4
1156 vendor_name: ovs
1157 product_name: ovs
1158 agents:
1159 - tsn0-0
1160 - tsn0
1161
1162Enforcing physical/logical interfaces for routers
1163
1164
1165.. code-block:: yaml
1166
1167 opencontrail
1168 client:
1169 ...
1170 physical_router:
1171 router1:
1172 ...
1173 interface:
1174 port1:
1175 name: port1
1176 logical_interface:
1177 port1_l:
1178 name: 'port1.0'
1179 vlan_tag: 0
1180 interface_type: L2
1181 virtual_machine_interface:
1182 port1_port:
1183 name: port1_port
1184 ip_address: 192.168.90.107
1185 mac_address: '2e:92:a8:af:c2:21'
1186 security_group: 'default'
1187 virtual_network: 'virtual-network'
1188
Jan Cachebfed1c2018-01-09 17:21:35 +01001189Enforcing virtual networks
1190
1191
1192.. code-block:: yaml
1193
1194 opencontrail:
1195 client:
1196 virtual_networks:
1197 net01:
1198 name: 'network01'
1199 ip_address: '172.16.111.0'
1200 ip_prefix: 24
1201 asn: 64512
1202 route_target: 10000
1203 external: True
1204 allow_transit: False
1205 forwarding_mode: 'l2_l3'
1206 rpf: 'disable'
1207 mirror_destination: False
1208 domain: 'default-domain'
1209 project: 'admin'
1210 ipam_domain: 'default-domain'
1211 ipam_project: 'default-project'
1212 ipam_name: 'default-network-ipam'
1213 net02:
1214 name: 'network02'
1215 net03:
1216 name: 'network03'
1217
Ales Komarekad46d2e2017-03-09 17:16:38 +01001218
Jan Cachb3092722018-01-31 12:46:16 +01001219Enforcing floating ip pool setings.
1220
1221Virtual network with flag external needs to be created before managing the floating ip pool.
1222Param vn_name is the name of the external network.
1223
1224.. code-block:: yaml
1225
1226 opencontrail:
1227 client:
1228 floating_ip_pools:
1229 pool1:
1230 vn_name: external-network
1231 vn_project: admin
1232 vn_domain: default-domain
1233 owner_access: 7
1234 global_access: 0
1235 list_of_projects:
1236 - [tenant1, 7]
1237 - [tenant2, 7]
1238 - [tenant3, 7]
1239 pool2:
1240 vn_name: floating-ips
1241 vn_project: admin
1242 vn_domain: default-domain
1243 owner_access: 7
1244 global_access: 0
1245 list_of_projects:
1246 - [tenant3, 7]
1247
1248
1249If you want to remove all shares from the ip floating pool, define only empty list in
1250list of projects, like this:
1251
1252.. code-block:: yaml
1253
1254 opencontrail:
1255 client:
1256 floating_ip_pools:
1257 pool1:
1258 vn_name: external-network
1259 vn_project: admin
1260 vn_domain: default-domain
1261 owner_access: 7
1262 global_access: 0
1263 list_of_projects: []
1264
1265
Michel Nederlof5364ab62017-12-11 15:02:25 +01001266Contrail DNS custom forwarders
1267------------------------------
1268
1269By default Contrail uses the /etc/resolv.conf file to determine the upstream DNS servers.
1270This can have some side-affects, like resolving internal DNS entries on you public instances.
1271
1272In order to overrule this default set, you can configure nameservers using pillar data.
1273The formula is then responsible for configuring and generating a alternate resolv.conf file.
1274
1275Note: this has been patched recently in the Contrail distribution of Mirantis:
1276https://github.com/Mirantis/contrail-controller/commit/ed9a25ccbcfebd7d079a93aecc5a1a7bf1265ea4
1277https://github.com/Mirantis/contrail-controller/commit/94c844cf2e9bcfcd48587aec03d10b869e737ade
1278
1279
1280To change forwarders for the default-dns option (which is handled by compute nodes):
1281
1282.. code-block:: yaml
1283
1284 compute:
1285 ....
1286 dns:
1287 forwarders:
1288 - 8.8.8.8
1289 - 8.8.4.4
1290 ....
1291
1292To change forwarders for vDNS zones (handled by control nodes):
1293
1294.. code-block:: yaml
1295
1296 control:
1297 ....
1298 dns:
1299 forwarders:
1300 - 8.8.8.8
1301 - 8.8.4.4
1302 ....
1303
Petr Jediný04bed9b2018-05-03 19:44:10 +02001304Contrail IF-MAP server configuration
1305------------------------------------
1306
1307Contrail 3.2 contains internal IF-MAP server implementation. This implementation can be enabled
1308by setting ``config:ifmap:engine`` to internal. Currently supported engines are ``internal`` and
1309``irond`` (default). The ``internal`` will configure contrail-api to run as a IF-MAP server in the
1310same process as contrail-api and will generate security certificates in specified folder.
1311
1312.. code-block:: yaml
1313
1314 config:
1315 ....
1316 ifmap:
1317 engine: internal
1318 cert_dir: /etc/contrail/ssl/certs/ # default
1319 basename_cert: ifmap.crt # default
1320 basename_key: ifmap.key # default
1321 ....
1322
1323To set static configuration of the IF-MAP server for contrail-control instead of using
1324discovery service, you can use ``control:ifmap:bind:host`` and ``port``. The static configuration
1325is triggered by existence of non-empty value of ``control:ifmap:bind`` key.
1326
1327.. code-block:: yaml
1328 control:
1329 ....
1330 ifmap
1331 bind:
1332 host: 127.0.0.1
1333 port: 8443
1334 ....
1335
1336
Michel Nederloff5bccda2017-11-20 13:31:38 +01001337
Filip Pytloun27930402015-10-06 16:28:32 +02001338Usage
1339=====
1340
1341Basic installation
Ales Komarekad46d2e2017-03-09 17:16:38 +01001342------------------
Filip Pytloun27930402015-10-06 16:28:32 +02001343
1344Add control BGP
Ales Komarekad46d2e2017-03-09 17:16:38 +01001345
1346.. code-block:: bash
Filip Pytloun27930402015-10-06 16:28:32 +02001347
1348 python /etc/contrail/provision_control.py --api_server_ip 192.168.1.11 --api_server_port 8082 --host_name network1.contrail.domain.com --host_ip 192.168.1.11 --router_asn 64512
1349
Ales Komarekad46d2e2017-03-09 17:16:38 +01001350Install compute node
Filip Pytloun27930402015-10-06 16:28:32 +02001351
Ales Komarekad46d2e2017-03-09 17:16:38 +01001352.. code-block:: bash
Filip Pytloun27930402015-10-06 16:28:32 +02001353
1354 yum install contrail-vrouter contrail-openstack-vrouter
1355
1356 salt-call state.sls nova,opencontrail
1357
1358Add virtual router
Filip Pytloun27930402015-10-06 16:28:32 +02001359
Ales Komarekad46d2e2017-03-09 17:16:38 +01001360.. code-block:: bash
Filip Pytloun27930402015-10-06 16:28:32 +02001361
1362 python /etc/contrail/provision_vrouter.py --host_name hostnode1.intra.domain.com --host_ip 10.0.100.101 --api_server_ip 10.0.100.30 --oper add --admin_user admin --admin_password cloudlab --admin_tenant_name admin
1363
1364 /etc/sysconfig/network-scripts/ifcfg-bond0 -- comment GATEWAY,NETMASK,IPADDR
1365
1366 reboot
1367
Aleš Komáreka3314b22017-04-11 13:46:06 +02001368Debugging
1369---------
Filip Pytloun27930402015-10-06 16:28:32 +02001370
1371Display vhost XMPP connection status
1372
1373You should see the correct controller_ip and state should be established.
1374
1375 http://<compute-node>:8085/Snh_AgentXmppConnectionStatusReq?
1376
1377Display vrouter interface status
1378
1379When vrf_name = ---ERROR--- then something goes wrong
1380
1381 http://<compute-node>:8085/Snh_ItfReq?name=
1382
1383Display IF MAP table
1384
Vasyl Saienkob10b7202017-09-05 14:19:03 +03001385Look for neighbours, if VM has 2, it's ok
Filip Pytloun27930402015-10-06 16:28:32 +02001386
1387 http://<control-node>:8083/Snh_IFMapTableShowReq?table_name=
1388
1389Trace XMPP requests
1390
1391 http://<compute-node>:8085/Snh_SandeshTraceRequest?x=XmppMessageTrace
1392
Filip Pytlounf6b79d42017-02-02 13:02:03 +01001393
1394Documentation and Bugs
1395======================
1396
1397To learn how to install and update salt-formulas, consult the documentation
1398available online at:
1399
1400 http://salt-formulas.readthedocs.io/
1401
1402In the unfortunate event that bugs are discovered, they should be reported to
1403the appropriate issue tracker. Use Github issue tracker for specific salt
1404formula:
1405
1406 https://github.com/salt-formulas/salt-formula-opencontrail/issues
1407
1408For feature requests, bug reports or blueprints affecting entire ecosystem,
1409use Launchpad salt-formulas project:
1410
1411 https://launchpad.net/salt-formulas
1412
1413You can also join salt-formulas-users team and subscribe to mailing list:
1414
1415 https://launchpad.net/~salt-formulas-users
1416
1417Developers wishing to work on the salt-formulas projects should always base
1418their work on master branch and submit pull request against specific formula.
1419
1420 https://github.com/salt-formulas/salt-formula-opencontrail
1421
1422Any questions or feedback is always welcome so feel free to join our IRC
1423channel:
1424
1425 #salt-formulas @ irc.freenode.net