blob: d7350c83906e695f39f7fad3baac8a6e12edac1e [file] [log] [blame]
Aleš Komáreka3314b22017-04-11 13:46:06 +02001====================
2OpenContrail Formula
3====================
Filip Pytloun27930402015-10-06 16:28:32 +02004
Jakub Pavlik01fe5372016-05-20 11:23:28 +02005Contrail Controller is an open, standards-based software solution that
6delivers network virtualization and service automation for federated cloud
7networks. It provides self-service provisioning, improves network
8troubleshooting and diagnostics, and enables service chaining for dynamic
9application environments across enterprise virtual private cloud (VPC),
10managed Infrastructure as a Service (IaaS), and Networks Functions
11Virtualization (NFV) use cases.
Filip Pytloun27930402015-10-06 16:28:32 +020012
Jiri Konecny463dee52016-03-03 11:08:46 +010013
Petr Michalec579e64d2017-03-24 12:54:29 +010014Package source
15==============
Aleš Komáreka3314b22017-04-11 13:46:06 +020016
Petr Michalec579e64d2017-03-24 12:54:29 +010017Formula support OpenContrail as well as Juniper Contrail package repository in the backend.
18
19Differences withing the configuration and state run are controlled by
20``opencontrail.common.vendor: [opencontrail|juniper]`` pillar attribute.
21
22Default value is set to ``opencontrail``.
23
24Juniper releases tested with this formula:
25 - 3.0.2.x
26
27To use Juniper Contrail repository as a source of packages override pillar as in this example:
28
29.. code-block:: yaml
30
31 opencontrail:
32 common:
33 vendor: juniper
34
35
Aleš Komáreka3314b22017-04-11 13:46:06 +020036Sample Pillars
Filip Pytloun27930402015-10-06 16:28:32 +020037==============
38
Jiri Konecny463dee52016-03-03 11:08:46 +010039Controller nodes
40----------------
41
42There are several scenarios for OpenContrail control plane.
43
44All-in-one single
45~~~~~~~~~~~~~~~~~
46
47Config, control, analytics, database, web -- altogether on one node.
48
49.. code-block:: yaml
50
51 opencontrail:
52 common:
53 version: 2.2
54 source:
55 engine: pkg
56 address: http://mirror.robotice.cz/contrail-havana/
57 identity:
58 engine: keystone
59 host: 127.0.0.1
60 port: 35357
61 token: token
62 password: password
63 network:
64 engine: neutron
65 host: 127.0.0.1
66 port: 9696
67 config:
68 version: 2.2
69 enabled: true
70 network:
71 engine: neutron
72 host: 127.0.0.1
73 port: 9696
74 discovery:
75 host: 127.0.0.1
76 analytics:
77 host: 127.0.0.1
78 bind:
79 address: 127.0.0.1
80 message_queue:
81 engine: rabbitmq
82 host: 127.0.0.1
83 port: 5672
84 database:
85 members:
86 - host: 127.0.0.1
87 port: 9160
88 cache:
Jakub Pavlikd1a059e2016-07-13 23:08:33 +020089 members:
90 - host: 127.0.0.1
91 port: 11211
Jiri Konecny463dee52016-03-03 11:08:46 +010092 identity:
93 engine: keystone
94 version: '2.0'
95 region: RegionOne
96 host: 127.0.0.1
97 port: 35357
98 user: admin
99 password: password
100 token: token
101 tenant: admin
102 members:
103 - host: 127.0.0.1
104 id: 1
Dmitry Stremkovskiy841fee32017-09-01 18:08:41 +0300105 rootlogger: "INFO, CONSOLE"
Jiri Konecny463dee52016-03-03 11:08:46 +0100106 control:
107 version: 2.2
108 enabled: true
109 bind:
110 address: 127.0.0.1
111 discovery:
112 host: 127.0.0.1
113 master:
114 host: 127.0.0.1
115 members:
116 - host: 127.0.0.1
117 id: 1
118 collector:
119 version: 2.2
120 enabled: true
121 bind:
122 address: 127.0.0.1
123 master:
124 host: 127.0.0.1
125 discovery:
126 host: 127.0.0.1
127 data_ttl: 2
128 database:
129 members:
130 - host: 127.0.0.1
131 port: 9160
Sergey Kreysfd017c12018-05-04 18:35:37 +0300132 message_queue:
133 members:
134 - host: 127.0.0.1
135 - host: 127.0.0.1
136 - host: 127.0.0.1
Jiri Konecny463dee52016-03-03 11:08:46 +0100137 database:
138 version: 2.2
139 cassandra:
140 version: 2
141 enabled: true
142 minimum_disk: 10
143 name: 'Contrail'
144 original_token: 0
Dmitry Stremkovskiy2a079c72017-07-12 23:11:18 +0300145 compaction_throughput_mb_per_sec: 16
Dmitry Stremkovskiy71b310a2017-08-11 20:39:11 +0300146 concurrent_compactors: 1
Jiri Konecny463dee52016-03-03 11:08:46 +0100147 data_dirs:
148 - /var/lib/cassandra
149 id: 1
150 discovery:
151 host: 127.0.0.1
152 bind:
153 host: 127.0.0.1
154 port: 9042
155 rpc_port: 9160
156 members:
157 - host: 127.0.0.1
158 id: 1
159 web:
160 version: 2.2
161 enabled: True
162 bind:
163 address: 127.0.0.1
164 analytics:
165 host: 127.0.0.1
166 master:
167 host: 127.0.0.1
168 cache:
169 engine: redis
170 host: 127.0.0.1
171 port: 6379
172 members:
173 - host: 127.0.0.1
174 id: 1
175 identity:
176 engine: keystone
177 version: '2.0'
178 host: 127.0.0.1
179 port: 35357
180 user: admin
181 password: password
182 token: token
183 tenant: admin
184
185
186All-in-one cluster
187~~~~~~~~~~~~~~~~~~
188
Jakub Pavlik01fe5372016-05-20 11:23:28 +0200189Config, control, analytics, database, web -- altogether, clustered on multiple
190nodes.
Jiri Konecny463dee52016-03-03 11:08:46 +0100191
192.. code-block:: yaml
193
194 opencontrail:
195 common:
196 version: 2.2
197 source:
198 engine: pkg
199 address: http://mirror.robotice.cz/contrail-havana/
200 identity:
201 engine: keystone
202 host: 127.0.0.1
203 port: 35357
204 token: token
205 password: password
206 network:
207 engine: neutron
208 host: 127.0.0.1
209 port: 9696
210 config:
211 version: 2.2
212 enabled: true
213 network:
214 engine: neutron
215 host: 127.0.0.1
216 port: 9696
217 discovery:
218 host: 127.0.0.1
219 analytics:
220 host: 127.0.0.1
221 bind:
222 address: 127.0.0.1
223 message_queue:
224 engine: rabbitmq
225 host: 127.0.0.1
226 port: 5672
227 database:
228 members:
229 - host: 127.0.0.1
230 port: 9160
231 - host: 127.0.0.1
232 port: 9160
233 - host: 127.0.0.1
234 port: 9160
235 cache:
Jakub Pavlikd1a059e2016-07-13 23:08:33 +0200236 members:
237 - host: 127.0.0.1
238 port: 11211
239 - host: 127.0.0.1
240 port: 11211
241 - host: 127.0.0.1
242 port: 11211
Jiri Konecny463dee52016-03-03 11:08:46 +0100243 identity:
244 engine: keystone
245 version: '2.0'
246 region: RegionOne
247 host: 127.0.0.1
248 port: 35357
249 user: admin
250 password: password
251 token: token
252 tenant: admin
253 members:
254 - host: 127.0.0.1
255 id: 1
256 - host: 127.0.0.1
257 id: 2
258 - host: 127.0.0.1
259 id: 3
260 control:
261 version: 2.2
262 enabled: true
263 bind:
264 address: 127.0.0.1
265 discovery:
266 host: 127.0.0.1
267 master:
268 host: 127.0.0.1
269 members:
270 - host: 127.0.0.1
271 id: 1
272 - host: 127.0.0.1
273 id: 2
274 - host: 127.0.0.1
275 id: 3
276 collector:
277 version: 2.2
278 enabled: true
279 bind:
280 address: 127.0.0.1
281 master:
282 host: 127.0.0.1
283 discovery:
284 host: 127.0.0.1
285 data_ttl: 1
286 database:
287 members:
288 - host: 127.0.0.1
289 port: 9160
290 - host: 127.0.0.1
291 port: 9160
292 - host: 127.0.0.1
293 port: 9160
Sergey Kreysfd017c12018-05-04 18:35:37 +0300294 message_queue:
295 members:
296 - host: 127.0.0.1
297 - host: 127.0.0.1
298 - host: 127.0.0.1
Jiri Konecny463dee52016-03-03 11:08:46 +0100299 database:
300 version: 2.2
301 cassandra:
302 version: 2
303 enabled: true
304 name: 'Contrail'
305 minimum_disk: 10
306 original_token: 0
307 data_dirs:
308 - /var/lib/cassandra
309 id: 1
310 discovery:
311 host: 127.0.0.1
312 bind:
313 host: 127.0.0.1
314 port: 9042
315 rpc_port: 9160
316 members:
317 - host: 127.0.0.1
318 id: 1
319 - host: 127.0.0.1
320 id: 2
321 - host: 127.0.0.1
322 id: 3
323 web:
324 version: 2.2
325 enabled: True
326 bind:
327 address: 127.0.0.1
328 master:
329 host: 127.0.0.1
330 analytics:
331 host: 127.0.0.1
332 cache:
333 engine: redis
334 host: 127.0.0.1
335 port: 6379
336 members:
337 - host: 127.0.0.1
338 id: 1
339 - host: 127.0.0.1
340 id: 2
341 - host: 127.0.0.1
342 id: 3
343 identity:
344 engine: keystone
345 version: '2.0'
346 host: 127.0.0.1
347 port: 35357
348 user: admin
349 password: password
350 token: token
351 tenant: admin
352
353
354Separated analytics from control and config
355~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
356
357Config, control, database, web.
358
359.. code-block:: yaml
360
361 opencontrail:
362 common:
363 version: 2.2
364 identity:
365 engine: keystone
366 host: 127.0.0.1
367 port: 35357
368 token: token
369 password: password
370 network:
371 engine: neutron
372 host: 127.0.0.1
373 port: 9696
374 config:
375 version: 2.2
376 enabled: true
377 network:
378 engine: neutron
379 host: 127.0.0.1
380 port: 9696
381 discovery:
382 host: 127.0.0.1
383 analytics:
384 host: 127.0.0.1
385 bind:
386 address: 127.0.0.1
387 message_queue:
388 engine: rabbitmq
389 host: 127.0.0.1
390 port: 5672
391 database:
392 members:
393 - host: 127.0.0.1
394 port: 9160
395 - host: 127.0.0.1
396 port: 9160
397 - host: 127.0.0.1
398 port: 9160
399 cache:
Jakub Pavlikd1a059e2016-07-13 23:08:33 +0200400 members:
401 - host: 127.0.0.1
402 port: 11211
403 - host: 127.0.0.1
404 port: 11211
405 - host: 127.0.0.1
406 port: 11211
Jiri Konecny463dee52016-03-03 11:08:46 +0100407 identity:
408 engine: keystone
409 version: '2.0'
410 region: RegionOne
411 host: 127.0.0.1
412 port: 35357
413 user: admin
414 password: password
415 token: token
416 tenant: admin
417 members:
418 - host: 127.0.0.1
419 id: 1
420 - host: 127.0.0.1
421 id: 2
422 - host: 127.0.0.1
423 id: 3
424 control:
425 version: 2.2
426 enabled: true
427 bind:
428 address: 127.0.0.1
429 discovery:
430 host: 127.0.0.1
431 master:
432 host: 127.0.0.1
433 members:
434 - host: 127.0.0.1
435 id: 1
436 - host: 127.0.0.1
437 id: 2
438 - host: 127.0.0.1
439 id: 3
440 database:
441 version: 127.0.0.1
442 cassandra:
443 version: 2
444 enabled: true
445 name: 'Contrail'
446 minimum_disk: 10
447 original_token: 0
448 data_dirs:
449 - /var/lib/cassandra
450 id: 1
451 discovery:
452 host: 127.0.0.1
453 bind:
454 host: 127.0.0.1
455 port: 9042
456 rpc_port: 9160
457 members:
458 - host: 127.0.0.1
459 id: 1
460 - host: 127.0.0.1
461 id: 2
462 - host: 127.0.0.1
463 id: 3
464 web:
465 version: 2.2
466 enabled: True
467 bind:
468 address: 127.0.0.1
469 analytics:
470 host: 127.0.0.1
471 master:
472 host: 127.0.0.1
473 cache:
474 engine: redis
475 host: 127.0.0.1
476 port: 6379
477 members:
478 - host: 127.0.0.1
479 id: 1
480 - host: 127.0.0.1
481 id: 2
482 - host: 127.0.0.1
483 id: 3
484 identity:
485 engine: keystone
486 version: '2.0'
487 host: 127.0.0.1
488 port: 35357
489 user: admin
490 password: password
491 token: token
492 tenant: admin
493
Jiri Konecny463dee52016-03-03 11:08:46 +0100494Analytic nodes
Jiri Konecny463dee52016-03-03 11:08:46 +0100495
496Analytics and database on an analytic node(s)
497
498.. code-block:: yaml
499
500 opencontrail:
501 common:
502 version: 2.2
503 identity:
504 engine: keystone
505 host: 127.0.0.1
506 port: 35357
507 token: token
508 password: password
509 network:
510 engine: neutron
511 host: 127.0.0.1
512 port: 9696
513 collector:
514 version: 2.2
515 enabled: true
516 bind:
517 address: 127.0.0.1
518 master:
519 host: 127.0.0.1
520 discovery:
521 host: 127.0.0.1
522 data_ttl: 1
523 database:
524 members:
525 - host: 127.0.0.1
526 port: 9160
527 - host: 127.0.0.1
528 port: 9160
529 - host: 127.0.0.1
530 port: 9160
Sergey Kreysfd017c12018-05-04 18:35:37 +0300531 message_queue:
532 members:
533 - host: 127.0.0.1
534 - host: 127.0.0.1
535 - host: 127.0.0.1
Jiri Konecny463dee52016-03-03 11:08:46 +0100536 database:
537 version: 2.2
538 cassandra:
539 version: 2
540 enabled: true
541 name: 'Contrail'
542 minimum_disk: 10
543 original_token: 0
544 data_dirs:
545 - /var/lib/cassandra
546 id: 1
547 discovery:
548 host: 127.0.0.1
549 bind:
550 host: 127.0.0.1
551 port: 9042
552 rpc_port: 9160
553 members:
554 - host: 127.0.0.1
555 id: 1
556 - host: 127.0.0.1
557 id: 2
558 - host: 127.0.0.1
559 id: 3
560
561
562Compute nodes
Aleš Komáreka3314b22017-04-11 13:46:06 +0200563-------------
Jiri Konecny463dee52016-03-03 11:08:46 +0100564
565Vrouter configuration on a compute node(s)
566
567.. code-block:: yaml
568
569 opencontrail:
570 common:
571 version: 2.2
572 identity:
573 engine: keystone
574 host: 127.0.0.1
575 port: 35357
576 token: token
577 password: password
578 network:
579 engine: neutron
580 host: 127.0.0.1
581 port: 9696
582 compute:
583 version: 2.2
584 enabled: True
Dmitry Stremkovskiy0cb5c562017-07-26 00:32:51 +0300585 hostname: node-12.domain.tld
Danysa144f292018-06-26 16:08:50 +0200586 flow_hold_limit: 0
Jiri Konecny463dee52016-03-03 11:08:46 +0100587 discovery:
588 host: 127.0.0.1
589 interface:
590 address: 127.0.0.1
591 dev: eth0
592 gateway: 127.0.0.1
593 mask: /24
594 dns: 127.0.0.1
595 mtu: 9000
596
Petr Jediný5f3008a2017-07-31 15:04:05 +0200597
598Compute nodes with gateway_mode
599-------------------------------
600
601Gateway mode: can be server/ vcpe (default is none)
602
603.. code-block:: yaml
604
605 opencontrail:
606 compute:
607 gateway_mode: server
608
Vasyl Saienkob10b7202017-09-05 14:19:03 +0300609TSN nodes
610---------
611
612Configure TSN nodes
613
614.. code-block:: yaml
615
616 opencontrail:
617 compute:
618 enabled: true
619 tor:
620 enabled: true
621 bind:
622 port: 8086
623 agent:
624 tor01:
625 id: 0
626 port: 6632
627 host: 127.0.0.1
628 address: 127.0.0.1
629
Petr Jediný5f3008a2017-07-31 15:04:05 +0200630
Andreyeff77ac2017-08-25 12:14:06 -0500631Set up metadata secret for the Vrouter
Petr Jedinýfe51c6a2017-09-05 18:30:31 +0200632--------------------------------------
Andreyeff77ac2017-08-25 12:14:06 -0500633
Petr Jedinýfe51c6a2017-09-05 18:30:31 +0200634In order to get cloud-init within the instance to properly fetch
Andreyeff77ac2017-08-25 12:14:06 -0500635instance metadata, metadata_proxy_secret in the Vrouter agent config
636should match the value in nova.conf. The administrator should define
637it in the pillar:
638
639.. code-block:: yaml
640
641 opencontrail:
642 compute:
643 metadata:
644 secret: opencontrail
645
Petr Jedinýfe51c6a2017-09-05 18:30:31 +0200646Add auth info for Barbican on compute nodes
647-------------------------------------------
648
649.. code-block:: yaml
650
651 opencontrail:
652 compute:
653 lbaas:
654 enabled: true
655 secret_manager:
656 engine: barbican
657 identity:
658 user: admin
659 password: "supersecretpassword123"
660 tenant: admin
661
662
Jakub Pavlik735005f2016-02-26 15:54:53 +0100663Keystone v3
Aleš Komáreka3314b22017-04-11 13:46:06 +0200664-----------
Jakub Pavlik735005f2016-02-26 15:54:53 +0100665
Jakub Pavlik01fe5372016-05-20 11:23:28 +0200666To enable support for keystone v3 in opencontrail, there must be defined
667version for config and web role.
Jakub Pavlik735005f2016-02-26 15:54:53 +0100668
669.. code-block:: yaml
670
671 opencontrail:
672 config:
673 version: 2.2
674 enabled: true
675 ...
676 identity:
677 engine: keystone
678 version: '3'
679 ...
680
681 opencontrail:
682 web:
683 version: 2.2
684 enabled: true
685 ...
686 identity:
687 engine: keystone
688 version: '3'
689 ...
690
marco10cc2212016-04-03 14:21:54 +0200691Without Keystone
692----------------
693
694.. code-block:: yaml
695
696 opencontrail:
697 ...
698 common:
699 ...
700 identity:
701 engine: none
702 token: none
703 password: none
704 ...
705 config:
706 ...
707 identity:
708 engine: none
709 password: none
710 token: none
711 ...
712 web:
713 ...
714 identity:
715 engine: none
716 password: none
717 token: none
718 ...
marcof5461712016-04-04 20:49:36 +0200719
Aleš Komáreka3314b22017-04-11 13:46:06 +0200720Kubernetes support
721------------------
722
marcof5461712016-04-04 20:49:36 +0200723Kubernetes vrouter nodes
marcof5461712016-04-04 20:49:36 +0200724
725Vrouter configuration on a kubernetes node(s)
726
727.. code-block:: yaml
728
729 opencontrail:
730 ...
731 compute:
732 engine: kubernetes
733 ...
734
Jakub Pavlik0d1f67e2016-11-30 10:04:13 +0100735vRouter with separated control plane
Jakub Pavlik0d1f67e2016-11-30 10:04:13 +0100736
737Separate XMPP traffic from dataplane interface.
738
739.. code-block:: yaml
740
741 opencontrail:
742 compute:
743 bind:
744 address: 172.16.0.50
745 ...
746
Petr Jediný439fab32017-07-10 14:33:09 +0200747Override RPF default in Contrail API
748------------------------------------
749
750From MCP1.1 with OpenContrail >= 3.1.1 you can override RPF default for newly
751created virtual networks. This can be useful for usecases like running
752Calico and K8S in overlay. The `override_rpf_default_by` has valid values
753`disable`, `enable`. If not defined, the configuration fallbacks to Contrail
754default - currently `enable`.
755
756.. code-block:: yaml
757
758 opencontrail:
759 ...
760 config:
761 override_rpf_default_by: 'disable'
762 ...
763
Petr Jediný01c18822017-11-15 12:30:53 +0100764Cassandra GC logging
765--------------------
766
767From Contrail version 3 you can set a way you want to handle Cassandra GC logs.
768The behavior is controlled by `cassandra_gc_logging`. Valid values are
769'rotation' (default), 'legacy' and false.
770
771- 'rotation' is supported by JDK 6u34 7u2 or later and handles rotation of log
772files automatically.
773- 'legacy' is a way to support older JDKs and you will need to handle logs by
774other means. This can be handled for example by using
775`- service.opencontrail.database.cassandra_log_cleanup` in your reclass model.
776- false will disable the cassandra gc logging
777
778.. code-block:: yaml
779
780 opencontrail:
781 ...
782 database:
783 cassandra_gc_logging: false
784 ...
785
Petr Jediný439fab32017-07-10 14:33:09 +0200786
Jakub Pavlik6d90f362016-04-19 20:34:37 +0200787Disable Contrail API authentication
788-----------------------------------
789
Petr Jediný78e6f422017-06-01 13:24:49 +0200790Contrail version must >= 3.0. It is useful especially for Keystone v3.
Jakub Pavlik6d90f362016-04-19 20:34:37 +0200791
792.. code-block:: yaml
793
794 opencontrail:
795 ...
796 config:
797 multi_tenancy: false
798 ...
799
Marek Celoudae98c642018-01-31 12:43:42 +0100800Enable RBAC
801-----------
802
803
804.. code-block:: yaml
805
806 opencontrail:
807 ...
808 config:
809 aaa_mode: rbac
810 cloud_admin_role: admin
811 global_read_only_role: member
812 ...
813
Petr Jediný78e6f422017-06-01 13:24:49 +0200814Switch from on demand to periodic keystone sync
815-----------------------------------------------
816
817This can be useful when you want to sync projects from OpenStack to Contrail
818automatically. The period of sync is 60s.
819
820.. code-block:: yaml
821
822 opencontrail:
823 ...
824 config:
825 identity:
826 sync_on_demand: false
827 ...
828
marco2502e052016-05-31 22:53:54 +0200829Cassandra listen interface
Petr Jedinýffbe2082017-03-07 00:56:47 +0100830--------------------------
marco2502e052016-05-31 22:53:54 +0200831
832.. code-block:: yaml
Vasyl Saienkob10b7202017-09-05 14:19:03 +0300833
marco2502e052016-05-31 22:53:54 +0200834 database:
835 ....
836 bind:
837 interface: eth0
838 port: 9042
839 rpc_port: 9160
840 ....
Jakub Pavlik6d90f362016-04-19 20:34:37 +0200841
Petr Jedinýffbe2082017-03-07 00:56:47 +0100842OpenContrail WebUI version >= 3.1.1
843-----------------------------------
Petr Jediný78e6f422017-06-01 13:24:49 +0200844For OpenContrail version >= 3.1.1 and Cassandra >= 2.1 we should override WebUI's cassandra port from 9160 to 9042.
Petr Jedinýffbe2082017-03-07 00:56:47 +0100845
846For appropriate node at class level:
847
848.. code-block:: yaml
Aleš Komáreka3314b22017-04-11 13:46:06 +0200849
Petr Jedinýffbe2082017-03-07 00:56:47 +0100850 opencontrail:
851 ....
852 web:
853 database:
854 port: 9042
855 ....
856
857
Jakub Pavlik9a4de012016-12-14 13:23:55 +0100858RabbitMQ HA hosts
859------------------
860
861.. code-block:: yaml
862
863 opencontrail:
864 config:
865 message_queue:
866 engine: rabbitmq
867 members:
868 - host: 10.0.16.1
869 - host: 10.0.16.2
870 - host: 10.0.16.3
871 port: 5672
872
873.. code-block:: yaml
874
875 database:
876 ....
877 bind:
878 interface: eth0
879 port: 9042
880 rpc_port: 9160
881 ....
882
Jakub Pavlike3590062017-02-20 23:32:57 +0100883DPDK vRouter
884-------------
885
886.. code-block:: yaml
887
888 opencontrail:
889 compute:
890 dpdk:
891 enabled: true
Jakub Pavlik54761d82017-03-08 11:22:37 +0100892 taskset: "0x0000003C00003C"
893 socket_mem: "1024,1024"
Jakub Pavlike3590062017-02-20 23:32:57 +0100894 interface:
895 mac_address: 90:e2:ba:7c:22:e1
896 pci: 0000:81:00.1
897 ...
898
Petr Jedinýe9960762018-05-04 17:36:59 +0200899Increase number of contrail-api workers
900---------------------------------------
901
902.. code-block:: yaml
903
904 opencontrail:
905 ...
906 config:
907 api_workers: 3
908 ...
909
Marek Celouddbba7ed2017-12-07 10:36:24 +0100910Increase number of alarm-gen workers
911------------------------------------
912
913Port prefix will increment used ports by workers starting with 5901.
914
915.. code-block:: yaml
916
917 collector:
918 alarm_gen:
919 workers: 1
920 port_prefix: 59
921
Ales Komarekad46d2e2017-03-09 17:16:38 +0100922Contrail client
923---------------
924
925Basic parameters with identity and host configs
926
Petr Jediný78e6f422017-06-01 13:24:49 +0200927.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +0100928
929 opencontrail:
930 client:
931 identity:
932 user: admin
933 project: admin
934 password: adminpass
935 host: keystone_host
936 config:
937 host: contrail_api_host
938 port: contrail_api_ort
939
940Enforcing virtual routers
941
Petr Jediný78e6f422017-06-01 13:24:49 +0200942.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +0100943
944 opencontrail:
945 client:
946 ...
947 virtual_router:
948 cmp01:
949 ip_address: 172.16.0.11
950 dpdk_enabled: True
951 cmp02:
952 ip_address: 172.16.0.12
953 dpdk_enabled: True
954
psvimbersky3c84e272018-01-02 10:34:29 +0100955
956Enforcing global system config
957
958.. code-block:: yaml
959
960 opencontrail:
961 client:
962 ...
963 global_system_config:
964 name: default-global-system-config
965 asn: 64512
966 grp:
967 enable: true
968 restart_time: 60
969 end_of_rib_timeout: 30
970 bgp_helper_enable: false
971 xmpp_helper_enable: false
972 long_lived_restart_time: 300
973
974
Pavel Svimbersky13cda442017-09-14 14:46:13 +0200975Enforcing global vrouter config
976
977.. code-block:: yaml
978
979 opencontrail:
980 client:
981 ...
982 global_vrouter_config:
Petr Jediný554d0412018-01-04 22:35:48 +0100983 name: default-global-vrouter-config
Pavel Svimbersky13cda442017-09-14 14:46:13 +0200984 parent_type: global-system-config
985 encap_priority: "MPLSoUDP,MPLSoGRE"
986 vxlan_vn_id_mode: automatic
987 fq_names:
988 - 'default-global-system-config'
989 - 'default-global-vrouter-config'
990
psvimbersky3c84e272018-01-02 10:34:29 +0100991
992
Ales Komarekad46d2e2017-03-09 17:16:38 +0100993Enforcing control nodes
994
Petr Jediný78e6f422017-06-01 13:24:49 +0200995.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +0100996
997 opencontrail:
998 client:
999 ...
1000 bgp_router:
1001 ntw01:
1002 type: control-node
1003 ip_address: 172.16.0.11
1004 nwt02:
1005 type: control-node
1006 ip_address: 172.16.0.12
1007 nwt03:
1008 type: control-node
1009 ip_address: 172.16.0.13
1010
1011
1012Enforcing edge BGP routers
1013
Petr Jediný78e6f422017-06-01 13:24:49 +02001014.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +01001015
1016 opencontrail:
1017 client:
1018 ...
1019 bgp_router:
1020 mx01:
1021 type: router
1022 ip_address: 172.16.0.21
1023 asn: 64512
1024 mx02:
1025 type: router
1026 ip_address: 172.16.0.22
1027 asn: 64512
Marek Celoud3097e5b2018-01-09 13:52:14 +01001028 key_type: md5
1029 key: password
Ales Komarekad46d2e2017-03-09 17:16:38 +01001030
1031Enforcing config nodes
1032
Petr Jediný78e6f422017-06-01 13:24:49 +02001033.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +01001034
1035 opencontrail:
1036 client:
1037 ...
1038 config_node:
1039 ctl01:
1040 ip_address: 172.16.0.21
1041 ctl02:
1042 ip_address: 172.16.0.22
1043
1044Enforcing database nodes
1045
Petr Jediný78e6f422017-06-01 13:24:49 +02001046.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +01001047
1048 opencontrail:
1049 client:
1050 ...
1051 database_node:
1052 ntw01:
1053 ip_address: 172.16.0.21
1054 ntw02:
1055 ip_address: 172.16.0.22
1056
1057Enforcing analytics nodes
1058
Petr Jediný78e6f422017-06-01 13:24:49 +02001059.. code-block:: yaml
Ales Komarekad46d2e2017-03-09 17:16:38 +01001060
1061 opencontrail:
1062 client:
1063 ...
1064 analytics_node:
1065 nal01:
1066 ip_address: 172.16.0.31
1067 nal02:
1068 ip_address: 172.16.0.32
1069
Petr Jediný5f3efe32017-05-26 17:55:09 +02001070Enforcing Link Local Services
1071
1072.. code-block:: yaml
1073
1074 opencontrail:
1075 client:
1076 ...
1077 linklocal_service:
1078 # example with dns name address (only one permited)
1079 meta1:
1080 lls_ip: 10.0.0.23
1081 lls_port: 80
1082 ipf_addresses: "meta.example.com"
1083 ipf_port: 80
1084 # example with multiple ip addresses
1085 meta2:
1086 lls_ip: 10.0.0.23
1087 lls_port: 80
1088 ipf_addresses:
1089 - 10.10.10.10
1090 - 10.20.20.20
1091 - 10.30.30.30
1092 ipf_port: 80
1093 # example with one ip address
1094 meta3:
1095 lls_ip: 10.0.0.23
1096 lls_port: 80
1097 ipf_addresses:
1098 - 10.10.10.10
1099 ipf_port: 80
1100 # example with name override
1101 lls_meta4:
1102 name: meta4
1103 lls_ip: 10.0.0.23
1104 lls_port: 80
1105 ipf_addresses:
1106 - 10.10.10.10
1107 ipf_port: 80
1108
Vasyl Saienkob10b7202017-09-05 14:19:03 +03001109
Michel Nederloff5bccda2017-11-20 13:31:38 +01001110Configuring OpenStack default quotasx
1111
1112.. code-block:: yaml
1113 config:
1114 quota:
1115 network: 5
1116 subnet: 10
1117 router: 10
1118 floating_ip: 100
1119 secgroup: 1000
1120 secgroup_rule: 1000
1121 port: 1000
1122 pool: -1
1123 member: -1
1124 health_monitor: -1
1125 vip: -1
1126
1127Enforcing physical routers
Petr Jediný04bed9b2018-05-03 19:44:10 +02001128
Vasyl Saienkob10b7202017-09-05 14:19:03 +03001129.. code-block:: yaml
1130
1131 opencontrail:
1132 client:
1133 ...
1134 physical_router:
1135 router1:
1136 name: router1
1137 dataplane_ip: 1.2.3.4
1138 management_ip: 1.2.3.4
1139 vendor_name: ovs
1140 product_name: ovs
1141 agents:
1142 - tsn0-0
1143 - tsn0
1144
1145Enforcing physical/logical interfaces for routers
1146
1147
1148.. code-block:: yaml
1149
1150 opencontrail
1151 client:
1152 ...
1153 physical_router:
1154 router1:
1155 ...
1156 interface:
1157 port1:
1158 name: port1
1159 logical_interface:
1160 port1_l:
1161 name: 'port1.0'
1162 vlan_tag: 0
1163 interface_type: L2
1164 virtual_machine_interface:
1165 port1_port:
1166 name: port1_port
1167 ip_address: 192.168.90.107
1168 mac_address: '2e:92:a8:af:c2:21'
1169 security_group: 'default'
1170 virtual_network: 'virtual-network'
1171
Jan Cachebfed1c2018-01-09 17:21:35 +01001172Enforcing virtual networks
1173
1174
1175.. code-block:: yaml
1176
1177 opencontrail:
1178 client:
1179 virtual_networks:
1180 net01:
1181 name: 'network01'
1182 ip_address: '172.16.111.0'
1183 ip_prefix: 24
1184 asn: 64512
1185 route_target: 10000
1186 external: True
1187 allow_transit: False
1188 forwarding_mode: 'l2_l3'
1189 rpf: 'disable'
1190 mirror_destination: False
1191 domain: 'default-domain'
1192 project: 'admin'
1193 ipam_domain: 'default-domain'
1194 ipam_project: 'default-project'
1195 ipam_name: 'default-network-ipam'
1196 net02:
1197 name: 'network02'
1198 net03:
1199 name: 'network03'
1200
Ales Komarekad46d2e2017-03-09 17:16:38 +01001201
Jan Cachb3092722018-01-31 12:46:16 +01001202Enforcing floating ip pool setings.
1203
1204Virtual network with flag external needs to be created before managing the floating ip pool.
1205Param vn_name is the name of the external network.
1206
1207.. code-block:: yaml
1208
1209 opencontrail:
1210 client:
1211 floating_ip_pools:
1212 pool1:
1213 vn_name: external-network
1214 vn_project: admin
1215 vn_domain: default-domain
1216 owner_access: 7
1217 global_access: 0
1218 list_of_projects:
1219 - [tenant1, 7]
1220 - [tenant2, 7]
1221 - [tenant3, 7]
1222 pool2:
1223 vn_name: floating-ips
1224 vn_project: admin
1225 vn_domain: default-domain
1226 owner_access: 7
1227 global_access: 0
1228 list_of_projects:
1229 - [tenant3, 7]
1230
1231
1232If you want to remove all shares from the ip floating pool, define only empty list in
1233list of projects, like this:
1234
1235.. code-block:: yaml
1236
1237 opencontrail:
1238 client:
1239 floating_ip_pools:
1240 pool1:
1241 vn_name: external-network
1242 vn_project: admin
1243 vn_domain: default-domain
1244 owner_access: 7
1245 global_access: 0
1246 list_of_projects: []
1247
1248
Michel Nederlof5364ab62017-12-11 15:02:25 +01001249Contrail DNS custom forwarders
1250------------------------------
1251
1252By default Contrail uses the /etc/resolv.conf file to determine the upstream DNS servers.
1253This can have some side-affects, like resolving internal DNS entries on you public instances.
1254
1255In order to overrule this default set, you can configure nameservers using pillar data.
1256The formula is then responsible for configuring and generating a alternate resolv.conf file.
1257
1258Note: this has been patched recently in the Contrail distribution of Mirantis:
1259https://github.com/Mirantis/contrail-controller/commit/ed9a25ccbcfebd7d079a93aecc5a1a7bf1265ea4
1260https://github.com/Mirantis/contrail-controller/commit/94c844cf2e9bcfcd48587aec03d10b869e737ade
1261
1262
1263To change forwarders for the default-dns option (which is handled by compute nodes):
1264
1265.. code-block:: yaml
1266
1267 compute:
1268 ....
1269 dns:
1270 forwarders:
1271 - 8.8.8.8
1272 - 8.8.4.4
1273 ....
1274
1275To change forwarders for vDNS zones (handled by control nodes):
1276
1277.. code-block:: yaml
1278
1279 control:
1280 ....
1281 dns:
1282 forwarders:
1283 - 8.8.8.8
1284 - 8.8.4.4
1285 ....
1286
Petr Jediný04bed9b2018-05-03 19:44:10 +02001287Contrail IF-MAP server configuration
1288------------------------------------
1289
1290Contrail 3.2 contains internal IF-MAP server implementation. This implementation can be enabled
1291by setting ``config:ifmap:engine`` to internal. Currently supported engines are ``internal`` and
1292``irond`` (default). The ``internal`` will configure contrail-api to run as a IF-MAP server in the
1293same process as contrail-api and will generate security certificates in specified folder.
1294
1295.. code-block:: yaml
1296
1297 config:
1298 ....
1299 ifmap:
1300 engine: internal
1301 cert_dir: /etc/contrail/ssl/certs/ # default
1302 basename_cert: ifmap.crt # default
1303 basename_key: ifmap.key # default
1304 ....
1305
1306To set static configuration of the IF-MAP server for contrail-control instead of using
1307discovery service, you can use ``control:ifmap:bind:host`` and ``port``. The static configuration
1308is triggered by existence of non-empty value of ``control:ifmap:bind`` key.
1309
1310.. code-block:: yaml
1311 control:
1312 ....
1313 ifmap
1314 bind:
1315 host: 127.0.0.1
1316 port: 8443
1317 ....
1318
1319
Michel Nederloff5bccda2017-11-20 13:31:38 +01001320
Filip Pytloun27930402015-10-06 16:28:32 +02001321Usage
1322=====
1323
1324Basic installation
Ales Komarekad46d2e2017-03-09 17:16:38 +01001325------------------
Filip Pytloun27930402015-10-06 16:28:32 +02001326
1327Add control BGP
Ales Komarekad46d2e2017-03-09 17:16:38 +01001328
1329.. code-block:: bash
Filip Pytloun27930402015-10-06 16:28:32 +02001330
1331 python /etc/contrail/provision_control.py --api_server_ip 192.168.1.11 --api_server_port 8082 --host_name network1.contrail.domain.com --host_ip 192.168.1.11 --router_asn 64512
1332
Ales Komarekad46d2e2017-03-09 17:16:38 +01001333Install compute node
Filip Pytloun27930402015-10-06 16:28:32 +02001334
Ales Komarekad46d2e2017-03-09 17:16:38 +01001335.. code-block:: bash
Filip Pytloun27930402015-10-06 16:28:32 +02001336
1337 yum install contrail-vrouter contrail-openstack-vrouter
1338
1339 salt-call state.sls nova,opencontrail
1340
1341Add virtual router
Filip Pytloun27930402015-10-06 16:28:32 +02001342
Ales Komarekad46d2e2017-03-09 17:16:38 +01001343.. code-block:: bash
Filip Pytloun27930402015-10-06 16:28:32 +02001344
1345 python /etc/contrail/provision_vrouter.py --host_name hostnode1.intra.domain.com --host_ip 10.0.100.101 --api_server_ip 10.0.100.30 --oper add --admin_user admin --admin_password cloudlab --admin_tenant_name admin
1346
1347 /etc/sysconfig/network-scripts/ifcfg-bond0 -- comment GATEWAY,NETMASK,IPADDR
1348
1349 reboot
1350
Aleš Komáreka3314b22017-04-11 13:46:06 +02001351Debugging
1352---------
Filip Pytloun27930402015-10-06 16:28:32 +02001353
1354Display vhost XMPP connection status
1355
1356You should see the correct controller_ip and state should be established.
1357
1358 http://<compute-node>:8085/Snh_AgentXmppConnectionStatusReq?
1359
1360Display vrouter interface status
1361
1362When vrf_name = ---ERROR--- then something goes wrong
1363
1364 http://<compute-node>:8085/Snh_ItfReq?name=
1365
1366Display IF MAP table
1367
Vasyl Saienkob10b7202017-09-05 14:19:03 +03001368Look for neighbours, if VM has 2, it's ok
Filip Pytloun27930402015-10-06 16:28:32 +02001369
1370 http://<control-node>:8083/Snh_IFMapTableShowReq?table_name=
1371
1372Trace XMPP requests
1373
1374 http://<compute-node>:8085/Snh_SandeshTraceRequest?x=XmppMessageTrace
1375
Filip Pytlounf6b79d42017-02-02 13:02:03 +01001376
1377Documentation and Bugs
1378======================
1379
1380To learn how to install and update salt-formulas, consult the documentation
1381available online at:
1382
1383 http://salt-formulas.readthedocs.io/
1384
1385In the unfortunate event that bugs are discovered, they should be reported to
1386the appropriate issue tracker. Use Github issue tracker for specific salt
1387formula:
1388
1389 https://github.com/salt-formulas/salt-formula-opencontrail/issues
1390
1391For feature requests, bug reports or blueprints affecting entire ecosystem,
1392use Launchpad salt-formulas project:
1393
1394 https://launchpad.net/salt-formulas
1395
1396You can also join salt-formulas-users team and subscribe to mailing list:
1397
1398 https://launchpad.net/~salt-formulas-users
1399
1400Developers wishing to work on the salt-formulas projects should always base
1401their work on master branch and submit pull request against specific formula.
1402
1403 https://github.com/salt-formulas/salt-formula-opencontrail
1404
1405Any questions or feedback is always welcome so feel free to join our IRC
1406channel:
1407
1408 #salt-formulas @ irc.freenode.net