Filip Pytloun | 8bfd2bf | 2015-10-06 16:28:32 +0200 | [diff] [blame] | 1 | ======= |
| 2 | Jenkins |
| 3 | ======= |
| 4 | |
Ales Komarek | 4c0bab1 | 2016-01-22 12:10:50 +0100 | [diff] [blame] | 5 | Jenkins is an application that monitors executions of repeated jobs, such as building a software project or jobs run by cron. |
Filip Pytloun | 8bfd2bf | 2015-10-06 16:28:32 +0200 | [diff] [blame] | 6 | |
| 7 | Available states |
| 8 | ================ |
| 9 | |
| 10 | .. contents:: |
| 11 | :local: |
| 12 | |
| 13 | ``jenkins.master`` |
| 14 | ------------------ |
| 15 | |
Ales Komarek | e5a1ed6 | 2016-08-27 12:02:48 +0200 | [diff] [blame] | 16 | Setup jenkins master. |
Filip Pytloun | 8bfd2bf | 2015-10-06 16:28:32 +0200 | [diff] [blame] | 17 | |
| 18 | ``jenkins.slave`` |
| 19 | ----------------- |
| 20 | |
Ales Komarek | e5a1ed6 | 2016-08-27 12:02:48 +0200 | [diff] [blame] | 21 | Setup jenkins slave. |
Filip Pytloun | 8bfd2bf | 2015-10-06 16:28:32 +0200 | [diff] [blame] | 22 | |
| 23 | ``jenkins.job_builder`` |
| 24 | ----------------------- |
| 25 | |
Ales Komarek | e5a1ed6 | 2016-08-27 12:02:48 +0200 | [diff] [blame] | 26 | Setup jenkins job builder. |
| 27 | |
| 28 | ``jenkins.client`` |
| 29 | ------------------ |
| 30 | |
| 31 | Setup jenkins client, works with Salt 2016.3+, supports pipeline workflow projects only now. |
| 32 | |
Filip Pytloun | 8bfd2bf | 2015-10-06 16:28:32 +0200 | [diff] [blame] | 33 | |
| 34 | Available metadata |
| 35 | ================== |
| 36 | |
| 37 | .. contents:: |
| 38 | :local: |
| 39 | |
| 40 | ``metadata.jenkins.master.single`` |
| 41 | ---------------------------------- |
| 42 | |
| 43 | Setup single-node master |
| 44 | |
| 45 | |
| 46 | ``metadata.jenkins.slave.single`` |
| 47 | --------------------------------- |
| 48 | |
| 49 | Setup Jenkins slave |
| 50 | |
Ales Komarek | e5a1ed6 | 2016-08-27 12:02:48 +0200 | [diff] [blame] | 51 | Sample pillars |
| 52 | ============== |
Filip Pytloun | 8bfd2bf | 2015-10-06 16:28:32 +0200 | [diff] [blame] | 53 | |
Ales Komarek | 4c0bab1 | 2016-01-22 12:10:50 +0100 | [diff] [blame] | 54 | Jenkins master |
Ales Komarek | e5a1ed6 | 2016-08-27 12:02:48 +0200 | [diff] [blame] | 55 | -------------- |
| 56 | |
| 57 | Simple master with reverse proxy |
Filip Pytloun | 8bfd2bf | 2015-10-06 16:28:32 +0200 | [diff] [blame] | 58 | |
| 59 | .. code-block:: yaml |
| 60 | |
Filip Pytloun | 8bfd2bf | 2015-10-06 16:28:32 +0200 | [diff] [blame] | 61 | nginx: |
| 62 | server: |
| 63 | site: |
| 64 | jenkins: |
| 65 | enabled: true |
| 66 | type: nginx_proxy |
| 67 | name: jenkins |
| 68 | proxy: |
| 69 | host: 127.0.0.1 |
| 70 | port: 8080 |
| 71 | protocol: http |
| 72 | host: |
| 73 | name: jenkins.example.com |
| 74 | port: 80 |
| 75 | jenkins: |
| 76 | master: |
| 77 | mode: EXCLUSIVE |
Filip Pytloun | 52b9c2c | 2016-01-28 13:45:57 +0100 | [diff] [blame] | 78 | # Do not manage config.xml from Salt, use UI instead |
| 79 | no_config: true |
Filip Pytloun | 8bfd2bf | 2015-10-06 16:28:32 +0200 | [diff] [blame] | 80 | slaves: |
| 81 | - name: slave01 |
| 82 | label: pbuilder |
| 83 | executors: 2 |
| 84 | - name: slave02 |
| 85 | label: image_builder |
| 86 | mode: EXCLUSIVE |
| 87 | executors: 2 |
| 88 | views: |
| 89 | - name: "Package builds" |
| 90 | regex: "debian-build-.*" |
| 91 | - name: "Contrail builds" |
| 92 | regex: "contrail-build-.*" |
| 93 | - name: "Aptly" |
| 94 | regex: "aptly-.*" |
| 95 | plugins: |
| 96 | - name: slack |
| 97 | - name: extended-choice-parameter |
| 98 | - name: rebuild |
| 99 | - name: test-stability |
| 100 | |
Ales Komarek | af967ee | 2016-08-31 19:38:50 +0200 | [diff] [blame] | 101 | Jenkins with experimental plugin source support |
| 102 | |
| 103 | .. code-block:: yaml |
| 104 | |
| 105 | jenkins: |
| 106 | master: |
| 107 | enabled: true |
| 108 | update_site_url: 'http://updates.jenkins-ci.org/experimental/update-center.json' |
| 109 | |
| 110 | |
Ales Komarek | e5a1ed6 | 2016-08-27 12:02:48 +0200 | [diff] [blame] | 111 | Agent (former slave) |
| 112 | -------------------- |
Filip Pytloun | 8bfd2bf | 2015-10-06 16:28:32 +0200 | [diff] [blame] | 113 | |
| 114 | .. code-block:: yaml |
| 115 | |
Ales Komarek | 4c0bab1 | 2016-01-22 12:10:50 +0100 | [diff] [blame] | 116 | jenkins: |
| 117 | slave: |
| 118 | master: |
| 119 | host: jenkins.example.com |
| 120 | port: 80 |
Michael KutĂ˝ | 37a3595 | 2016-06-10 23:51:36 +0200 | [diff] [blame] | 121 | protocol: http |
Ales Komarek | 4c0bab1 | 2016-01-22 12:10:50 +0100 | [diff] [blame] | 122 | user: |
| 123 | name: jenkins_slave |
| 124 | password: dexiech6AepohthaiHook2iesh7ol5ook4Ov3leid3yek6daid2ooNg3Ee2oKeYo |
| 125 | gpg: |
| 126 | keypair_id: A76882D3 |
| 127 | public_key: | |
| 128 | -----BEGIN PGP PUBLIC KEY BLOCK----- |
| 129 | ... |
| 130 | private_key: | |
| 131 | -----BEGIN PGP PRIVATE KEY BLOCK----- |
| 132 | ... |
Ales Komarek | af967ee | 2016-08-31 19:38:50 +0200 | [diff] [blame] | 133 | |
Ales Komarek | e5a1ed6 | 2016-08-27 12:02:48 +0200 | [diff] [blame] | 134 | Client |
| 135 | ------ |
| 136 | |
| 137 | Simple client with workflow job definition |
| 138 | |
| 139 | .. code-block:: yaml |
| 140 | |
| 141 | jenkins: |
| 142 | client: |
| 143 | master: |
| 144 | host: jenkins.example.com |
| 145 | port: 80 |
| 146 | protocol: http |
| 147 | job: |
| 148 | jobname: |
| 149 | type: workflow |
| 150 | param: |
| 151 | bool_param: |
| 152 | type: boolean |
| 153 | description: true/false |
| 154 | default: true |
| 155 | string_param: |
| 156 | type: string |
| 157 | description: 1 liner |
| 158 | default: default_string |
| 159 | text_param: |
| 160 | type: text |
| 161 | description: multi-liner |
| 162 | default: default_text |
Filip Pytloun | ebd4d17 | 2016-09-01 14:23:20 +0200 | [diff] [blame] | 163 | jobname_scm: |
| 164 | type: workflow-scm |
| 165 | concurrent: false |
| 166 | scm: |
| 167 | type: git |
| 168 | url: https://github.com/jenkinsci/docker.git |
| 169 | branch: master |
| 170 | script: Jenkinsfile |
| 171 | github: |
| 172 | url: https://github.com/jenkinsci/docker |
| 173 | name: "Jenkins Docker Image" |
| 174 | trigger: |
| 175 | github: |
| 176 | pollscm: |
| 177 | spec: "H/15 * * * *" |
| 178 | reverse: |
| 179 | projects: |
| 180 | - test1 |
| 181 | - test2 |
| 182 | state: SUCCESS |
| 183 | param: |
| 184 | bool_param: |
| 185 | type: boolean |
| 186 | description: true/false |
| 187 | default: true |
| 188 | string_param: |
| 189 | type: string |
| 190 | description: 1 liner |
| 191 | default: default_string |
| 192 | text_param: |
| 193 | type: text |
| 194 | description: multi-liner |
| 195 | default: default_text |
Ales Komarek | e5a1ed6 | 2016-08-27 12:02:48 +0200 | [diff] [blame] | 196 | |
Ales Komarek | daf31f7 | 2016-08-29 11:00:13 +0200 | [diff] [blame] | 197 | Inline Groovy script samples |
Ales Komarek | e5a1ed6 | 2016-08-27 12:02:48 +0200 | [diff] [blame] | 198 | |
| 199 | .. code-block:: yaml |
| 200 | |
| 201 | jenkins: |
| 202 | client: |
| 203 | job: |
| 204 | test_workflow_jenkins_simple: |
| 205 | type: workflow |
| 206 | display_name: Test jenkins simple workflow |
Ales Komarek | 5b672fd | 2016-08-29 16:05:03 +0200 | [diff] [blame] | 207 | script: |
| 208 | content: | |
| 209 | node { |
| 210 | stage 'Stage 1' |
| 211 | echo 'Hello World 1' |
| 212 | stage 'Stage 2' |
| 213 | echo 'Hello World 2' |
| 214 | } |
Ales Komarek | e5a1ed6 | 2016-08-27 12:02:48 +0200 | [diff] [blame] | 215 | test_workflow_jenkins_input: |
| 216 | type: workflow |
| 217 | display_name: Test jenkins workflow inputs |
Ales Komarek | 5b672fd | 2016-08-29 16:05:03 +0200 | [diff] [blame] | 218 | script: |
| 219 | content: | |
| 220 | node { |
| 221 | stage 'Enter string' |
| 222 | input message: 'Enter job parameters', ok: 'OK', parameters: [ |
| 223 | string(defaultValue: 'default', description: 'Enter a string.', name: 'string'), |
| 224 | ] |
| 225 | stage 'Enter boolean' |
| 226 | input message: 'Enter job parameters', ok: 'OK', parameters: [ |
| 227 | booleanParam(defaultValue: false, description: 'Select boolean.', name: 'Bool'), |
| 228 | ] |
| 229 | stage 'Enter text' |
| 230 | input message: 'Enter job parameters', ok: 'OK', parameters: [ |
| 231 | text(defaultValue: '', description: 'Enter multiline', name: 'Multiline') |
| 232 | ] |
| 233 | } |
Ales Komarek | e5a1ed6 | 2016-08-27 12:02:48 +0200 | [diff] [blame] | 234 | |
Filip Pytloun | 8bfd2bf | 2015-10-06 16:28:32 +0200 | [diff] [blame] | 235 | |
Ales Komarek | daf31f7 | 2016-08-29 11:00:13 +0200 | [diff] [blame] | 236 | GIT controlled groovy script samples |
| 237 | |
| 238 | .. code-block:: yaml |
| 239 | |
| 240 | jenkins: |
| 241 | client: |
| 242 | source: |
Ales Komarek | 5b672fd | 2016-08-29 16:05:03 +0200 | [diff] [blame] | 243 | base: |
| 244 | engine: git |
| 245 | address: repo_url |
| 246 | branch: branch |
| 247 | domain: |
| 248 | engine: git |
| 249 | address: domain_url |
| 250 | branch: branch |
Ales Komarek | daf31f7 | 2016-08-29 11:00:13 +0200 | [diff] [blame] | 251 | job: |
| 252 | test_workflow_jenkins_simple: |
| 253 | type: workflow |
| 254 | display_name: Test jenkins simple workflow |
Ales Komarek | 5b672fd | 2016-08-29 16:05:03 +0200 | [diff] [blame] | 255 | param: |
| 256 | bool_param: |
| 257 | type: boolean |
| 258 | description: true/false |
| 259 | default: true |
| 260 | script: |
| 261 | repository: base |
| 262 | file: workflows/test_workflow_jenkins_simple.groovy |
Ales Komarek | daf31f7 | 2016-08-29 11:00:13 +0200 | [diff] [blame] | 263 | test_workflow_jenkins_input: |
| 264 | type: workflow |
| 265 | display_name: Test jenkins workflow inputs |
Ales Komarek | 5b672fd | 2016-08-29 16:05:03 +0200 | [diff] [blame] | 266 | script: |
| 267 | repository: domain |
| 268 | file: workflows/test_workflow_jenkins_input.groovy |
| 269 | test_workflow_jenkins_input_jenkinsfile: |
| 270 | type: workflow |
| 271 | display_name: Test jenkins workflow inputs (jenknisfile) |
| 272 | script: |
| 273 | repository: domain |
| 274 | file: workflows/test_workflow_jenkins_input/Jenkinsfile |
Ales Komarek | daf31f7 | 2016-08-29 11:00:13 +0200 | [diff] [blame] | 275 | |
Ales Komarek | 5b672fd | 2016-08-29 16:05:03 +0200 | [diff] [blame] | 276 | GIT controlled groovy script with shared libraries |
| 277 | |
| 278 | .. code-block:: yaml |
| 279 | |
| 280 | jenkins: |
| 281 | client: |
| 282 | source: |
| 283 | base: |
| 284 | engine: git |
| 285 | address: repo_url |
| 286 | branch: branch |
| 287 | domain: |
| 288 | engine: git |
| 289 | address: domain_url |
| 290 | branch: branch |
| 291 | job: |
| 292 | test_workflow_jenkins_simple: |
| 293 | type: workflow |
| 294 | display_name: Test jenkins simple workflow |
| 295 | param: |
| 296 | bool_param: |
| 297 | type: boolean |
| 298 | description: true/false |
| 299 | default: true |
| 300 | script: |
| 301 | repository: base |
| 302 | file: workflows/test_workflow_jenkins_simple.groovy |
| 303 | libs: |
| 304 | - repository: base |
| 305 | file: macros/cookiecutter.groovy |
| 306 | - repository: base |
| 307 | file: macros/git.groovy |
Ales Komarek | daf31f7 | 2016-08-29 11:00:13 +0200 | [diff] [blame] | 308 | |
Jakub Josef | 10b4e10 | 2017-01-05 18:18:41 +0100 | [diff] [blame] | 309 | Plugins management from client |
| 310 | |
| 311 | .. code-block:: yaml |
| 312 | |
| 313 | |
| 314 | jenkins: |
| 315 | client: |
| 316 | plugin: |
| 317 | swarm: |
| 318 | restart: false |
| 319 | hipchat: |
| 320 | enabled: false |
| 321 | restart: true |
| 322 | |
Jakub Josef | 063a753 | 2017-01-11 15:48:01 +0100 | [diff] [blame] | 323 | LDAP configuration (depends on LDAP plugin) |
| 324 | |
| 325 | .. code-block:: yaml |
| 326 | |
| 327 | jenkins: |
| 328 | client: |
| 329 | security: |
| 330 | ldap: |
| 331 | server: 1.2.3.4 |
| 332 | root_dn: dc=foo,dc=com |
| 333 | user_search_base: cn=users,cn=accounts |
| 334 | manager_dn: "" |
| 335 | manager_password: password |
| 336 | user_search: "" |
| 337 | group_search_base: "" |
| 338 | inhibit_infer_root_dn: false |
| 339 | |
| 340 | |
| 341 | Matrix configuration (depends on auth-matrix plugin) |
| 342 | |
| 343 | .. code-block:: yaml |
| 344 | |
| 345 | jenkins: |
| 346 | client: |
| 347 | security: |
| 348 | matrix: |
Jakub Josef | 0ee470e | 2017-01-17 11:46:58 +0100 | [diff] [blame] | 349 | # set true for use ProjectMatrixAuthStrategy instead of GlobalMatrixAuthStrategy |
| 350 | project_based: false |
Jakub Josef | 063a753 | 2017-01-11 15:48:01 +0100 | [diff] [blame] | 351 | permissions: |
| 352 | Jenkins: |
| 353 | # administrator access |
| 354 | ADMINISTER: |
| 355 | - admin |
| 356 | # read access (anonymous too) |
| 357 | READ: |
| 358 | - anonymous |
| 359 | - user1 |
| 360 | - user2 |
| 361 | # agents permissions |
| 362 | MasterComputer: |
| 363 | BUILD: |
| 364 | - user3 |
| 365 | # jobs permissions |
| 366 | hudson: |
| 367 | model: |
| 368 | Item: |
| 369 | BUILD: |
| 370 | - user4 |
| 371 | |
| 372 | `Common matrix strategies <https://github.com/arbabnazar/configuration/blob/c08a5eaf4e04a68d2481375502a926517097b253/playbooks/roles/tools_jenkins/templates/projectBasedMatrixSecurity.groovy.j2>`_ |
| 373 | |
Jakub Josef | 7bb17ab | 2017-01-12 14:52:53 +0100 | [diff] [blame] | 374 | Views enforcing from client |
| 375 | |
| 376 | .. code-block:: yaml |
| 377 | |
| 378 | jenkins: |
| 379 | client: |
| 380 | view: |
| 381 | my-list-view: |
| 382 | enabled: true |
| 383 | type: ListView |
| 384 | include_regex: ".\*." |
| 385 | my-view: |
| 386 | # set false to disable |
| 387 | enabled: true |
| 388 | type: MyView |
| 389 | |
| 390 | View specific params: |
| 391 | |
| 392 | - include_regex for ListView |
| 393 | |
Jakub Josef | 063a753 | 2017-01-11 15:48:01 +0100 | [diff] [blame] | 394 | |
Jakub Josef | 123be7a | 2016-12-12 16:02:36 +0100 | [diff] [blame] | 395 | Credentials enforcing from client |
| 396 | |
| 397 | .. code-block:: yaml |
| 398 | |
| 399 | jenkins: |
| 400 | client: |
| 401 | credential: |
| 402 | cred_first: |
| 403 | username: admin |
| 404 | password: password |
| 405 | cred_second: |
| 406 | username: salt |
| 407 | password: password |
| 408 | cred_with_key: |
| 409 | username: admin |
| 410 | key: SOMESSHKEY |
| 411 | |
| 412 | Users enforcing from client |
| 413 | |
| 414 | .. code-block:: yaml |
| 415 | |
| 416 | jenkins: |
| 417 | client: |
| 418 | user: |
| 419 | admin: |
| 420 | password: admin_password |
| 421 | admin: true |
| 422 | user01: |
| 423 | password: user_password |
| 424 | |
| 425 | Node enforcing from client using JNLP launcher |
| 426 | |
| 427 | .. code-block:: yaml |
| 428 | |
| 429 | jenkins: |
| 430 | client: |
| 431 | node: |
| 432 | node01: |
| 433 | remote_home: /remote/home/path |
| 434 | desc: node-description |
| 435 | num_executors: 1 |
| 436 | node_mode: Normal |
| 437 | ret_strategy: Always |
Jakub Josef | 98123ab | 2016-12-14 14:05:01 +0100 | [diff] [blame] | 438 | labels: |
| 439 | - example |
| 440 | - label |
Jakub Josef | 123be7a | 2016-12-12 16:02:36 +0100 | [diff] [blame] | 441 | launcher: |
| 442 | type: jnlp |
| 443 | |
| 444 | Node enforcing from client using SSH launcher |
| 445 | |
| 446 | .. code-block:: yaml |
| 447 | |
| 448 | jenkins: |
| 449 | client: |
| 450 | node: |
| 451 | node01: |
| 452 | remote_home: /remote/home/path |
| 453 | desc: node-description |
| 454 | num_executors: 1 |
| 455 | node_mode: Normal |
| 456 | ret_strategy: Always |
Jakub Josef | 98123ab | 2016-12-14 14:05:01 +0100 | [diff] [blame] | 457 | labels: |
| 458 | - example |
| 459 | - label |
Jakub Josef | 123be7a | 2016-12-12 16:02:36 +0100 | [diff] [blame] | 460 | launcher: |
| 461 | type: ssh |
| 462 | host: test-launcher |
| 463 | port: 22 |
| 464 | username: launcher-user |
| 465 | password: launcher-pass |
| 466 | |
| 467 | Setting node labels |
| 468 | |
| 469 | .. code-block:: yaml |
| 470 | |
| 471 | jenkins: |
| 472 | client: |
| 473 | label: |
| 474 | node-name: |
| 475 | lbl_text: label-offline |
| 476 | append: false # set true for label append instead of replace |
| 477 | |
Jakub Josef | 60cc9d2 | 2017-01-18 12:02:14 +0100 | [diff] [blame^] | 478 | SMTP server settings from master |
Jakub Josef | d8e0429 | 2016-11-28 18:02:27 +0100 | [diff] [blame] | 479 | |
| 480 | .. code-block:: yaml |
| 481 | |
| 482 | jenkins: |
| 483 | master: |
| 484 | email: |
| 485 | engine: "smtp" |
| 486 | host: "smtp.domain.com" |
| 487 | user: "user@domain.cz" |
| 488 | password: "smtp-password" |
| 489 | port: 25 |
| 490 | |
Jakub Josef | 60cc9d2 | 2017-01-18 12:02:14 +0100 | [diff] [blame^] | 491 | SMTP server settings from client |
| 492 | |
| 493 | .. code-block:: yaml |
| 494 | |
| 495 | jenkins: |
| 496 | client: |
| 497 | smtp: |
| 498 | host: "smtp.domain.com" |
| 499 | username: "user@domain.cz" |
| 500 | password: "smtp-password" |
| 501 | port: 25 |
| 502 | ssl: false |
| 503 | reply_to: reply_to@address.com |
| 504 | |
Jakub Josef | d8e0429 | 2016-11-28 18:02:27 +0100 | [diff] [blame] | 505 | Jenkins script approvals |
| 506 | |
| 507 | .. code-block:: yaml |
| 508 | |
| 509 | jenkins: |
| 510 | master: |
| 511 | approved_scripts: |
| 512 | - method groovy.json.JsonSlurperClassic parseText java.lang.String |
| 513 | |
Jakub Josef | d8e0429 | 2016-11-28 18:02:27 +0100 | [diff] [blame] | 514 | |
Jakub Josef | 123be7a | 2016-12-12 16:02:36 +0100 | [diff] [blame] | 515 | Users enforcing from master |
Jakub Josef | d8e0429 | 2016-11-28 18:02:27 +0100 | [diff] [blame] | 516 | |
| 517 | .. code-block:: yaml |
| 518 | |
| 519 | jenkins: |
| 520 | user: |
| 521 | admin: |
| 522 | api_token: xxxxxxxxxx |
| 523 | password: admin_password |
| 524 | email: admin@domain.com |
| 525 | user01: |
| 526 | api_token: xxxxxxxxxx |
| 527 | password: user_password |
| 528 | email: user01@domain.com |
| 529 | |
Ales Komarek | 4c0bab1 | 2016-01-22 12:10:50 +0100 | [diff] [blame] | 530 | Usage |
| 531 | ===== |
Filip Pytloun | 8bfd2bf | 2015-10-06 16:28:32 +0200 | [diff] [blame] | 532 | |
Ales Komarek | 4c0bab1 | 2016-01-22 12:10:50 +0100 | [diff] [blame] | 533 | Generate password hash: |
| 534 | |
| 535 | .. code-block:: bash |
| 536 | |
| 537 | echo -n "salt{plainpassword}" | openssl dgst -sha256 |
| 538 | |
| 539 | Place in the configuration ``salt:hashpassword``. |
Filip Pytloun | 8bfd2bf | 2015-10-06 16:28:32 +0200 | [diff] [blame] | 540 | |
| 541 | Read more |
| 542 | ========= |
| 543 | |
| 544 | * https://wiki.jenkins-ci.org/display/JENKINS/Use+Jenkins |