blob: 2faaa29e4b5f019b9536393e35741b9d10437722 [file] [log] [blame]
Ghanshyam Mann61f57332020-11-25 11:46:20 -06001# NOTE(gmann): This file includes all integrated jobs definition which
2# are supposed to be run by Tempest and other projects as
3# integrated testing.
4- job:
5 name: tempest-all
6 parent: devstack-tempest
7 description: |
8 Integration test that runs all tests.
9 Former name for this job was:
10 * legacy-periodic-tempest-dsvm-all-master
11 vars:
12 tox_envlist: all
13 tempest_test_regex: tempest
Ghanshyam Mann861c78f2021-02-09 11:25:26 -060014 # TODO(gmann): Enable File injection tests once nova bug is fixed
15 # https://bugs.launchpad.net/nova/+bug/1882421
16 # devstack_localrc:
17 # ENABLE_FILE_INJECTION: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -060018
19- job:
20 name: tempest-ipv6-only
21 parent: devstack-tempest-ipv6
22 # This currently works from stable/pike on.
23 branches: ^(?!stable/ocata).*$
24 description: |
25 Integration test of IPv6-only deployments. This job runs
26 smoke and IPv6 relates tests only. Basic idea is to test
27 whether OpenStack Services listen on IPv6 addrress or not.
28 timeout: 10800
29 vars:
30 tox_envlist: ipv6-only
31
32- job:
33 name: tempest-full
34 parent: devstack-tempest
35 # This currently works from stable/pike on.
36 # Before stable/pike, legacy version of tempest-full
37 # 'legacy-tempest-dsvm-neutron-full' run.
38 branches: ^(?!stable/ocata).*$
39 description: |
40 Base integration test with Neutron networking and py27.
41 This job is supposed to run until stable/train setup only.
42 If you are running it on stable/ussuri gate onwards for python2.7
43 coverage then you need to do override-checkout with any stable
44 branch less than or equal to stable/train.
45 Former names for this job where:
46 * legacy-tempest-dsvm-neutron-full
47 * gate-tempest-dsvm-neutron-full-ubuntu-xenial
48 vars:
49 tox_envlist: full
50 devstack_localrc:
51 ENABLE_FILE_INJECTION: true
52 ENABLE_VOLUME_MULTIATTACH: true
53 USE_PYTHON3: False
54 devstack_services:
55 # NOTE(mriedem): Disable the cinder-backup service from tempest-full
56 # since tempest-full is in the integrated-gate project template but
57 # the backup tests do not really involve other services so they should
58 # be run in some more cinder-specific job, especially because the
59 # tests fail at a high rate (see bugs 1483434, 1813217, 1745168)
60 c-bak: false
61
62- job:
63 name: tempest-full-py3
64 parent: devstack-tempest
Ghanshyam Mann0ead7532020-12-29 13:22:26 -060065 # This job version is with swift enabled on py3
66 # as swift is ready on py3 from stable/ussuri onwards.
67 branches: ^(?!stable/(ocata|pike|queens|rocky|stein|train)).*$
68 description: |
Ghanshyam Mann4e2a6ff2021-06-02 12:14:26 -050069 Base integration test with Neutron networking, horizon, swift enable,
70 and py3.
Ghanshyam Mann0ead7532020-12-29 13:22:26 -060071 Former names for this job where:
72 * legacy-tempest-dsvm-py35
73 * gate-tempest-dsvm-py35
Ghanshyam Mann4e2a6ff2021-06-02 12:14:26 -050074 required-projects:
75 - openstack/horizon
Ghanshyam Mann0ead7532020-12-29 13:22:26 -060076 vars:
77 tox_envlist: full
78 devstack_localrc:
79 USE_PYTHON3: true
80 FORCE_CONFIG_DRIVE: true
81 ENABLE_VOLUME_MULTIATTACH: true
82 GLANCE_USE_IMPORT_WORKFLOW: True
Ghanshyam Mann4e2a6ff2021-06-02 12:14:26 -050083 devstack_plugins:
84 neutron: https://opendev.org/openstack/neutron
85 devstack_local_conf:
86 post-config:
87 "/$NEUTRON_CORE_PLUGIN_CONF":
88 ovs:
89 bridge_mappings: public:br-ex
90 resource_provider_bandwidths: br-ex:1000000:1000000
91 test-config:
92 $TEMPEST_CONFIG:
93 network-feature-enabled:
94 qos_placement_physnet: public
95 devstack_services:
96 # Enbale horizon so that we can run horizon test.
97 horizon: true
98 neutron-placement: true
99 neutron-qos: true
Ghanshyam Mann0ead7532020-12-29 13:22:26 -0600100
101- job:
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600102 name: tempest-integrated-networking
103 parent: devstack-tempest
104 branches: ^(?!stable/ocata).*$
105 description: |
106 This job runs integration tests for networking. This is subset of
107 'tempest-full-py3' job and run only Neutron and Nova related tests.
108 This is meant to be run on neutron gate only.
109 vars:
110 tox_envlist: integrated-network
111 devstack_localrc:
112 USE_PYTHON3: true
113 FORCE_CONFIG_DRIVE: true
114 devstack_services:
115 s-account: false
116 s-container: false
117 s-object: false
118 s-proxy: false
119 c-bak: false
120
121- job:
122 name: tempest-integrated-compute
123 parent: devstack-tempest
124 branches: ^(?!stable/ocata).*$
125 description: |
126 This job runs integration tests for compute. This is
127 subset of 'tempest-full-py3' job and run Nova, Neutron, Cinder (except backup tests)
128 and Glance related tests. This is meant to be run on Nova gate only.
129 vars:
130 tox_envlist: integrated-compute
Ghanshyam Mann4fa15342021-02-11 13:28:53 -0600131 tempest_exclude_regex: ""
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600132 devstack_localrc:
133 USE_PYTHON3: true
134 FORCE_CONFIG_DRIVE: true
135 ENABLE_VOLUME_MULTIATTACH: true
136 devstack_services:
137 s-account: false
138 s-container: false
139 s-object: false
140 s-proxy: false
141 c-bak: false
142
143- job:
144 name: tempest-integrated-placement
145 parent: devstack-tempest
146 branches: ^(?!stable/ocata).*$
147 description: |
148 This job runs integration tests for placement. This is
149 subset of 'tempest-full-py3' job and run Nova and Neutron
150 related tests. This is meant to be run on Placement gate only.
151 vars:
152 tox_envlist: integrated-placement
153 devstack_localrc:
154 USE_PYTHON3: true
155 FORCE_CONFIG_DRIVE: true
156 ENABLE_VOLUME_MULTIATTACH: true
157 devstack_services:
158 s-account: false
159 s-container: false
160 s-object: false
161 s-proxy: false
162 c-bak: false
163
164- job:
165 name: tempest-integrated-storage
166 parent: devstack-tempest
167 branches: ^(?!stable/ocata).*$
168 description: |
169 This job runs integration tests for image & block storage. This is
170 subset of 'tempest-full-py3' job and run Cinder, Glance, Swift and Nova
171 related tests. This is meant to be run on Cinder and Glance gate only.
172 vars:
173 tox_envlist: integrated-storage
174 devstack_localrc:
175 USE_PYTHON3: true
176 FORCE_CONFIG_DRIVE: true
177 ENABLE_VOLUME_MULTIATTACH: true
178 GLANCE_USE_IMPORT_WORKFLOW: True
179
180- job:
181 name: tempest-integrated-object-storage
182 parent: devstack-tempest
183 branches: ^(?!stable/ocata).*$
184 description: |
185 This job runs integration tests for object storage. This is
186 subset of 'tempest-full-py3' job and run Swift, Cinder and Glance
187 related tests. This is meant to be run on Swift gate only.
188 vars:
189 tox_envlist: integrated-object-storage
190 devstack_localrc:
191 # NOTE(gmann): swift is not ready on python3 yet and devstack
192 # install it on python2.7 only. But settting the USE_PYTHON3
193 # for future once swift is ready on py3.
194 USE_PYTHON3: true
195
196- job:
Ghanshyam Mannba28d782021-09-03 10:21:54 -0500197 name: tempest-with-latest-microversion
198 parent: tempest-full-py3
199 description: |
200 This job runs compute, placement and volume API tests with 'latest'
201 API microversion (This can be extended to other services having API
202 microversion concept).
203 vars:
204 tox_envlist: api-microversion-tests
205 devstack_localrc:
206 TEMPEST_COMPUTE_MIN_MICROVERSION: 'latest'
207 TEMPEST_VOLUME_MIN_MICROVERSION: 'latest'
208 TEMPEST_PLACEMENT_MIN_MICROVERSION: 'latest'
209
210- job:
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600211 name: tempest-multinode-full
212 parent: tempest-multinode-full-base
213 nodeset: openstack-two-node-focal
214 # This job runs on Focal from stable/victoria on.
215 branches: ^(?!stable/(ocata|pike|queens|rocky|stein|train|ussuri)).*$
216 vars:
217 devstack_localrc:
218 USE_PYTHON3: False
219 group-vars:
220 subnode:
221 devstack_localrc:
222 USE_PYTHON3: False
223
224- job:
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600225 name: tempest-multinode-full-py3
226 parent: tempest-multinode-full
227 vars:
228 devstack_localrc:
229 USE_PYTHON3: true
elajkat064a3402019-10-17 13:18:10 +0200230 devstack_plugins:
231 neutron: https://opendev.org/openstack/neutron
232 devstack_local_conf:
233 post-config:
234 "/$NEUTRON_CORE_PLUGIN_CONF":
235 ovs:
236 bridge_mappings: public:br-ex
237 resource_provider_bandwidths: br-ex:1000000:1000000
238 test-config:
239 $TEMPEST_CONFIG:
240 network-feature-enabled:
241 qos_placement_physnet: public
242 devstack_services:
243 neutron-placement: true
244 neutron-qos: true
elajkat0b14db22021-02-08 16:43:59 +0100245 neutron-trunk: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600246 group-vars:
247 subnode:
248 devstack_localrc:
249 USE_PYTHON3: true
Slawek Kaplonski24762612021-03-03 13:34:19 +0100250 devstack_local_conf:
251 post-config:
252 "/$NEUTRON_CORE_PLUGIN_CONF":
253 ovs:
254 bridge_mappings: public:br-ex
255 resource_provider_bandwidths: br-ex:1000000:1000000
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600256
257- job:
258 name: tempest-slow
259 parent: tempest-multinode-full
260 description: |
261 This multinode integration job will run all the tests tagged as slow.
262 It enables the lvm multibackend setup to cover few scenario tests.
263 This job will run only slow tests (API or Scenario) serially.
264
265 Former names for this job were:
266 * legacy-tempest-dsvm-neutron-scenario-multinode-lvm-multibackend
267 * tempest-scenario-multinode-lvm-multibackend
268 timeout: 10800
Hemanth Nakkinaf4bd5542021-02-10 09:12:14 +0530269 # This job runs on stable/stein onwards.
270 branches: ^(?!stable/(ocata|pike|queens|rocky)).*$
Luigi Toscanob9ac0572021-07-13 12:44:35 +0200271 vars: &tempest_slow_vars
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600272 tox_envlist: slow-serial
273 devstack_localrc:
274 CINDER_ENABLED_BACKENDS: lvm:lvmdriver-1,lvm:lvmdriver-2
275 ENABLE_VOLUME_MULTIATTACH: true
276 devstack_plugins:
277 neutron: https://opendev.org/openstack/neutron
278 devstack_services:
279 neutron-placement: true
280 neutron-qos: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600281 tempest_concurrency: 2
282 group-vars:
283 # NOTE(mriedem): The ENABLE_VOLUME_MULTIATTACH variable is used on both
284 # the controller and subnode prior to Rocky so we have to make sure the
285 # variable is set in both locations.
286 subnode:
287 devstack_localrc:
288 ENABLE_VOLUME_MULTIATTACH: true
289
290- job:
291 name: tempest-slow-py3
Luigi Toscanob9ac0572021-07-13 12:44:35 +0200292 parent: tempest-multinode-full-py3
Ghanshyam Mannebecf792021-06-14 17:09:35 -0500293 # This job version is with swift enabled on py3
294 # as swift is ready on py3 from stable/ussuri onwards.
Luigi Toscanob9ac0572021-07-13 12:44:35 +0200295 timeout: 10800
Ghanshyam Mannebecf792021-06-14 17:09:35 -0500296 branches: ^(?!stable/(ocata|pike|queens|rocky|stein|train)).*$
Luigi Toscanob9ac0572021-07-13 12:44:35 +0200297 vars: *tempest_slow_vars
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600298
299- job:
300 name: tempest-cinder-v2-api
301 parent: devstack-tempest
Ghanshyam Mann2f4539d2021-05-18 12:32:39 -0500302 # NOTE(gmann): Cinder v2 APIs are available until
303 # stable/wallaby only.
304 override-checkout: stable/wallaby
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600305 description: |
306 This job runs the cinder API test against v2 endpoint.
307 vars:
308 tox_envlist: all
309 tempest_test_regex: api.*volume
310 devstack_localrc:
311 TEMPEST_VOLUME_TYPE: volumev2
312
313- job:
314 name: tempest-pg-full
315 parent: tempest-full-py3
316 description: |
317 Base integration test with Neutron networking and PostgreSQL.
318 Former name for this job was legacy-tempest-dsvm-neutron-pg-full.
319 vars:
320 devstack_localrc:
Ghanshyam Mann861c78f2021-02-09 11:25:26 -0600321 # TODO(gmann): Enable File injection tests once nova bug is fixed
322 # https://bugs.launchpad.net/nova/+bug/1882421
323 # ENABLE_FILE_INJECTION: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600324 DATABASE_TYPE: postgresql
325
326- project-template:
327 name: integrated-gate-networking
328 description: |
329 Run the python3 Tempest network integration tests (Nova and Neutron related)
330 in check and gate for the neutron integrated gate. This is meant to be
331 run on neutron gate only.
332 check:
333 jobs:
334 - grenade
335 - tempest-integrated-networking
336 gate:
337 jobs:
338 - grenade
339 - tempest-integrated-networking
340
341- project-template:
342 name: integrated-gate-compute
343 description: |
344 Run the python3 Tempest compute integration tests
345 (Nova, Neutron, Cinder and Glance related) in check and gate
346 for the Nova integrated gate. This is meant to be
347 run on Nova gate only.
348 check:
349 jobs:
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600350 - tempest-integrated-compute
351 gate:
352 jobs:
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600353 - tempest-integrated-compute
354
355- project-template:
356 name: integrated-gate-placement
357 description: |
358 Run the python3 Tempest placement integration tests
359 (Nova and Neutron related) in check and gate
360 for the Placement integrated gate. This is meant to be
361 run on Placement gate only.
362 check:
363 jobs:
364 - grenade
365 - tempest-integrated-placement
366 gate:
367 jobs:
368 - grenade
369 - tempest-integrated-placement
370
371- project-template:
372 name: integrated-gate-storage
373 description: |
374 Run the python3 Tempest image & block storage integration tests
375 (Cinder, Glance, Swift and Nova related) in check and gate
376 for the neutron integrated gate. This is meant to be
377 run on Cinder and Glance gate only.
378 check:
379 jobs:
380 - grenade
381 - tempest-integrated-storage
382 gate:
383 jobs:
384 - grenade
385 - tempest-integrated-storage
386
387- project-template:
388 name: integrated-gate-object-storage
389 description: |
390 Run the python3 Tempest object storage integration tests
391 (Swift, Cinder and Glance related) in check and gate
392 for the swift integrated gate. This is meant to be
393 run on swift gate only.
394 check:
395 jobs:
396 - grenade
397 - tempest-integrated-object-storage
398 gate:
399 jobs:
400 - grenade
401 - tempest-integrated-object-storage