blob: 47b78127fe12f10952d4b1908ca6fb4e37e8c5ce [file] [log] [blame]
Ghanshyam Mann61f57332020-11-25 11:46:20 -06001# NOTE(gmann): This file includes all integrated jobs definition which
2# are supposed to be run by Tempest and other projects as
3# integrated testing.
4- job:
5 name: tempest-all
6 parent: devstack-tempest
7 description: |
8 Integration test that runs all tests.
9 Former name for this job was:
10 * legacy-periodic-tempest-dsvm-all-master
Martin Kopec86ee1152024-01-31 18:19:52 +010011 timeout: 10800
Ghanshyam Mann61f57332020-11-25 11:46:20 -060012 vars:
13 tox_envlist: all
14 tempest_test_regex: tempest
Dan Smithd869e3a2023-02-13 14:14:52 -080015 devstack_localrc:
16 MYSQL_REDUCE_MEMORY: true
17 # TODO(gmann): Enable File injection tests once nova bug is fixed
18 # https://bugs.launchpad.net/nova/+bug/1882421
19 # ENABLE_FILE_INJECTION: true
Martin Kopec1a9c40d2024-05-09 13:30:43 +020020 run_tempest_cleanup: true
21 run_tempest_cleanup_resource_list: true
22 devstack_local_conf:
23 test-config:
24 $TEMPEST_CONFIG:
25 DEFAULT:
26 record_resources: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -060027
28- job:
29 name: tempest-ipv6-only
30 parent: devstack-tempest-ipv6
Ghanshyam Mann61f57332020-11-25 11:46:20 -060031 description: |
32 Integration test of IPv6-only deployments. This job runs
33 smoke and IPv6 relates tests only. Basic idea is to test
Rajesh Tailora85bdb42024-04-02 12:01:53 +053034 whether OpenStack Services listen on IPv6 address or not.
Ghanshyam Mann61f57332020-11-25 11:46:20 -060035 timeout: 10800
36 vars:
37 tox_envlist: ipv6-only
38
39- job:
Ghanshyam Mann518e4262023-02-10 19:57:36 -060040 name: tempest-extra-tests
Ghanshyam Manneb85cec2023-03-15 14:19:03 -050041 parent: tempest-full-py3
Ghanshyam Mann518e4262023-02-10 19:57:36 -060042 description: |
43 This job runs the extra tests mentioned in
44 tools/tempest-extra-tests-list.txt.
Ghanshyam Mann14f199e2024-12-13 12:26:10 -080045 # NOTE(gmann): We need c-t-p as this job run c-t-p tests also.
46 required-projects:
47 - opendev.org/openstack/cinder-tempest-plugin
Ghanshyam Mann518e4262023-02-10 19:57:36 -060048 vars:
49 tox_envlist: extra-tests
Ghanshyam Mann14f199e2024-12-13 12:26:10 -080050 tempest_plugins:
51 - cinder-tempest-plugin
Martin Kopec1a9c40d2024-05-09 13:30:43 +020052 run_tempest_cleanup: true
53 run_tempest_cleanup_resource_list: true
54 run_tempest_dry_cleanup: true
Ghanshyam Mann14f199e2024-12-13 12:26:10 -080055 devstack_localrc:
56 CINDER_ENFORCE_SCOPE: true
Martin Kopec1a9c40d2024-05-09 13:30:43 +020057 devstack_local_conf:
58 test-config:
59 $TEMPEST_CONFIG:
60 DEFAULT:
61 record_resources: true
Ghanshyam Mann518e4262023-02-10 19:57:36 -060062
63- job:
Ghanshyam Mann61f57332020-11-25 11:46:20 -060064 name: tempest-full-py3
65 parent: devstack-tempest
Ghanshyam Mann0ead7532020-12-29 13:22:26 -060066 # This job version is with swift enabled on py3
67 # as swift is ready on py3 from stable/ussuri onwards.
Ghanshyam Mann11d4fc92023-02-21 13:29:44 -080068 # As this use 'integrated-full' tox env which is not
69 # available in old tempest used till stable/wallaby,
70 # this job definition is only for stable/xena onwards
71 # and separate job definition until stable/wallaby
Martin Kopecc52304f2023-09-20 09:13:08 +020072 branches:
yatinkarel1c5f3412024-03-07 17:22:44 +053073 regex: ^.*/(victoria|wallaby)$
Martin Kopecc52304f2023-09-20 09:13:08 +020074 negate: true
Sean Mooneyf207d292024-06-17 14:34:22 +010075 # NOTE(sean-k-mooney): this job and its descendants frequently times out
76 # run on rax-* providers with a timeout of 2 hours. temporary increase
77 # the timeout to 2.5 hours.
78 timeout: 9000
Ghanshyam Mann0ead7532020-12-29 13:22:26 -060079 description: |
Ghanshyam Mann4e2a6ff2021-06-02 12:14:26 -050080 Base integration test with Neutron networking, horizon, swift enable,
81 and py3.
Ghanshyam Mann0ead7532020-12-29 13:22:26 -060082 Former names for this job where:
83 * legacy-tempest-dsvm-py35
84 * gate-tempest-dsvm-py35
Ghanshyam Mann4e2a6ff2021-06-02 12:14:26 -050085 required-projects:
86 - openstack/horizon
Ghanshyam Mann0ead7532020-12-29 13:22:26 -060087 vars:
Ghanshyam Mann68a25ef2023-08-07 10:07:12 -070088 # NOTE(gmann): Default concurrency is higher (number of cpu -2) which
89 # end up 6 in upstream CI. Higher concurrency means high parallel
90 # requests to services and can cause more oom issues. To avoid the
91 # oom issue, setting the concurrency to 4 in this job.
Sean Mooneyf207d292024-06-17 14:34:22 +010092 # NOTE(sean-k-mooney): now that we use zswap we should be able to
93 # increase the concurrency to 6.
Ghanshyam Mann68a25ef2023-08-07 10:07:12 -070094 tempest_concurrency: 4
Ghanshyam Mann518e4262023-02-10 19:57:36 -060095 tox_envlist: integrated-full
Ghanshyam Mann0ead7532020-12-29 13:22:26 -060096 devstack_localrc:
97 USE_PYTHON3: true
98 FORCE_CONFIG_DRIVE: true
99 ENABLE_VOLUME_MULTIATTACH: true
100 GLANCE_USE_IMPORT_WORKFLOW: True
Ghanshyam Mann4e2a6ff2021-06-02 12:14:26 -0500101 devstack_plugins:
102 neutron: https://opendev.org/openstack/neutron
Ghanshyam Mann4e2a6ff2021-06-02 12:14:26 -0500103 devstack_services:
Rajesh Tailora85bdb42024-04-02 12:01:53 +0530104 # Enable horizon so that we can run horizon test.
Ghanshyam Mann4e2a6ff2021-06-02 12:14:26 -0500105 horizon: true
Ghanshyam Mann0ead7532020-12-29 13:22:26 -0600106
107- job:
Ghanshyam Mann3ed52102022-04-25 18:07:00 -0500108 name: tempest-full-centos-9-stream
109 parent: tempest-full-py3
110 nodeset: devstack-single-node-centos-9-stream
Ghanshyam Mann9625f0d2022-04-27 17:45:52 -0500111 # centos-9-stream is supported from yoga release onwards
Martin Kopecc52304f2023-09-20 09:13:08 +0200112 branches:
yatinkarel1c5f3412024-03-07 17:22:44 +0530113 regex: ^.*/(victoria|wallaby|xena)$
Martin Kopecc52304f2023-09-20 09:13:08 +0200114 negate: true
Ghanshyam Mann3ed52102022-04-25 18:07:00 -0500115 description: |
116 Base integration test on CentOS 9 stream
117 vars:
118 # Required until bug/1949606 is resolved when using libvirt and QEMU
119 # >=5.0.0 with a [libvirt]virt_type of qemu (TCG).
120 configure_swap_size: 4096
Ghanshyam Mann518e4262023-02-10 19:57:36 -0600121 tox_envlist: full
Ghanshyam Mann3ed52102022-04-25 18:07:00 -0500122
123- job:
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600124 name: tempest-integrated-networking
125 parent: devstack-tempest
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600126 description: |
127 This job runs integration tests for networking. This is subset of
128 'tempest-full-py3' job and run only Neutron and Nova related tests.
129 This is meant to be run on neutron gate only.
130 vars:
131 tox_envlist: integrated-network
132 devstack_localrc:
133 USE_PYTHON3: true
134 FORCE_CONFIG_DRIVE: true
135 devstack_services:
136 s-account: false
137 s-container: false
138 s-object: false
139 s-proxy: false
140 c-bak: false
141
142- job:
143 name: tempest-integrated-compute
144 parent: devstack-tempest
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600145 description: |
146 This job runs integration tests for compute. This is
147 subset of 'tempest-full-py3' job and run Nova, Neutron, Cinder (except backup tests)
148 and Glance related tests. This is meant to be run on Nova gate only.
Sean Mooneyf207d292024-06-17 14:34:22 +0100149 # NOTE(sean-k-mooney): this job and its descendants frequently times out
150 # when run on rax-* providers, recent optimizations have reduced the
151 # runtime of the job but it still times out. temporary increase the
152 # timeout to 2.5 hours.
153 timeout: 9000
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600154 vars:
Ghanshyam Mann68a25ef2023-08-07 10:07:12 -0700155 # NOTE(gmann): Default concurrency is higher (number of cpu -2) which
156 # end up 6 in upstream CI. Higher concurrency means high parallel
157 # requests to services and can cause more oom issues. To avoid the
158 # oom issue, setting the concurrency to 4 in this job.
Sean Mooneyf207d292024-06-17 14:34:22 +0100159 # NOTE(sean-k-mooney): now that we use zswap we should be able to
160 # increase the concurrency to 6.
Ghanshyam Mann68a25ef2023-08-07 10:07:12 -0700161 tempest_concurrency: 4
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600162 tox_envlist: integrated-compute
Ghanshyam Mann4fa15342021-02-11 13:28:53 -0600163 tempest_exclude_regex: ""
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600164 devstack_localrc:
165 USE_PYTHON3: true
166 FORCE_CONFIG_DRIVE: true
167 ENABLE_VOLUME_MULTIATTACH: true
168 devstack_services:
169 s-account: false
170 s-container: false
171 s-object: false
172 s-proxy: false
173 c-bak: false
174
175- job:
Ghanshyam Mann3ed52102022-04-25 18:07:00 -0500176 name: tempest-integrated-compute-centos-9-stream
Lee Yarwood0dba41c2021-06-23 10:47:44 +0100177 parent: tempest-integrated-compute
Ghanshyam Mann3ed52102022-04-25 18:07:00 -0500178 nodeset: devstack-single-node-centos-9-stream
Ghanshyam Mann9625f0d2022-04-27 17:45:52 -0500179 # centos-9-stream is supported from yoga release onwards
Martin Kopecc52304f2023-09-20 09:13:08 +0200180 branches:
yatinkarel1c5f3412024-03-07 17:22:44 +0530181 regex: ^.*/(victoria|wallaby|xena)$
Martin Kopecc52304f2023-09-20 09:13:08 +0200182 negate: true
Lee Yarwood0dba41c2021-06-23 10:47:44 +0100183 description: |
184 This job runs integration tests for compute. This is
185 subset of 'tempest-full-py3' job and run Nova, Neutron, Cinder (except backup tests)
186 and Glance related tests. This is meant to be run on Nova gate only.
Ghanshyam Mann3ed52102022-04-25 18:07:00 -0500187 This version of the job also uses CentOS 9 stream.
Lee Yarwood0dba41c2021-06-23 10:47:44 +0100188 vars:
189 # Required until bug/1949606 is resolved when using libvirt and QEMU
190 # >=5.0.0 with a [libvirt]virt_type of qemu (TCG).
191 configure_swap_size: 4096
192
193- job:
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600194 name: tempest-integrated-placement
195 parent: devstack-tempest
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600196 description: |
197 This job runs integration tests for placement. This is
198 subset of 'tempest-full-py3' job and run Nova and Neutron
199 related tests. This is meant to be run on Placement gate only.
200 vars:
Ghanshyam Mann68a25ef2023-08-07 10:07:12 -0700201 # NOTE(gmann): Default concurrency is higher (number of cpu -2) which
202 # end up 6 in upstream CI. Higher concurrency means high parallel
203 # requests to services and can cause more oom issues. To avoid the
204 # oom issue, setting the concurrency to 4 in this job.
205 tempest_concurrency: 4
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600206 tox_envlist: integrated-placement
207 devstack_localrc:
208 USE_PYTHON3: true
209 FORCE_CONFIG_DRIVE: true
210 ENABLE_VOLUME_MULTIATTACH: true
211 devstack_services:
212 s-account: false
213 s-container: false
214 s-object: false
215 s-proxy: false
216 c-bak: false
217
218- job:
219 name: tempest-integrated-storage
220 parent: devstack-tempest
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600221 description: |
222 This job runs integration tests for image & block storage. This is
223 subset of 'tempest-full-py3' job and run Cinder, Glance, Swift and Nova
224 related tests. This is meant to be run on Cinder and Glance gate only.
225 vars:
226 tox_envlist: integrated-storage
227 devstack_localrc:
228 USE_PYTHON3: true
229 FORCE_CONFIG_DRIVE: true
230 ENABLE_VOLUME_MULTIATTACH: true
231 GLANCE_USE_IMPORT_WORKFLOW: True
232
233- job:
234 name: tempest-integrated-object-storage
235 parent: devstack-tempest
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600236 description: |
237 This job runs integration tests for object storage. This is
238 subset of 'tempest-full-py3' job and run Swift, Cinder and Glance
239 related tests. This is meant to be run on Swift gate only.
240 vars:
241 tox_envlist: integrated-object-storage
242 devstack_localrc:
243 # NOTE(gmann): swift is not ready on python3 yet and devstack
Rajesh Tailora85bdb42024-04-02 12:01:53 +0530244 # install it on python2.7 only. But setting the USE_PYTHON3
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600245 # for future once swift is ready on py3.
246 USE_PYTHON3: true
247
248- job:
Ghanshyam Mannba28d782021-09-03 10:21:54 -0500249 name: tempest-with-latest-microversion
250 parent: tempest-full-py3
251 description: |
252 This job runs compute, placement and volume API tests with 'latest'
253 API microversion (This can be extended to other services having API
254 microversion concept).
255 vars:
256 tox_envlist: api-microversion-tests
257 devstack_localrc:
258 TEMPEST_COMPUTE_MIN_MICROVERSION: 'latest'
259 TEMPEST_VOLUME_MIN_MICROVERSION: 'latest'
260 TEMPEST_PLACEMENT_MIN_MICROVERSION: 'latest'
261
262- job:
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600263 name: tempest-multinode-full-py3
Ghanshyam Mann24a3a362022-10-12 15:50:28 -0500264 parent: tempest-multinode-full-base
Ghanshyam Mann040070a2024-10-10 21:04:00 -0700265 nodeset: openstack-two-node-noble
266 # This job runs on ubuntu Noble from 2025.1 onwards.
Martin Kopecc52304f2023-09-20 09:13:08 +0200267 branches:
Ghanshyam Mann040070a2024-10-10 21:04:00 -0700268 regex: ^.*/(victoria|wallaby|xena|yoga|zed|2023.1|2023.2|2024.1|2024.2)$
Martin Kopecc52304f2023-09-20 09:13:08 +0200269 negate: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600270 vars:
Ghanshyam Mann68a25ef2023-08-07 10:07:12 -0700271 # NOTE(gmann): Default concurrency is higher (number of cpu -2) which
272 # end up 6 in upstream CI. Higher concurrency means high parallel
273 # requests to services and can cause more oom issues. To avoid the
274 # oom issue, setting the concurrency to 4 in this job.
275 tempest_concurrency: 4
Martin Kopec450096d2024-02-12 22:40:45 +0100276 tempest_set_src_dest_host: true
elajkat064a3402019-10-17 13:18:10 +0200277 devstack_plugins:
278 neutron: https://opendev.org/openstack/neutron
elajkat064a3402019-10-17 13:18:10 +0200279 devstack_services:
elajkat0b14db22021-02-08 16:43:59 +0100280 neutron-trunk: true
yatinkarel2d2cfac2023-02-14 16:29:42 +0530281 br-ex-tcpdump: true
282 br-int-flows: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600283 group-vars:
284 subnode:
yatinkarel2d2cfac2023-02-14 16:29:42 +0530285 devstack_services:
286 br-ex-tcpdump: true
287 br-int-flows: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600288
289- job:
290 name: tempest-slow
291 parent: tempest-multinode-full
292 description: |
293 This multinode integration job will run all the tests tagged as slow.
294 It enables the lvm multibackend setup to cover few scenario tests.
295 This job will run only slow tests (API or Scenario) serially.
296
297 Former names for this job were:
298 * legacy-tempest-dsvm-neutron-scenario-multinode-lvm-multibackend
299 * tempest-scenario-multinode-lvm-multibackend
300 timeout: 10800
Ghanshyam Mann8de41272023-06-28 18:48:33 -0500301 vars:
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600302 tox_envlist: slow-serial
303 devstack_localrc:
304 CINDER_ENABLED_BACKENDS: lvm:lvmdriver-1,lvm:lvmdriver-2
305 ENABLE_VOLUME_MULTIATTACH: true
306 devstack_plugins:
307 neutron: https://opendev.org/openstack/neutron
308 devstack_services:
309 neutron-placement: true
310 neutron-qos: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600311 group-vars:
312 # NOTE(mriedem): The ENABLE_VOLUME_MULTIATTACH variable is used on both
313 # the controller and subnode prior to Rocky so we have to make sure the
314 # variable is set in both locations.
315 subnode:
316 devstack_localrc:
317 ENABLE_VOLUME_MULTIATTACH: true
318
319- job:
320 name: tempest-slow-py3
Luigi Toscanob9ac0572021-07-13 12:44:35 +0200321 parent: tempest-multinode-full-py3
Ghanshyam Mannebecf792021-06-14 17:09:35 -0500322 # This job version is with swift enabled on py3
323 # as swift is ready on py3 from stable/ussuri onwards.
Luigi Toscanob9ac0572021-07-13 12:44:35 +0200324 timeout: 10800
Ghanshyam Mann180717d2023-07-14 10:50:02 -0500325 # As the 'slow' tox env which is not available in old tempest used
326 # till stable/wallaby, this job definition is only for stable/xena
327 # onwards and separate job definition until stable/wallaby
Martin Kopecc52304f2023-09-20 09:13:08 +0200328 branches:
yatinkarel1c5f3412024-03-07 17:22:44 +0530329 regex: ^.*/(victoria|wallaby)$
Martin Kopecc52304f2023-09-20 09:13:08 +0200330 negate: true
Ghanshyam Mann6bb98c22023-02-10 18:22:02 -0600331 vars:
332 tox_envlist: slow
Dan Smithd869e3a2023-02-13 14:14:52 -0800333 devstack_localrc:
Ghanshyam Mann8de41272023-06-28 18:48:33 -0500334 CINDER_ENABLED_BACKENDS: lvm:lvmdriver-1,lvm:lvmdriver-2
335 ENABLE_VOLUME_MULTIATTACH: true
Dan Smith2ba7ed82024-10-01 07:33:09 -0700336 GLANCE_ENFORCE_IMAGE_FORMAT: false
Ghanshyam Mann8de41272023-06-28 18:48:33 -0500337 devstack_plugins:
338 neutron: https://opendev.org/openstack/neutron
339 devstack_services:
340 neutron-placement: true
341 neutron-qos: true
342 group-vars:
343 # NOTE(mriedem): The ENABLE_VOLUME_MULTIATTACH variable is used on both
344 # the controller and subnode prior to Rocky so we have to make sure the
345 # variable is set in both locations.
346 subnode:
347 devstack_localrc:
348 ENABLE_VOLUME_MULTIATTACH: true
Ghanshyam Mann6bb98c22023-02-10 18:22:02 -0600349
Ghanshyam Mann040070a2024-10-10 21:04:00 -0700350# TODO(gmann): As per the 2025.1 testing runtime, we need to run at least
351# one job set on Jammy. These jammy job can be removed in the next
352# cycle(2025.2).
353- job:
354 name: tempest-full-ubuntu-jammy
355 description: This is tempest-full python3 job on Ubuntu Jammy(22.04)
356 parent: tempest-full-py3
357 nodeset: openstack-single-node-jammy
358
359- job:
360 name: tempest-multinode-full-ubuntu-jammy
361 description: This is tempest-multinode-full-py3 python3 job on Ubuntu Jammy(22.04)
362 parent: tempest-multinode-full-py3
363 nodeset: openstack-two-node-jammy
364
365- job:
366 name: tempest-extra-tests-ubuntu-jammy
367 description: This is tempest-extra-tests python3 job on Ubuntu Jammy(22.04)
368 parent: tempest-extra-tests
369 nodeset: openstack-single-node-jammy
370
Ghanshyam Mann6bb98c22023-02-10 18:22:02 -0600371- job:
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600372 name: tempest-cinder-v2-api
373 parent: devstack-tempest
Ghanshyam Mann2f4539d2021-05-18 12:32:39 -0500374 # NOTE(gmann): Cinder v2 APIs are available until
375 # stable/wallaby only.
376 override-checkout: stable/wallaby
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600377 description: |
378 This job runs the cinder API test against v2 endpoint.
379 vars:
380 tox_envlist: all
381 tempest_test_regex: api.*volume
382 devstack_localrc:
383 TEMPEST_VOLUME_TYPE: volumev2
384
385- job:
Ade Lee0687b9c2022-03-02 16:24:50 -0500386 name: tempest-centos9-stream-fips
387 parent: devstack-tempest
388 description: |
389 Integration testing for a FIPS enabled Centos 9 system
Sylvain Bauzab8f0c302022-11-29 17:49:33 +0100390 timeout: 10800
Ade Lee0687b9c2022-03-02 16:24:50 -0500391 nodeset: devstack-single-node-centos-9-stream
Ade Lee0687b9c2022-03-02 16:24:50 -0500392 vars:
393 tox_envlist: full
394 configure_swap_size: 4096
395 nslookup_target: 'opendev.org'
Ade Leee64f4c22023-03-26 15:52:30 +0200396 enable_fips: True
Ade Lee6ded0702021-09-04 15:56:34 -0400397
398- job:
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600399 name: tempest-pg-full
400 parent: tempest-full-py3
401 description: |
402 Base integration test with Neutron networking and PostgreSQL.
403 Former name for this job was legacy-tempest-dsvm-neutron-pg-full.
404 vars:
405 devstack_localrc:
Ghanshyam Mann861c78f2021-02-09 11:25:26 -0600406 # TODO(gmann): Enable File injection tests once nova bug is fixed
407 # https://bugs.launchpad.net/nova/+bug/1882421
408 # ENABLE_FILE_INJECTION: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600409 DATABASE_TYPE: postgresql
410
Ghanshyam Mann7ab45a92022-11-21 19:14:05 -0600411- job:
412 name: tempest-full-enforce-scope-new-defaults
413 parent: tempest-full-py3
414 description: |
415 This job runs the Tempest tests with scope and new defaults enabled.
Ghanshyam Mann7ab45a92022-11-21 19:14:05 -0600416 vars:
417 devstack_localrc:
Douglas Mendizábalcdbe43e2024-03-11 15:03:29 -0400418 KEYSTONE_ENFORCE_SCOPE: true
Ghanshyam Mann7ab45a92022-11-21 19:14:05 -0600419 CINDER_ENFORCE_SCOPE: true
Ghanshyam Mannc5ff86b2022-11-30 14:37:26 -0600420 PLACEMENT_ENFORCE_SCOPE: true
Ghanshyam Mann7ab45a92022-11-21 19:14:05 -0600421
Ghanshyam Mann2c912412023-07-27 17:17:52 -0700422- job:
423 name: tempest-all-rbac-old-defaults
424 parent: tempest-all
425 description: |
426 Integration test that runs all tests on RBAC old defaults.
Ghanshyam Manncc0e9b12023-10-25 13:13:26 -0700427 vars:
Ghanshyam Mann2c912412023-07-27 17:17:52 -0700428 devstack_localrc:
Ghanshyam Manncc0e9b12023-10-25 13:13:26 -0700429 # NOTE(gmann): Nova, Glance, and Neutron have enabled the new defaults
430 # and scope by default in devstack so we need some jobs keep testing
431 # the old defaults until they are removed from service side.
Ghanshyam Mann2c912412023-07-27 17:17:52 -0700432 NOVA_ENFORCE_SCOPE: false
433 GLANCE_ENFORCE_SCOPE: false
Ghanshyam Manncc0e9b12023-10-25 13:13:26 -0700434 NEUTRON_ENFORCE_SCOPE: false
Ghanshyam Mann2c912412023-07-27 17:17:52 -0700435
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600436- project-template:
437 name: integrated-gate-networking
438 description: |
439 Run the python3 Tempest network integration tests (Nova and Neutron related)
440 in check and gate for the neutron integrated gate. This is meant to be
441 run on neutron gate only.
442 check:
443 jobs:
444 - grenade
Ghanshyam Mann270e4fe2023-09-28 13:29:52 -0700445 # NOTE(gmann): These template are generic and used on stable branch
446 # as well as master testing. So grenade-skip-level on stable/2023.1
447 # which test stable/yoga to stable/2023.1 upgrade is non-voting.
Dan Smithaf19ff42022-02-23 10:42:26 -0800448 - grenade-skip-level:
449 voting: false
Ghanshyam Mannbbb2e042023-03-20 13:51:51 -0500450 branches:
451 - stable/2023.1
Ghanshyam Mann07655682024-03-28 11:14:07 -0700452 # on stable/2024.1(SLURP) grenade-skip-level is voting which test
453 # stable/2023.1 to stable/2024.1 upgrade. This is supposed to run on
454 # SLURP release only.
Ghanshyam Mann270e4fe2023-09-28 13:29:52 -0700455 - grenade-skip-level:
456 branches:
Ghanshyam Mann07655682024-03-28 11:14:07 -0700457 - ^.*/2024.1
Ghanshyam Mann066e0bd2024-09-25 12:53:46 -0700458 # on current master 2025.1(SLURP) grenade-skip-level-always is voting
459 # which test stable/2024.1 to 2025.1 upgrade.
460 - grenade-skip-level-always:
461 branches:
462 - master
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600463 - tempest-integrated-networking
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500464 # Do not run it on ussuri until below issue is fixed
465 # https://storyboard.openstack.org/#!/story/2010057
Elod Illes31afd4e2023-02-07 15:17:32 +0100466 # and job is broken up to wallaby branch due to the issue
Elod Illese17f1d32023-02-02 15:24:35 +0100467 # described in https://review.opendev.org/872341
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500468 - openstacksdk-functional-devstack:
Martin Kopecc52304f2023-09-20 09:13:08 +0200469 branches:
yatinkarel1c5f3412024-03-07 17:22:44 +0530470 regex: ^.*/(victoria|wallaby)$
Martin Kopecc52304f2023-09-20 09:13:08 +0200471 negate: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600472 gate:
473 jobs:
474 - grenade
475 - tempest-integrated-networking
Ghanshyam Mann07655682024-03-28 11:14:07 -0700476 # on stable/2024.1(SLURP) grenade-skip-level is voting which test
477 # stable/2023.1 to stable/2024.1 upgrade. This is supposed to run on
478 # SLURP release only.
Ghanshyam Mann270e4fe2023-09-28 13:29:52 -0700479 - grenade-skip-level:
480 branches:
Ghanshyam Mann07655682024-03-28 11:14:07 -0700481 - ^.*/2024.1
Ghanshyam Mann066e0bd2024-09-25 12:53:46 -0700482 # on current master 2025.1(SLURP) grenade-skip-level-always is voting
483 # which test stable/2024.1 to 2025.1 upgrade.
484 - grenade-skip-level-always:
485 branches:
486 - master
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500487 # Do not run it on ussuri until below issue is fixed
488 # https://storyboard.openstack.org/#!/story/2010057
Elod Illes31afd4e2023-02-07 15:17:32 +0100489 # and job is broken up to wallaby branch due to the issue
Elod Illese17f1d32023-02-02 15:24:35 +0100490 # described in https://review.opendev.org/872341
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500491 - openstacksdk-functional-devstack:
Martin Kopecc52304f2023-09-20 09:13:08 +0200492 branches:
yatinkarel1c5f3412024-03-07 17:22:44 +0530493 regex: ^.*/(victoria|wallaby)$
Martin Kopecc52304f2023-09-20 09:13:08 +0200494 negate: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600495
496- project-template:
497 name: integrated-gate-compute
498 description: |
499 Run the python3 Tempest compute integration tests
500 (Nova, Neutron, Cinder and Glance related) in check and gate
501 for the Nova integrated gate. This is meant to be
502 run on Nova gate only.
Ghanshyam Mann9625f0d2022-04-27 17:45:52 -0500503 # NOTE(gmann): This template is used for stable branches also so when we
504 # add/remove jobs here we need to make sure we should not change the
505 # behaviour for stable branches. For example, with branch variant we need
506 # to make sure old job keep running on stable branches and the new one run
507 # only from master(or the branch it was meant to run).
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600508 check:
509 jobs:
Ghanshyam Mann270e4fe2023-09-28 13:29:52 -0700510 # NOTE(gmann): These template are generic and used on stable branch
511 # as well as master testing. So grenade-skip-level on stable/2023.1
512 # which test stable/yoga to stable/2023.1 upgrade is non-voting.
Dan Smithaf19ff42022-02-23 10:42:26 -0800513 - grenade-skip-level:
514 voting: false
Ghanshyam Mannbbb2e042023-03-20 13:51:51 -0500515 branches:
516 - stable/2023.1
517 # NOTE(gmann): Nova decided to run grenade skip level testing always
518 # (on SLURP as well as non SLURP release) so we are adding grenade-skip-level-always
519 # job in integrated gate and we do not need to update skip level job
520 # here until Nova change the decision.
Rajesh Tailora85bdb42024-04-02 12:01:53 +0530521 # This is added from 2023.2 release cycle onwards so we need to use branch variant
Ghanshyam Mannbbb2e042023-03-20 13:51:51 -0500522 # to make sure we do not run this job on older than 2023.2 gate.
523 - grenade-skip-level-always:
524 branches:
Ghanshyam Mann07655682024-03-28 11:14:07 -0700525 - ^.*/2023.2
526 - ^.*/2024.1
Ghanshyam Mann066e0bd2024-09-25 12:53:46 -0700527 - ^.*/2024.2
Ghanshyam Mannbbb2e042023-03-20 13:51:51 -0500528 - master
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600529 - tempest-integrated-compute
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500530 # Do not run it on ussuri until below issue is fixed
531 # https://storyboard.openstack.org/#!/story/2010057
Elod Illes31afd4e2023-02-07 15:17:32 +0100532 # and job is broken up to wallaby branch due to the issue
Elod Illese17f1d32023-02-02 15:24:35 +0100533 # described in https://review.opendev.org/872341
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500534 - openstacksdk-functional-devstack:
Martin Kopecc52304f2023-09-20 09:13:08 +0200535 branches:
yatinkarel1c5f3412024-03-07 17:22:44 +0530536 regex: ^.*/(victoria|wallaby)$
Martin Kopecc52304f2023-09-20 09:13:08 +0200537 negate: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600538 gate:
539 jobs:
Ghanshyam Mannbbb2e042023-03-20 13:51:51 -0500540 - grenade-skip-level-always:
541 branches:
Ghanshyam Mann07655682024-03-28 11:14:07 -0700542 - ^.*/2023.2
543 - ^.*/2024.1
Ghanshyam Mann066e0bd2024-09-25 12:53:46 -0700544 - ^.*/2024.2
Ghanshyam Mannbbb2e042023-03-20 13:51:51 -0500545 - master
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600546 - tempest-integrated-compute
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500547 - openstacksdk-functional-devstack:
Martin Kopecc52304f2023-09-20 09:13:08 +0200548 branches:
yatinkarel1c5f3412024-03-07 17:22:44 +0530549 regex: ^.*/(victoria|wallaby)$
Martin Kopecc52304f2023-09-20 09:13:08 +0200550 negate: true
Sean Mooney9c263de2022-07-18 16:55:31 +0100551 periodic-weekly:
552 jobs:
553 # centos-9-stream is tested from zed release onwards
554 - tempest-integrated-compute-centos-9-stream:
Martin Kopecc52304f2023-09-20 09:13:08 +0200555 branches:
yatinkarel1c5f3412024-03-07 17:22:44 +0530556 regex: ^.*/(victoria|wallaby|xena|yoga)$
Martin Kopecc52304f2023-09-20 09:13:08 +0200557 negate: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600558
559- project-template:
560 name: integrated-gate-placement
561 description: |
562 Run the python3 Tempest placement integration tests
563 (Nova and Neutron related) in check and gate
564 for the Placement integrated gate. This is meant to be
565 run on Placement gate only.
566 check:
567 jobs:
568 - grenade
Ghanshyam Mann270e4fe2023-09-28 13:29:52 -0700569 # NOTE(gmann): These template are generic and used on stable branch
570 # as well as master testing. So grenade-skip-level on stable/2023.1
571 # which test stable/yoga to stable/2023.1 upgrade is non-voting.
Dan Smithaf19ff42022-02-23 10:42:26 -0800572 - grenade-skip-level:
573 voting: false
Ghanshyam Mannbbb2e042023-03-20 13:51:51 -0500574 branches:
575 - stable/2023.1
Ghanshyam Mann07655682024-03-28 11:14:07 -0700576 # on stable/2024.1(SLURP) grenade-skip-level is voting which test
577 # stable/2023.1 to stable/2024.1 upgrade. This is supposed to run on
578 # SLURP release only.
Ghanshyam Mann270e4fe2023-09-28 13:29:52 -0700579 - grenade-skip-level:
580 branches:
Ghanshyam Mann07655682024-03-28 11:14:07 -0700581 - ^.*/2024.1
Ghanshyam Mann066e0bd2024-09-25 12:53:46 -0700582 # on current master 2025.1(SLURP) grenade-skip-level-always is voting
583 # which test stable/2024.1 to 2025.1 upgrade.
584 - grenade-skip-level-always:
585 branches:
586 - master
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600587 - tempest-integrated-placement
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500588 # Do not run it on ussuri until below issue is fixed
589 # https://storyboard.openstack.org/#!/story/2010057
Elod Illes31afd4e2023-02-07 15:17:32 +0100590 # and job is broken up to wallaby branch due to the issue
Elod Illese17f1d32023-02-02 15:24:35 +0100591 # described in https://review.opendev.org/872341
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500592 - openstacksdk-functional-devstack:
Martin Kopecc52304f2023-09-20 09:13:08 +0200593 branches:
yatinkarel1c5f3412024-03-07 17:22:44 +0530594 regex: ^.*/(victoria|wallaby)$
Martin Kopecc52304f2023-09-20 09:13:08 +0200595 negate: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600596 gate:
597 jobs:
598 - grenade
599 - tempest-integrated-placement
Ghanshyam Mann07655682024-03-28 11:14:07 -0700600 # on stable/2024.1(SLURP) grenade-skip-level is voting which test
601 # stable/2023.1 to stable/2024.1 upgrade. This is supposed to run on
602 # SLURP release only.
Ghanshyam Mann270e4fe2023-09-28 13:29:52 -0700603 - grenade-skip-level:
604 branches:
Ghanshyam Mann07655682024-03-28 11:14:07 -0700605 - ^.*/2024.1
Ghanshyam Mann066e0bd2024-09-25 12:53:46 -0700606 # on current master 2025.1(SLURP) grenade-skip-level-always is voting
607 # which test stable/2024.1 to 2025.1 upgrade.
608 - grenade-skip-level-always:
609 branches:
610 - master
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500611 # Do not run it on ussuri until below issue is fixed
612 # https://storyboard.openstack.org/#!/story/2010057
Elod Illes31afd4e2023-02-07 15:17:32 +0100613 # and job is broken up to wallaby branch due to the issue
Elod Illese17f1d32023-02-02 15:24:35 +0100614 # described in https://review.opendev.org/872341
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500615 - openstacksdk-functional-devstack:
Martin Kopecc52304f2023-09-20 09:13:08 +0200616 branches:
yatinkarel1c5f3412024-03-07 17:22:44 +0530617 regex: ^.*/(victoria|wallaby)$
Martin Kopecc52304f2023-09-20 09:13:08 +0200618 negate: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600619
620- project-template:
621 name: integrated-gate-storage
622 description: |
623 Run the python3 Tempest image & block storage integration tests
624 (Cinder, Glance, Swift and Nova related) in check and gate
625 for the neutron integrated gate. This is meant to be
626 run on Cinder and Glance gate only.
627 check:
628 jobs:
629 - grenade
Ghanshyam Mann270e4fe2023-09-28 13:29:52 -0700630 # NOTE(gmann): These template are generic and used on stable branch
631 # as well as master testing. So grenade-skip-level on stable/2023.1
632 # which test stable/yoga to stable/2023.1 upgrade is non-voting.
Dan Smithaf19ff42022-02-23 10:42:26 -0800633 - grenade-skip-level:
634 voting: false
Ghanshyam Mannbbb2e042023-03-20 13:51:51 -0500635 branches:
636 - stable/2023.1
Ghanshyam Mann07655682024-03-28 11:14:07 -0700637 # on stable/2024.1(SLURP) grenade-skip-level is voting which test
638 # stable/2023.1 to stable/2024.1 upgrade. This is supposed to run on
639 # SLURP release only.
Ghanshyam Mann270e4fe2023-09-28 13:29:52 -0700640 - grenade-skip-level:
641 branches:
Ghanshyam Mann07655682024-03-28 11:14:07 -0700642 - ^.*/2024.1
Ghanshyam Mann066e0bd2024-09-25 12:53:46 -0700643 # on current master 2025.1(SLURP) grenade-skip-level-always is voting
644 # which test stable/2024.1 to 2025.1 upgrade.
645 - grenade-skip-level-always:
646 branches:
647 - master
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600648 - tempest-integrated-storage
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500649 # Do not run it on ussuri until below issue is fixed
650 # https://storyboard.openstack.org/#!/story/2010057
Elod Illes31afd4e2023-02-07 15:17:32 +0100651 # and job is broken up to wallaby branch due to the issue
Elod Illese17f1d32023-02-02 15:24:35 +0100652 # described in https://review.opendev.org/872341
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500653 - openstacksdk-functional-devstack:
Martin Kopecc52304f2023-09-20 09:13:08 +0200654 branches:
yatinkarel1c5f3412024-03-07 17:22:44 +0530655 regex: ^.*/(victoria|wallaby)$
Martin Kopecc52304f2023-09-20 09:13:08 +0200656 negate: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600657 gate:
658 jobs:
659 - grenade
Ghanshyam Mann07655682024-03-28 11:14:07 -0700660 # on stable/2024.1(SLURP) grenade-skip-level is voting which test
661 # stable/2023.1 to stable/2024.1 upgrade. This is supposed to run on
662 # SLURP release only.
Ghanshyam Mann270e4fe2023-09-28 13:29:52 -0700663 - grenade-skip-level:
664 branches:
Ghanshyam Mann07655682024-03-28 11:14:07 -0700665 - ^.*/2024.1
Ghanshyam Mann066e0bd2024-09-25 12:53:46 -0700666 # on current master 2025.1(SLURP) grenade-skip-level-always is voting
667 # which test stable/2024.1 to 2025.1 upgrade.
668 - grenade-skip-level-always:
669 branches:
670 - master
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600671 - tempest-integrated-storage
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500672 # Do not run it on ussuri until below issue is fixed
673 # https://storyboard.openstack.org/#!/story/2010057
Elod Illes31afd4e2023-02-07 15:17:32 +0100674 # and job is broken up to wallaby branch due to the issue
Elod Illese17f1d32023-02-02 15:24:35 +0100675 # described in https://review.opendev.org/872341
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500676 - openstacksdk-functional-devstack:
Martin Kopecc52304f2023-09-20 09:13:08 +0200677 branches:
yatinkarel1c5f3412024-03-07 17:22:44 +0530678 regex: ^.*/(victoria|wallaby)$
Martin Kopecc52304f2023-09-20 09:13:08 +0200679 negate: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600680
681- project-template:
682 name: integrated-gate-object-storage
683 description: |
684 Run the python3 Tempest object storage integration tests
685 (Swift, Cinder and Glance related) in check and gate
686 for the swift integrated gate. This is meant to be
687 run on swift gate only.
688 check:
689 jobs:
690 - grenade
Ghanshyam Mann07655682024-03-28 11:14:07 -0700691 # on stable/2024.1(SLURP) grenade-skip-level is voting which test
692 # stable/2023.1 to stable/2024.1 upgrade. This is supposed to run on
693 # SLURP release only.
Ghanshyam Mann270e4fe2023-09-28 13:29:52 -0700694 - grenade-skip-level:
695 branches:
Ghanshyam Mann07655682024-03-28 11:14:07 -0700696 - ^.*/2024.1
Ghanshyam Mann066e0bd2024-09-25 12:53:46 -0700697 # on current master 2025.1(SLURP) grenade-skip-level-always is voting
698 # which test stable/2024.1 to 2025.1 upgrade.
699 - grenade-skip-level-always:
700 branches:
701 - master
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600702 - tempest-integrated-object-storage
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500703 # Do not run it on ussuri until below issue is fixed
704 # https://storyboard.openstack.org/#!/story/2010057
Elod Illes31afd4e2023-02-07 15:17:32 +0100705 # and job is broken up to wallaby branch due to the issue
Elod Illese17f1d32023-02-02 15:24:35 +0100706 # described in https://review.opendev.org/872341
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500707 - openstacksdk-functional-devstack:
Martin Kopecc52304f2023-09-20 09:13:08 +0200708 branches:
yatinkarel1c5f3412024-03-07 17:22:44 +0530709 regex: ^.*/(victoria|wallaby)$
Martin Kopecc52304f2023-09-20 09:13:08 +0200710 negate: true
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600711 gate:
712 jobs:
713 - grenade
Ghanshyam Mann07655682024-03-28 11:14:07 -0700714 # on stable/2024.1(SLURP) grenade-skip-level is voting which test
715 # stable/2023.1 to stable/2024.1 upgrade. This is supposed to run on
716 # SLURP release only.
Ghanshyam Mann270e4fe2023-09-28 13:29:52 -0700717 - grenade-skip-level:
718 branches:
Ghanshyam Mann07655682024-03-28 11:14:07 -0700719 - ^.*/2024.1
Ghanshyam Mann066e0bd2024-09-25 12:53:46 -0700720 # on current master 2025.1(SLURP) grenade-skip-level-always is voting
721 # which test stable/2024.1 to 2025.1 upgrade.
722 - grenade-skip-level-always:
723 branches:
724 - master
Ghanshyam Mann61f57332020-11-25 11:46:20 -0600725 - tempest-integrated-object-storage
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500726 # Do not run it on ussuri until below issue is fixed
727 # https://storyboard.openstack.org/#!/story/2010057
Elod Illes31afd4e2023-02-07 15:17:32 +0100728 # and job is broken up to wallaby branch due to the issue
Elod Illese17f1d32023-02-02 15:24:35 +0100729 # described in https://review.opendev.org/872341
Ghanshyam Mann2202f7b2022-06-01 16:31:51 -0500730 - openstacksdk-functional-devstack:
Martin Kopecc52304f2023-09-20 09:13:08 +0200731 branches:
yatinkarel1c5f3412024-03-07 17:22:44 +0530732 regex: ^.*/(victoria|wallaby)$
Martin Kopecc52304f2023-09-20 09:13:08 +0200733 negate: true