blob: 32fad92ebdaf667e46b281f7ed381c6d9c6610bf [file] [log] [blame] [view]
James E. King, III0ad20bd2017-09-30 15:44:16 -07001# Docker Integration #
James E. King, III65efdff2017-09-25 00:13:38 -04002
James E. King, III0ad20bd2017-09-30 15:44:16 -07003Due to the large number of language requirements to build Apache Thrift, docker containers are used to build and test the project on a variety of platforms to provide maximum test coverage.
jfarrelle03f7e82015-02-18 23:25:54 -05004
James E. King, III0ad20bd2017-09-30 15:44:16 -07005## Travis CI Integration ##
jfarrelle03f7e82015-02-18 23:25:54 -05006
James E. King, III0ad20bd2017-09-30 15:44:16 -07007The Travis CI scripts use the following environment variables and logic to determine their behavior.
8
9### Environment Variables ###
10
11| Variable | Default | Usage |
12| -------- | ----- | ------- |
13| `DISTRO` | `ubuntu-xenial` | Set by various build jobs in `.travis.yml` to run builds in different containers. Not intended to be set externally.|
James E. King, IIIcd5be7b2017-10-21 10:16:19 -040014| `DOCKER_REPO` | `thrift/thrift-build` | The name of the Docker Hub repository to obtain and store docker images. |
15| `DOCKER_USER` | `<none>` | The Docker Hub account name containing the repository. |
James E. King, III0ad20bd2017-09-30 15:44:16 -070016| `DOCKER_PASS` | `<none>` | The Docker Hub account password to use when pushing new tags. |
17
James E. King, IIIcd5be7b2017-10-21 10:16:19 -040018For example, the default docker image that is used in builds if no overrides are specified would be: `thrift/thrift-build:ubuntu-xenial`
James E. King, III0ad20bd2017-09-30 15:44:16 -070019
James E. King, IIIcd5be7b2017-10-21 10:16:19 -040020### Forks ###
21
22If you have forked the Apache Thrift repository and you would like to use your own Docker Hub account to store thrift build images, you can use the Travis CI web interface to set the `DOCKER_USER`, `DOCKER_PASS`, and `DOCKER_REPO` variables in a secure manner. Your fork builds will then pull, push, and tag the docker images in your account.
James E. King, III0ad20bd2017-09-30 15:44:16 -070023
24### Logic ###
25
26The Travis CI build runs in two phases - first the docker images are rebuilt for each of the three supported containers if they do not match the Dockerfile that was used to build the most recent tag. If a `DOCKER_PASS` environment variable is specified, the docker stage builds will attempt to log into Docker Hub and push the resulting tags.
27
28## Supported Containers ##
29
30The Travis CI (continuous integration) builds use the Ubuntu Trusty, Xenial, and Artful images to maximize language level coverage.
James E. King, IIId7142b72017-09-01 13:00:36 -070031
James E. King, IIIcd5be7b2017-10-21 10:16:19 -040032### Ubuntu ###
33
James E. King, III0ad20bd2017-09-30 15:44:16 -070034* trusty (legacy)
35* xenial (stable)
36* artful (latest)
37
James E. King, IIIcd5be7b2017-10-21 10:16:19 -040038## Unsupported Containers ##
James E. King, III0ad20bd2017-09-30 15:44:16 -070039
40These containers may be in various states, and may not build everything.
jfarrelle03f7e82015-02-18 23:25:54 -050041
James E. King, IIIcd5be7b2017-10-21 10:16:19 -040042### CentOS ###
James E. King, III65efdff2017-09-25 00:13:38 -040043* 7.3
44 * make check in lib/py may hang in test_sslsocket - root cause unknown
45
James E. King, IIIcd5be7b2017-10-21 10:16:19 -040046### Debian ###
47
James E. King, III65efdff2017-09-25 00:13:38 -040048* jessie
49* stretch
50 * make check in lib/cpp fails due to https://svn.boost.org/trac10/ticket/12507
51
James E. King, IIIcd5be7b2017-10-21 10:16:19 -040052## Building Locally ##
53
James E. King, IIId7142b72017-09-01 13:00:36 -070054From the Apache Thrift code base root:
jfarrelle03f7e82015-02-18 23:25:54 -050055
James E. King, IIIcd5be7b2017-10-21 10:16:19 -040056* Build the image
jfarrelle03f7e82015-02-18 23:25:54 -050057
James E. King, IIId7142b72017-09-01 13:00:36 -070058 docker build -t thrift build/docker/ubuntu-xenial
jfarrelle03f7e82015-02-18 23:25:54 -050059
James E. King, IIIcd5be7b2017-10-21 10:16:19 -040060* Open a command prompt in the image
jfarrelle03f7e82015-02-18 23:25:54 -050061
Nobuaki Sukegawaa6ab1f52015-11-28 15:04:39 +090062 docker run -v $(pwd):/thrift/src -it thrift /bin/bash
jfarrelle03f7e82015-02-18 23:25:54 -050063
James E. King, IIIcd5be7b2017-10-21 10:16:19 -040064## Core Tool Versions per Dockerfile ##
65
66Last updated: October 1, 2017
67
James E. King, III0ad20bd2017-09-30 15:44:16 -070068| Tool | ubuntu-trusty | ubuntu-xenial | ubuntu-artful | Notes |
69| :-------- | :------------ | :------------ | :------------ | :---- |
70| ant | 1.9.3 | 1.9.6 | 1.9.9 | |
71| autoconf | 2.69 | 2.69 | 2.69 | |
72| automake | 1.14.1 | 1.15 | 1.15 | |
73| bison | 3.0.2 | 3.0.4 | 3.0.4 | |
74| boost | 1.54.0 | 1.58.0 | 1.63.0 | artful: stock boost 1.62.0 has problems running unit tests |
75| cmake | 3.2.2 | 3.5.1 | 3.9.1 | |
76| cppcheck | 1.61 | 1.72 | 1.80 | |
77| flex | 2.5.35 | 2.6.0 | 2.6.1 | |
78| glibc | 2.19 | 2.23 | 2.26 | |
79| libevent | 2.0.21 | 2.0.21 | 2.1 | |
80| libstdc++ | 4.8.4 | 5.4.0 | 7.2.0 | |
81| make | 3.81 | 4.1 | 4.1 | |
82| openssl | 1.0.1f | 1.0.2g | 1.0.2g | |
83| qt5 | 5.2.1 | 5.5.1 | 5.9.1 | |
James E. King, IIId7142b72017-09-01 13:00:36 -070084
James E. King, IIIcd5be7b2017-10-21 10:16:19 -040085## Compiler/Language Versions per Dockerfile ##
86
87Last updated: October 1, 2017
88
James E. King, III0ad20bd2017-09-30 15:44:16 -070089| Language | ubuntu-trusty | ubuntu-xenial | ubuntu-artful | Notes |
90| :-------- | :------------ | :------------ | :------------ | :---- |
91| as3 | | | | Not in CI |
92| C++ gcc | 4.8.4 | 5.4.0 | 7.2.0 | |
93| C++ clang | 3.4 | 3.8 | 4.0 | |
94| C# (mono) | 3.2.8.0 | 4.2.1 | 4.6.2.7 | |
95| c_glib | 2.40.2 | 2.48.2 | 2.54.0 | |
96| cocoa | | | | Not in CI |
97| d | 2.070.2 | 2.073.2 | 2.076.0 | |
98| dart | 1.20.1 | 1.24.2 | | artful: apt repo not compatible with apt 1.4? |
99| delphi | | | | Not in CI |
100| dotnet | | 2.0.0 | | Needs to be added to artful |
101| erlang | R16B03 | 18.3 | 20.0.4 | |
102| go | 1.2.1 | 1.6.2 | 1.8.3 | |
103| haskell | 7.6.3 | 7.10.3 | 8.0.2 | |
104| haxe | | 3.2.1 | 3.4.2 | disabled in trusty builds - cores on install v3.0.0, disabled in artful builds - see THRIFT-4352 |
105| java | 1.7.0_151 | 1.8.0_131 | 1.8.0_144 | |
106| js | | | | Unsure how to look for version info? |
107| lua | 5.1.5 | 5.2.4 | 5.3.3 | |
108| nodejs | | 4.2.6 | 6.11.2 | trusty has node.js 0.10.0 which is too old |
109| ocaml | | 4.02.3 | 4.04.0 | |
110| perl | 5.18.2 | 5.22.1 | 5.26.0 | |
111| php | 5.5.9 | 7.0.22 | 7.1.8 | |
112| python | 2.7.6 | 2.7.12 | 2.7.14 | |
113| python3 | 3.4.3 | 3.5.2 | 3.6.3 | |
114| ruby | 1.9.3p484 | 2.3.1p112 | 2.3.3p222 | |
115| rust | 1.15.1 | 1.15.1 | 1.18.0 | |
116| smalltalk | | | | Not in CI |
117| swift | | | | Not in CI |
James E. King, IIId7142b72017-09-01 13:00:36 -0700118