JakeHillion/object-introspection
1
0
Fork 0
mirror of https://github.com/JakeHillion/object-introspection.git synced 2024-11-14 14:26:55 +00:00
Code Issues Packages Projects Releases Wiki Activity
d232a5d2fb
object-introspection/.circleci/config.yml

238 lines
7.4 KiB
YAML
Raw Normal View History

Initial commit
2022-12-19 14:37:51 +00:00
version: 2.1
workflows:
CI: Split build and test into separate jobs This will give us more flexibility later, e.g. allowing different steps for GCC and Clang (as needed for code coverage), or letting us parallelise our tests across multiple machines.
2023-02-01 18:03:42 +00:00
object-introspection:
Initial commit
2022-12-19 14:37:51 +00:00
jobs:
- lint
CI: Split build and test into separate jobs This will give us more flexibility later, e.g. allowing different steps for GCC and Clang (as needed for code coverage), or letting us parallelise our tests across multiple machines.
2023-02-01 18:03:42 +00:00
- build:
name: build-gcc
Initial commit
2022-12-19 14:37:51 +00:00
cc: /usr/bin/gcc
cxx: /usr/bin/g++
Enable -Werror for Clang builds in CI Don't enable for local dev builds or for GCC CI builds, as every compiler version has a different set of warnings and trying to make them all pass is a neverending task.
2023-05-22 11:02:47 +01:00
warnings_as_errors: "OFF"
Integration tests: Set up CI testing for TypeGraph CTest can't forward command line arguments to the test runner, so add the option to using an environment variable to enable features instead. CMake issue tracking the feature that would have been needed: https://gitlab.kitware.com/cmake/cmake/-/issues/20470 Tests which aren't passing yet have been disabled in CI.
2023-06-26 16:34:52 +01:00
- test:
OID: Make CodeGen v2 (TypeGraph) the default
2023-12-14 16:39:16 +00:00
name: test-gcc
Integration tests: Set up CI testing for TypeGraph CTest can't forward command line arguments to the test runner, so add the option to using an environment variable to enable features instead. CMake issue tracking the feature that would have been needed: https://gitlab.kitware.com/cmake/cmake/-/issues/20470 Tests which aren't passing yet have been disabled in CI.
2023-06-26 16:34:52 +01:00
requires:
- build-gcc
EnforceCompatibility: Stub out void pointers CodeGen v1 does not record anything for pointers to incomplete types. Not even the address, as is done for other pointers. Introduce a new Primitive type "Incomplete". This behaves identically to "Void", but allows us to tell whether a type was defined as void or if it ended up like that because of incomplete DWARF information.
2023-07-31 14:28:05 +01:00
exclude_regex: ".*inheritance_polymorphic.*|.*arrays_member_int0"
CI: Add code coverage reporting Add CODE_COVERAGE option to enable coverage instrumentation in builds. Add new CI job to upload coverage reports to CodeCov.io. Reports can be found by navigating the codecov.io UI, or by going to the URL printed at the end of the "Code Coverage" CI job. More CodeCov integration could be set up later once we have coverage reporting on the main branch.
2023-02-03 09:47:57 +00:00
- coverage:
CI: Fix code coverage collection Multiple jobs are not allowed to persist the same files to a workspace. This commit takes the lazy approach of splitting the type-graph and non-type-graph jobs into different workspaces and creating a second coverage job to avoid the conflict.
2023-06-28 09:37:24 +01:00
name: coverage
CI: Add code coverage reporting Add CODE_COVERAGE option to enable coverage instrumentation in builds. Add new CI job to upload coverage reports to CodeCov.io. Reports can be found by navigating the codecov.io UI, or by going to the URL printed at the end of the "Code Coverage" CI job. More CodeCov integration could be set up later once we have coverage reporting on the main branch.
2023-02-03 09:47:57 +00:00
requires:
- test-gcc
CI: Split build and test into separate jobs This will give us more flexibility later, e.g. allowing different steps for GCC and Clang (as needed for code coverage), or letting us parallelise our tests across multiple machines.
2023-02-01 18:03:42 +00:00
- build:
name: build-clang
Initial commit
2022-12-19 14:37:51 +00:00
cc: /usr/bin/clang-12
cxx: /usr/bin/clang++-12
Enable -Werror for Clang builds in CI Don't enable for local dev builds or for GCC CI builds, as every compiler version has a different set of warnings and trying to make them all pass is a neverending task.
2023-05-22 11:02:47 +01:00
warnings_as_errors: "ON"
Integration tests: Set up CI testing for TypeGraph CTest can't forward command line arguments to the test runner, so add the option to using an environment variable to enable features instead. CMake issue tracking the feature that would have been needed: https://gitlab.kitware.com/cmake/cmake/-/issues/20470 Tests which aren't passing yet have been disabled in CI.
2023-06-26 16:34:52 +01:00
- test:
OID: Make CodeGen v2 (TypeGraph) the default
2023-12-14 16:39:16 +00:00
name: test-clang
Integration tests: Set up CI testing for TypeGraph CTest can't forward command line arguments to the test runner, so add the option to using an environment variable to enable features instead. CMake issue tracking the feature that would have been needed: https://gitlab.kitware.com/cmake/cmake/-/issues/20470 Tests which aren't passing yet have been disabled in CI.
2023-06-26 16:34:52 +01:00
requires:
- build-clang
TypeGraph: Create dummy containers These represent types which don't store any interesting data for us to measure, but which are required by a real container so can not be replaced with our own generated class types. std::allocator often has bad DWARF, so it must be replaced after the DWARF is fixed up in Flattener. The others could be replaced earlier in the transformation process if desired, but I've left them all together for simplicity for now. This fixes the folly::fbstring tests.
2023-06-26 19:00:51 +01:00
# Tests disabled due to bad DWARF generated by the old clang compiler in CI
circleci: clean up codegen v1 runs Remove the CodeGen v1 sections of the CI config because both OID and OIL use CodeGen v2. We were missing running any test that wasn't `Oi{d,l}Integration.*` before. This now runs the unit tests again and requires a minor fix to one unit test. Test plan: - CI
2024-01-03 15:26:45 +00:00
exclude_regex: ".*inheritance_polymorphic.*|.*arrays_member_int0|.*fbstring.*|.*std_string_*|.*multi_arg_tb_.*|.*ignored_a|OilIntegration.fbstring_.*|OilIntegration.capture_keys_string|OilIntegration.capture_keys_multi_level"
Initial commit
2022-12-19 14:37:51 +00:00
CI: Split build and test into separate jobs This will give us more flexibility later, e.g. allowing different steps for GCC and Clang (as needed for code coverage), or letting us parallelise our tests across multiple machines.
2023-02-01 18:03:42 +00:00
executors:
ci: move formatting checks to nix
2023-12-14 15:18:24 +00:00
nix-docker:
docker:
- image: nixos/nix:latest
resource_class: small
CI: Split build and test into separate jobs This will give us more flexibility later, e.g. allowing different steps for GCC and Clang (as needed for code coverage), or letting us parallelise our tests across multiple machines.
2023-02-01 18:03:42 +00:00
ubuntu-docker:
Initial commit
2022-12-19 14:37:51 +00:00
docker:
- image: ubuntu:jammy
CI: Split build and test into separate jobs This will give us more flexibility later, e.g. allowing different steps for GCC and Clang (as needed for code coverage), or letting us parallelise our tests across multiple machines.
2023-02-01 18:03:42 +00:00
resource_class: small
big-boy:
machine:
image: ubuntu-2204:2022.10.2
resource_class: 2xlarge
jobs:
lint:
ci: move formatting checks to nix
2023-12-14 15:18:24 +00:00
executor: nix-docker
Initial commit
2022-12-19 14:37:51 +00:00
steps:
- checkout
- run:
ci: move formatting checks to nix
2023-12-14 15:18:24 +00:00
name: Flake check
command: nix --experimental-features 'nix-command flakes' flake check
Initial commit
2022-12-19 14:37:51 +00:00
CI: Split build and test into separate jobs This will give us more flexibility later, e.g. allowing different steps for GCC and Clang (as needed for code coverage), or letting us parallelise our tests across multiple machines.
2023-02-01 18:03:42 +00:00
build:
# TODO this job could be run in Docker
executor: big-boy
Initial commit
2022-12-19 14:37:51 +00:00
parameters:
cc:
type: string
cxx:
type: string
Enable -Werror for Clang builds in CI Don't enable for local dev builds or for GCC CI builds, as every compiler version has a different set of warnings and trying to make them all pass is a neverending task.
2023-05-22 11:02:47 +01:00
warnings_as_errors:
type: string
Initial commit
2022-12-19 14:37:51 +00:00
environment:
CC: << parameters.cc >>
CXX: << parameters.cxx >>
CI: Add code coverage reporting Add CODE_COVERAGE option to enable coverage instrumentation in builds. Add new CI job to upload coverage reports to CodeCov.io. Reports can be found by navigating the codecov.io UI, or by going to the URL printed at the end of the "Code Coverage" CI job. More CodeCov integration could be set up later once we have coverage reporting on the main branch.
2023-02-03 09:47:57 +00:00
working_directory:
/tmp/object-introspection
Initial commit
2022-12-19 14:37:51 +00:00
steps:
- run:
name: Install dependencies
command: |
sudo apt-get update
sudo apt-get install -y \
bison \
build-essential \
clang-12 \
Update to clang/llvm 15 (#342) Summary: Update to clang-15 compiler and libraries as clang-12 is ancient. The changes to oilgen are necessary because the new internal toolchain is being more picky about linking PIC to PIC. In certain modes we build with PIC, but try to link a non-PIC oilgen artifact. Add the ability to build the oilgen artifacts with PIC which sorts this. Reviewed By: ttreyer Differential Revision: D46220858
2023-09-14 11:40:11 +01:00
clang-15 \
Initial commit
2022-12-19 14:37:51 +00:00
cmake \
flex \
gawk \
libboost-all-dev \
libbz2-dev \
libcap2-bin \
Update to clang/llvm 15 (#342) Summary: Update to clang-15 compiler and libraries as clang-12 is ancient. The changes to oilgen are necessary because the new internal toolchain is being more picky about linking PIC to PIC. In certain modes we build with PIC, but try to link a non-PIC oilgen artifact. Add the ability to build the oilgen artifacts with PIC which sorts this. Reviewed By: ttreyer Differential Revision: D46220858
2023-09-14 11:40:11 +01:00
libclang-15-dev \
Initial commit
2022-12-19 14:37:51 +00:00
libcurl4-gnutls-dev \
libdouble-conversion-dev \
libdw-dev \
libfmt-dev \
libgflags-dev \
libgmock-dev \
libgoogle-glog-dev \
libgtest-dev \
libjemalloc-dev \
libmsgpack-dev \
libzstd-dev \
Update to clang/llvm 15 (#342) Summary: Update to clang-15 compiler and libraries as clang-12 is ancient. The changes to oilgen are necessary because the new internal toolchain is being more picky about linking PIC to PIC. In certain modes we build with PIC, but try to link a non-PIC oilgen artifact. Add the ability to build the oilgen artifacts with PIC which sorts this. Reviewed By: ttreyer Differential Revision: D46220858
2023-09-14 11:40:11 +01:00
llvm-15-dev \
Initial commit
2022-12-19 14:37:51 +00:00
ninja-build \
pkg-config \
CI: Output junit result format directly from CTest Remove the conversion script we were previously using.
2023-02-01 18:06:31 +00:00
python3-setuptools
Initial commit
2022-12-19 14:37:51 +00:00
pip3 install toml
environment:
DEBIAN_FRONTEND: noninteractive
CI: Split build and test into separate jobs This will give us more flexibility later, e.g. allowing different steps for GCC and Clang (as needed for code coverage), or letting us parallelise our tests across multiple machines.
2023-02-01 18:03:42 +00:00
- checkout
Initial commit
2022-12-19 14:37:51 +00:00
- run:
name: Build
command: |
Enable -Werror for Clang builds in CI Don't enable for local dev builds or for GCC CI builds, as every compiler version has a different set of warnings and trying to make them all pass is a neverending task.
2023-05-22 11:02:47 +01:00
cmake -G Ninja -B build/ -DWITH_FLAKY_TESTS=Off -DCODE_COVERAGE=On -DWARNINGS_AS_ERRORS=<< parameters.warnings_as_errors >>
CI: Split build and test into separate jobs This will give us more flexibility later, e.g. allowing different steps for GCC and Clang (as needed for code coverage), or letting us parallelise our tests across multiple machines.
2023-02-01 18:03:42 +00:00
cmake --build build/
# Testing rubbish:
cp test/ci.oid.toml build/testing.oid.toml
- persist_to_workspace:
root: .
paths:
- build/*
- extern/*
- types/*
Initial commit
2022-12-19 14:37:51 +00:00
CI: Split build and test into separate jobs This will give us more flexibility later, e.g. allowing different steps for GCC and Clang (as needed for code coverage), or letting us parallelise our tests across multiple machines.
2023-02-01 18:03:42 +00:00
test:
executor: big-boy
Integration tests: Set up CI testing for TypeGraph CTest can't forward command line arguments to the test runner, so add the option to using an environment variable to enable features instead. CMake issue tracking the feature that would have been needed: https://gitlab.kitware.com/cmake/cmake/-/issues/20470 Tests which aren't passing yet have been disabled in CI.
2023-06-26 16:34:52 +01:00
parameters:
oid_test_args:
type: string
default: ""
tests_regex:
type: string
default: ".*"
exclude_regex:
type: string
default: ""
CI: Add code coverage reporting Add CODE_COVERAGE option to enable coverage instrumentation in builds. Add new CI job to upload coverage reports to CodeCov.io. Reports can be found by navigating the codecov.io UI, or by going to the URL printed at the end of the "Code Coverage" CI job. More CodeCov integration could be set up later once we have coverage reporting on the main branch.
2023-02-03 09:47:57 +00:00
working_directory:
/tmp/object-introspection
CI: Split build and test into separate jobs This will give us more flexibility later, e.g. allowing different steps for GCC and Clang (as needed for code coverage), or letting us parallelise our tests across multiple machines.
2023-02-01 18:03:42 +00:00
steps:
- attach_workspace:
at: .
- run:
name: Install dependencies
command: |
sudo apt-get update
sudo apt-get install -y \
Update to clang/llvm 15 (#342) Summary: Update to clang-15 compiler and libraries as clang-12 is ancient. The changes to oilgen are necessary because the new internal toolchain is being more picky about linking PIC to PIC. In certain modes we build with PIC, but try to link a non-PIC oilgen artifact. Add the ability to build the oilgen artifacts with PIC which sorts this. Reviewed By: ttreyer Differential Revision: D46220858
2023-09-14 11:40:11 +01:00
clang-15 \
update folly and enable ci usage
2023-02-23 23:32:15 +00:00
libboost-all-dev \
CI: Split build and test into separate jobs This will give us more flexibility later, e.g. allowing different steps for GCC and Clang (as needed for code coverage), or letting us parallelise our tests across multiple machines.
2023-02-01 18:03:42 +00:00
libgflags-dev \
Update to clang/llvm 15 (#342) Summary: Update to clang-15 compiler and libraries as clang-12 is ancient. The changes to oilgen are necessary because the new internal toolchain is being more picky about linking PIC to PIC. In certain modes we build with PIC, but try to link a non-PIC oilgen artifact. Add the ability to build the oilgen artifacts with PIC which sorts this. Reviewed By: ttreyer Differential Revision: D46220858
2023-09-14 11:40:11 +01:00
llvm-15-dev \
add test for folly::fbstring
2023-04-05 21:56:55 +01:00
libfmt-dev \
libjemalloc-dev
CI: Set installs to noninteractive so they don't hang waiting for user input
2023-08-01 16:58:06 +01:00
environment:
DEBIAN_FRONTEND: noninteractive
Initial commit
2022-12-19 14:37:51 +00:00
- run:
name: Test
environment:
# disable drgn multithreading as tests are already run in parallel
OMP_NUM_THREADS: 1
command: |
echo 0 | sudo tee /proc/sys/kernel/yama/ptrace_scope
Integration tests: Set up CI testing for TypeGraph CTest can't forward command line arguments to the test runner, so add the option to using an environment variable to enable features instead. CMake issue tracking the feature that would have been needed: https://gitlab.kitware.com/cmake/cmake/-/issues/20470 Tests which aren't passing yet have been disabled in CI.
2023-06-26 16:34:52 +01:00
OID_TEST_ARGS='<< parameters.oid_test_args >>' ctest \
--test-dir build/test/ \
--test-action Test \
-j 16 \
--tests-regex '<< parameters.tests_regex >>' \
--exclude-regex '<< parameters.exclude_regex >>' \
--no-compress-output \
--output-on-failure \
--schedule-random \
--timeout 60 \
ci: retry tests once on failure
2023-06-28 16:08:07 +01:00
--repeat until-pass:2 \
CI: Output junit result format directly from CTest Remove the conversion script we were previously using.
2023-02-01 18:06:31 +00:00
--output-junit results.xml
Initial commit
2022-12-19 14:37:51 +00:00
- store_test_results:
CI: Output junit result format directly from CTest Remove the conversion script we were previously using.
2023-02-01 18:06:31 +00:00
path: build/test/results.xml
CI: Add code coverage reporting Add CODE_COVERAGE option to enable coverage instrumentation in builds. Add new CI job to upload coverage reports to CodeCov.io. Reports can be found by navigating the codecov.io UI, or by going to the URL printed at the end of the "Code Coverage" CI job. More CodeCov integration could be set up later once we have coverage reporting on the main branch.
2023-02-03 09:47:57 +00:00
- persist_to_workspace:
# Save code coverage data
root: .
paths:
- build/*
coverage:
executor: ubuntu-docker
working_directory:
/tmp/object-introspection
steps:
- run:
name: Install dependencies
command: |
apt-get update
apt-get install -y \
Code Coverage: Reduce irrelevant partial branch matches The C++ compiler generates implicit branches for exception handling, which is particularly common when calling standard library functions. It's not generally useful to have tests for the case when std::vector::push_back fails due to an out-of-memory condition, so in this PR we use a feature in the latest lcov release to filter out these compiler-generated branches. Our code coverage numbers consequently go way up!
2023-06-21 21:03:48 +01:00
build-essential \
cpanminus \
CI: Add code coverage reporting Add CODE_COVERAGE option to enable coverage instrumentation in builds. Add new CI job to upload coverage reports to CodeCov.io. Reports can be found by navigating the codecov.io UI, or by going to the URL printed at the end of the "Code Coverage" CI job. More CodeCov integration could be set up later once we have coverage reporting on the main branch.
2023-02-03 09:47:57 +00:00
curl \
git \
Code Coverage: Reduce irrelevant partial branch matches The C++ compiler generates implicit branches for exception handling, which is particularly common when calling standard library functions. It's not generally useful to have tests for the case when std::vector::push_back fails due to an out-of-memory condition, so in this PR we use a feature in the latest lcov release to filter out these compiler-generated branches. Our code coverage numbers consequently go way up!
2023-06-21 21:03:48 +01:00
gpg
# Install lcov 2.0 - required for the "--filter branch" option.
# This improves C++ branch coverage by excluding compiler-generated
# branches, which primarily come from exception handling in
# standard library functions.
cpanm --notest Capture::Tiny DateTime
pushd /tmp
curl -sLO https://github.com/linux-test-project/lcov/releases/download/v2.0/lcov-2.0.tar.gz
tar -xf lcov-2.0.tar.gz
cd lcov-2.0
make install
popd
CI: Set installs to noninteractive so they don't hang waiting for user input
2023-08-01 16:58:06 +01:00
environment:
DEBIAN_FRONTEND: noninteractive
Code coverage: Checkout repo before running Apparently this is needed for CodeCov.io to work.
2023-02-03 16:26:22 +00:00
- checkout
CI: Add code coverage reporting Add CODE_COVERAGE option to enable coverage instrumentation in builds. Add new CI job to upload coverage reports to CodeCov.io. Reports can be found by navigating the codecov.io UI, or by going to the URL printed at the end of the "Code Coverage" CI job. More CodeCov integration could be set up later once we have coverage reporting on the main branch.
2023-02-03 09:47:57 +00:00
- attach_workspace:
at: .
- run:
name: Code Coverage
when: always
command: |
Code Coverage: Reduce irrelevant partial branch matches The C++ compiler generates implicit branches for exception handling, which is particularly common when calling standard library functions. It's not generally useful to have tests for the case when std::vector::push_back fails due to an out-of-memory condition, so in this PR we use a feature in the latest lcov release to filter out these compiler-generated branches. Our code coverage numbers consequently go way up!
2023-06-21 21:03:48 +01:00
lcov --capture --directory . --filter branch --no-external --ignore-errors mismatch --ignore-errors source --rc lcov_branch_coverage=1 --output-file coverage.info
CodeCov: Collect coverage from all source files The "src" directory got renamed to "oi" and the previous rule stopped matching our source code. By changing to collect coverage for everything except for "build" and "extern", we should avoid this problem in the future.
2023-05-24 16:14:19 +01:00
# Empirically, extract-then-remove is faster than remove-then-extract
lcov --extract coverage.info '/tmp/object-introspection/*' --rc lcov_branch_coverage=1 --output-file coverage.info
lcov --remove coverage.info '/tmp/object-introspection/build/*' '/tmp/object-introspection/extern/*' --rc lcov_branch_coverage=1 --output-file coverage.info
CI: Add code coverage reporting Add CODE_COVERAGE option to enable coverage instrumentation in builds. Add new CI job to upload coverage reports to CodeCov.io. Reports can be found by navigating the codecov.io UI, or by going to the URL printed at the end of the "Code Coverage" CI job. More CodeCov integration could be set up later once we have coverage reporting on the main branch.
2023-02-03 09:47:57 +00:00
lcov --list --rc lcov_branch_coverage=1 coverage.info
curl https://keybase.io/codecovsecurity/pgp_keys.asc | gpg --no-default-keyring --keyring trustedkeys.gpg --import
curl -Os https://uploader.codecov.io/latest/linux/codecov
curl -Os https://uploader.codecov.io/latest/linux/codecov.SHA256SUM
curl -Os https://uploader.codecov.io/latest/linux/codecov.SHA256SUM.sig
gpgv codecov.SHA256SUM.sig codecov.SHA256SUM
shasum -a 256 -c codecov.SHA256SUM
chmod +x codecov
# It appears that codecov wants to scan through all directories
# other than "build", looking for files to upload, even if we
# specify a file name on the command line.
#
# "extern" is huge and makes uploading the coverage report take
# forever. Delete it for a speedup.
rm -rf extern
Pass in CodeCov.io token through CI env var CodeCov's docs say that a token isn't required for a public repository, but our uploads have been broken for a few weeks at this point and passing in the token fixes them...
2023-04-21 13:50:29 +01:00
./codecov -Z -f coverage.info -t $CODECOV_TOKEN
Reference in New Issue Copy Permalink