Skip to content

Investigate Go test run time on ubuntu-large #2630

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
masih wants to merge 10 commits into
base: main
Choose a base branch
from
Open

Investigate Go test run time on ubuntu-large #2630

Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
c170756
Investigate Go test run time on ubuntu-large
masih Dec 17, 2025
d657c9f
Merge branch 'main' into masih/run-tests-on-ubuntu-large
masih Dec 17, 2025
c8f57b4
Skip sei-iavl tests as they take waay too long
masih Dec 17, 2025
e533238
Merge branch 'main' into masih/run-tests-on-ubuntu-large
masih Dec 17, 2025
4c42141
Bump explicit parallelism
masih Dec 17, 2025
cef4e65
Skip sei-iavl and refine config
masih Dec 17, 2025
d841680
Try sharding even though we might miss cross package races
masih Dec 17, 2025
78c61f6
Reduce sharding and fall back to latest instance
masih Dec 17, 2025
0f3fbf5
Do not prune docker images as it takes too long
masih Dec 17, 2025
73053c5
Poke the CI to run again
masih Dec 18, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 23 additions & 6 deletions .github/workflows/go-test.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,11 +15,14 @@ jobs:
tests:
env:
GO_TEST_TIMEOUT: 30m
name: "Test ${{ matrix.modules.name }}"
GO_TEST_SKIP_PACKAGES: "sei-iavl"
name: "Test ${{ matrix.modules.name }} (${{ matrix.shard }}/${{ matrix.total_shards }})"
runs-on: ubuntu-latest
strategy:
fail-fast: false
matrix:
total_shards: [2]
shard: [1, 2]
modules:
- name: sei-chain
path: ./
Expand All @@ -37,21 +40,35 @@ jobs:
- name: Remove unnecessary tooling
run: |
# Remove unrelated tooling to open up more space. Without doing
# this ~80% of the available 15GiB space is already occupied.
# this ~80% of the available 15 GiB space is already occupied.
sudo rm -rf \
/usr/share/dotnet \
/usr/local/lib/android \
/opt/ghc /opt/hostedtoolcache/CodeQL
sudo docker image prune --all --force
- name: Go test with race detector
working-directory: '${{ matrix.modules.path }}'
run: go test -race -tags='${{ matrix.modules.tags }}' -timeout='${{env.GO_TEST_TIMEOUT}}' -covermode=atomic -coverprofile=coverage.out ./...
run: |
if [ -n "$GO_TEST_SKIP_PACKAGES" ]; then
ALL_PACKAGES=$(go list ./... | grep -v -E "$GO_TEST_SKIP_PACKAGES")
else
ALL_PACKAGES=$(go list ./...)
fi

# Split packages into shards
PACKAGES=$(echo "$ALL_PACKAGES" | awk "NR % ${{ matrix.total_shards }} == ${{ matrix.shard }} - 1")

if [ -n "$PACKAGES" ]; then
go test -race -tags='${{ matrix.modules.tags }}' -timeout='${{env.GO_TEST_TIMEOUT}}' -covermode=atomic -coverprofile=coverage.out $PACKAGES
else
echo "No packages in this shard"
touch coverage.out
fi
- name: Upload coverage to Codecov
uses: codecov/codecov-action@v5
with:
token: ${{ secrets.CODECOV_TOKEN }}
fail_ci_if_error: 'true'
fail_ci_if_error: 'false'
disable_search: 'true'
name: '${{ matrix.modules.name }}-coverage'
name: '${{ matrix.modules.name }}-shard-${{ matrix.shard }}-coverage'
files: ${{ matrix.modules.path }}/coverage.out
flags: ${{ matrix.modules.name }}
Loading