Skip to content

Conversation

@dan-stowell
Copy link
Contributor

This change allows the buildbuddy_dev_qa_test target to run tests across the server, app, and enterprise directory trees. This brings the coverage of this test on par with the existing dev_qa.py test (and on a much more recent version of the codebase, to boot). Once we have cut a release that includes this change, I'll point the dev qa workflow at the //tools/dev_qa_test/... targets.

Copy link
Contributor

@sluongng sluongng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This brings the coverage of this test on par with the existing dev_qa.py test

The current dev_qa.py has this

        "repo_url": "https://github.com/buildbuddy-io/buildbuddy",
        "commit_sha": "a97d4303c9485db089a33a1049fe480d0122687d",
        "command": """
            bazel test //... \
                ...
                --test_tag_filters=-docker,-bare,-performance \

So we are not quite on par?

Comment on lines +114 to +115
build:dev_qa_test --compilation_mode=fastbuild
build:dev_qa_test --host_compilation_mode=fastbuild
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These should already be the default mode? any reason to set them explicitly?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I added this flags while trying to get builds to work over different targets. Perhaps I can take them out now and things will just work! 🤞

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Keeping these fastbuild flags in allows test //... to run successfully.
Removing the flags yields failures. I'm not sure why. Doesn't seem awful to leave them in for now?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you share an invocation with such failures? They are mildly concerning

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I found the (a?) problem: https://buildbuddy.buildbuddy.dev/invocation/9ae0f20d-61d8-48b0-be09-2be6b2b46800
That invocation does not pass --host_compilation_mode or --compilation_mode flags.

//server/version:populate_version tries to grep for STABLE_VERSION_TAG from bazel-out/stable-status.txt. I'm assuming that when building a release tarball, that file does not exist?

The populate_version target will simply touch $@ for fastbuild builds.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One way to fix this would be to provide a default (such as dev) in case the grep fails.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dan-stowell
Copy link
Contributor Author

This brings the coverage of this test on par with the existing dev_qa.py test

The current dev_qa.py has this

        "repo_url": "https://github.com/buildbuddy-io/buildbuddy",
        "commit_sha": "a97d4303c9485db089a33a1049fe480d0122687d",
        "command": """
            bazel test //... \
                ...
                --test_tag_filters=-docker,-bare,-performance \

So we are not quite on par?

Not quite. I'll try test //....

build:dev_qa_test --workspace_status_command=
build:dev_qa_test --compilation_mode=fastbuild
build:dev_qa_test --host_compilation_mode=fastbuild
build:dev_qa_test --test_tag_filters=-block-network,-performance,-webdriver,-docker,-bare
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why filter out tests with block-network?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It was an attempt to avoid tests that caused the fetching of all the bazel binaries under //server/util/bazel.
Let me clear that filter and re-run.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Running test //... without -block-network succeeds!

@dan-stowell dan-stowell changed the title [dev qa test] build and test //server/..., //app/..., and //enterprise/... targets in buildbuddy_dev_qa_test [dev qa test] test //... in buildbuddy_dev_qa_test Dec 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants