-
Notifications
You must be signed in to change notification settings - Fork 23
Description
Describe the bug
We have a pipeline that runs multiple pytests in parallel. For every test an allure stage and environment is defined.
We have an issue where if we select an environment in the dynamics graph it only shows the tests for the specific environment for the last test, but for the previous tests it shows the result for all environments.
It might be that we have misconfigured the dashboard generation. To reproduce see the following section.
To Reproduce
Per test we run the following command:
allure run \
--config=./allurerc.yaml \
--environment="<< TEST NAME >>" \
--stage="allure-results-<< TEST NAME >>" \
-- \
uv run pytest tests/agent_tests/test_<< TEST NAME>>.py -v -s -o log_cli=true --alluredir=./allure-results
When this command is run for multiple tests we have multiple .zip stage files. These files are used for generating the report using the following command:
allure generate --stage="allure-results-*.zip" --output=./allure-report
The results is the result shown in the images.
For reference this is the allurerc.yaml:
name: Allure Agentic Report
output: ./allure-report
historyPath: ./history/history.jsonl
Expected behavior
For reference this is what the all environment graphs look like:
**Screenshots**
Desktop (please complete the following information):
- OS: Ubuntu 24.04
- Browser Chrome
- Version 3.2
Thank you for working on allure v3 🙏
