Skip to content

python: waiting arguments for pipeline.clear_storage()#5808

Merged
snkas merged 1 commit intomainfrom
py-pipeline-clear-wait
Mar 12, 2026
Merged

python: waiting arguments for pipeline.clear_storage()#5808
snkas merged 1 commit intomainfrom
py-pipeline-clear-wait

Conversation

@snkas
Copy link
Contributor

@snkas snkas commented Mar 12, 2026

Before, it was only possible to clear storage in a blocking way using the pipeline.clear_storage() function. Now, it's possible to specify whether to wait, and as well how long and at which frequency to check if storage has been cleared. The default behavior of calling the function without arguments remains, which is to wait indefinitely.

Tests are added accordingly, including one future test that is skipped for now but will be made to pass in a follow-up PR.

PR information

  • Integration tests added
  • Documentation updated
  • One minor breaking change: FelderaClient.clear_storage(...) has its optional named argument timeout_s position changed to be after wait. Given it's an optional named argument (not positional) and it's the FelderaClient (not Pipeline) and thus shouldn't be used directly, this is an acceptable change.

@snkas snkas requested review from abhizer, gz and mythical-fred March 12, 2026 14:30
Before, it was only possible to clear storage in a blocking way using
the `pipeline.clear_storage()` function. Now, it's possible to specify
whether to wait, and as well how long and at which frequency to check if
storage has been cleared. The default behavior of calling the function
without arguments remains, which is to wait indefinitely.

Tests are added accordingly, including one future test that is skipped
for now but will be made to pass in a follow-up PR.

Signed-off-by: Simon Kassing <simon.kassing@feldera.com>
@snkas snkas force-pushed the py-pipeline-clear-wait branch from e08b308 to 6c56260 Compare March 12, 2026 17:07
@snkas snkas requested a review from mythical-fred March 12, 2026 17:11
@snkas snkas added this pull request to the merge queue Mar 12, 2026
Merged via the queue into main with commit 352a7ae Mar 12, 2026
1 check passed
@snkas snkas deleted the py-pipeline-clear-wait branch March 12, 2026 18:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants