Skip to content

[docs] add merge code example to delta docs#5845

Merged
anandbraman merged 2 commits intomainfrom
anandraman/fde-30-document-merge-code-for-delta-outputs
Mar 17, 2026
Merged

[docs] add merge code example to delta docs#5845
anandbraman merged 2 commits intomainfrom
anandraman/fde-30-document-merge-code-for-delta-outputs

Conversation

@anandbraman
Copy link
Contributor

Describe Manual Test Plan

Checklist

  • Unit tests added/updated
  • Integration tests added/updated
  • Documentation updated
  • Changelog updated

Breaking Changes?

Mark if you think the answer is yes for any of these components:

Describe Incompatible Changes

Copy link
Contributor

@ryzhyk ryzhyk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Please create an issue to add a test for this in either the main repo or the QA repo.

Update docs.feldera.com/docs/connectors/sinks/delta.md

Co-authored-by: Leonid Ryzhyk <ryzhyk@gmail.com>
Signed-off-by: Anand Raman <49171658+anandbraman@users.noreply.github.com>

Update docs.feldera.com/docs/connectors/sinks/delta.md

Co-authored-by: Leonid Ryzhyk <ryzhyk@gmail.com>
Signed-off-by: Anand Raman <49171658+anandbraman@users.noreply.github.com>

Update docs.feldera.com/docs/connectors/sinks/delta.md

Co-authored-by: Leonid Ryzhyk <ryzhyk@gmail.com>
Signed-off-by: Anand Raman <49171658+anandbraman@users.noreply.github.com>
@anandbraman anandbraman force-pushed the anandraman/fde-30-document-merge-code-for-delta-outputs branch from 31388dd to 7162b86 Compare March 17, 2026 15:32
@anandbraman anandbraman enabled auto-merge March 17, 2026 15:32
Signed-off-by: feldera-bot <feldera-bot@feldera.com>
@anandbraman anandbraman added this pull request to the merge queue Mar 17, 2026
FROM {source_table}
-- Only consider new updates since the last merge.
WHERE __feldera_ts >= (
SELECT COALESCE(MAX(__feldera_ts), 0)

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The subquery reads from {target_table} inside the USING clause, which is the same table being merged into. This self-reference is legal in Delta Lake but can behave differently across Spark versions — worth a note in the surrounding prose so readers know to validate against their environment.

Merged via the queue into main with commit 4b5272b Mar 17, 2026
1 check passed
@anandbraman anandbraman deleted the anandraman/fde-30-document-merge-code-for-delta-outputs branch March 17, 2026 16:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants