Skip to content

Improve copy-deduplicate efficiency and speed #7912

@data-sync-user

Description

@data-sync-user

We should investigate how the existing copy_deduplicate DAG can be sped up (it’s currently running for 2h) and if there are other efficiency improvements that can be made

┆Issue is synchronized with this Jira Task

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions