Skip to content

Update overview.md #3955

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Update overview.md #3955

wants to merge 1 commit into from

Conversation

aashishkohli
Copy link
Contributor

Added section to outline backup and restore duration guidance.

Summary

Checklist

Added section to outline backup and restore duration guidance.
@aashishkohli aashishkohli requested a review from a team as a code owner June 17, 2025 00:13
Copy link

vercel bot commented Jun 17, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
clickhouse-docs ❌ Failed (Inspect) 💬 Add feedback Jun 17, 2025 0:13am
clickhouse-docs-jp 🔄 Building (Inspect) Visit Preview 💬 Add feedback Jun 17, 2025 0:13am
2 Skipped Deployments
Name Status Preview Comments Updated (UTC)
clickhouse-docs-ru ⬜️ Ignored (Inspect) Visit Preview Jun 17, 2025 0:13am
clickhouse-docs-zh ⬜️ Ignored (Inspect) Visit Preview Jun 17, 2025 0:13am


Restore durations are about the same as the backup durations.

We recommend testing with your own database and sample data to get better estimates as the actual duration depends on several factors as outlined above.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
We recommend testing with your own database and sample data to get better estimates as the actual duration depends on several factors as outlined above.
We recommend testing with your own database or sample data to get better estimates as the actual duration depends on several factors as outlined above.


In our testing, we have seen that smaller backups ~1 TB could take up to 10-15 mins or longer to backup. Backups less than 20 TB should complete within an hour, and backing up 50 TB of data should take about 2-3 hours. Backups get economies of scale at larger sizes, and we have seen backups of up to 1 PB for some internal services complete in about 10 hours.

Restore durations are about the same as the backup durations.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Check this


Backup and restore durations depend on several factors such as the size of the database as well as the schema and the number of tables in the database. Incremental backups will usually complete much faster than a full backup as less data is being backed up. Restoring from an incremental backup, however, will not be faster than restoring from a full backup as all incremental backups and the last full backup in the chain have to be included in the restore as explained above.

In our testing, we have seen that smaller backups ~1 TB could take up to 10-15 mins or longer to backup. Backups less than 20 TB should complete within an hour, and backing up 50 TB of data should take about 2-3 hours. Backups get economies of scale at larger sizes, and we have seen backups of up to 1 PB for some internal services complete in about 10 hours.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should note these are VERY broad generalizations

@@ -171,6 +171,16 @@ SYNC SETTINGS max_table_size_to_drop=2097152 -- increases the limit to 2TB
```
:::

## Backup and Restore Duration

Backup and restore durations depend on several factors such as the size of the database as well as the schema and the number of tables in the database. Incremental backups will usually complete much faster than a full backup as less data is being backed up. Restoring from an incremental backup, however, will not be faster than restoring from a full backup as all incremental backups and the last full backup in the chain have to be included in the restore as explained above.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Restoring incremental backups are slightly slower

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants