Skip to content

[PLAT-129166] fix parallel db update#12

Merged
jnyi merged 2 commits intodatabricks:db_mainfrom
jnyi:PLAT-129166-parallel-db-update
Mar 15, 2025
Merged

[PLAT-129166] fix parallel db update#12
jnyi merged 2 commits intodatabricks:db_mainfrom
jnyi:PLAT-129166-parallel-db-update

Conversation

@jnyi
Copy link

@jnyi jnyi commented Mar 14, 2025

To ensure only update the next statefulset until previous statefulset is considered ready. We should check desired replicas using Spec.Replicas instead of Status.Replicas which will overlook when multiple pods are deleted. See previous incident:

Screenshot 2025-03-14 at 11 53 54 AM

Tested this works:

Screenshot 2025-03-14 at 5 47 10 PM

Signed-off-by: Yi Jin <yi.jin@databricks.com>
@jnyi jnyi requested review from hczhu-db and yuchen-db March 14, 2025 19:04
if p.Status.Phase == corev1.PodRunning {
return 1 // Running pods are ranked higher and will be updated last.
}
return 0 // Running pods are ranked lower and will be updated first.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: Non-runnign pods

@jnyi jnyi force-pushed the PLAT-129166-parallel-db-update branch 9 times, most recently from 6fceaa3 to 7c89b53 Compare March 15, 2025 01:12
Signed-off-by: Yi Jin <yi.jin@databricks.com>
@jnyi jnyi force-pushed the PLAT-129166-parallel-db-update branch from 7c89b53 to 71ce581 Compare March 15, 2025 01:13
@jnyi jnyi merged commit 2d46643 into databricks:db_main Mar 15, 2025
5 checks passed
@jnyi jnyi mentioned this pull request Mar 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants