Skip to content

[update] Restore Ceph after EDPM reboot - #4191

Open
srac0 wants to merge 2 commits into
openstack-k8s-operators:mainfrom
srac0:update/remove-ceph-stray-daemon
Open

[update] Restore Ceph after EDPM reboot#4191
srac0 wants to merge 2 commits into
openstack-k8s-operators:mainfrom
srac0:update/remove-ceph-stray-daemon

Conversation

@srac0

@srac0 srac0 commented Sep 18, 2026

Copy link
Copy Markdown
Contributor

No description provided.

@openshift-ci

openshift-ci Bot commented Sep 18, 2026

Copy link
Copy Markdown
Contributor

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Sep 18, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/ec14b75026ff4a23b210b1507d005b3b

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 40m 31s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 23m 06s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 37m 59s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 05m 14s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 09s
✔️ openstack-k8s-operators-content-provider-bootc SUCCESS in 1h 19m 03s
❌ cifmw-crc-podified-edpm-baremetal-bootc NODE_FAILURE Node(set) request 099-0000207011 failed in 0s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 01s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 39s
✔️ cifmw-molecule-update SUCCESS in 5m 55s

@srac0
srac0 force-pushed the update/remove-ceph-stray-daemon branch from 11ad381 to 0f63525 Compare September 18, 2026 17:03
@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Sep 18, 2026

Copy link
Copy Markdown

Build succeeded (check pipeline).
https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/5e6a656b788e4c30bde86cb159974720

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 24m 31s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 22m 39s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 28m 19s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 02m 28s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 25s
✔️ openstack-k8s-operators-content-provider-bootc SUCCESS in 2h 07m 12s
✔️ cifmw-crc-podified-edpm-baremetal-bootc SUCCESS in 1h 28m 36s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 30s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 16s
✔️ cifmw-molecule-update SUCCESS in 5m 54s

@srac0
srac0 force-pushed the update/remove-ceph-stray-daemon branch from 0f63525 to 1e26e8b Compare September 20, 2026 11:16
@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Sep 20, 2026

Copy link
Copy Markdown

Build succeeded (check pipeline).
https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/ecae8aacc91a4eeba2e66a8db79c4c9c

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 08m 15s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 25m 40s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 29m 45s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 1h 55m 10s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 33s
✔️ openstack-k8s-operators-content-provider-bootc SUCCESS in 2h 05m 00s
✔️ cifmw-crc-podified-edpm-baremetal-bootc SUCCESS in 1h 29m 49s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 21s
✔️ cifmw-pod-pre-commit SUCCESS in 7m 58s
✔️ cifmw-molecule-update SUCCESS in 5m 37s

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Sep 23, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/e33c3233867e4006a2fb880b44792f8e

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 16m 30s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 24m 27s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 38m 32s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 03m 43s
✔️ cifmw-pod-zuul-files SUCCESS in 4m 47s
❌ openstack-k8s-operators-content-provider-bootc FAILURE in 18m 23s
⚠️ cifmw-crc-podified-edpm-baremetal-bootc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider-bootc
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 43s
✔️ cifmw-pod-pre-commit SUCCESS in 8m 27s
✔️ cifmw-molecule-update SUCCESS in 5m 44s

@srac0
srac0 force-pushed the update/remove-ceph-stray-daemon branch from 358be02 to 8855f0e Compare September 29, 2026 07:51
@srac0
srac0 marked this pull request as ready for review September 29, 2026 07:51
@qodo-code-review

qodo-code-review Bot commented Sep 29, 2026

Copy link
Copy Markdown

Qodo reviews are paused for this user.

Troubleshooting steps vary by plan Learn more →

On a Teams plan?
Reviews resume once this user has a paid seat and their Git account is linked in Qodo.
Link Git account →

Using GitHub Enterprise Server, GitLab Self-Managed, or Bitbucket Data Center?
These require an Enterprise plan - Contact us
Contact us →

@srac0 srac0 changed the title [update] Remove stray Ceph mgr daemon after hypervisor reboot [update] Restore Ceph after EDPM reboot Sep 29, 2026
@srac0
[update] Add option to re-apply Ceph MON IPs
64a7bf1 
In adoption HCI scenarios where Ceph MON IPs are assigned to compute nodes, these IPs
are not persisted in NetworkManager profiles. After a compute node reboot, the
IPs must be manually re-applied to the storage VLAN interface to restore Ceph
connectivity. This change adds an optional feature to automate that step.

Signed-off-by: Samuel Rac <srac@redhat.com>
@srac0
srac0 force-pushed the update/remove-ceph-stray-daemon branch from 8855f0e to 7f6b00e Compare September 29, 2026 08:06
@srac0
[update] Fail over a stray active Ceph manager after reboot
1ef09af 
A leftover ceph controller manager can become active after adoption and
report no capacity. Detect that exact daemon and fail it so a another
standby controller takes over.

Signed-off-by: Samuel Rac <srac@redhat.com>
@srac0
srac0 force-pushed the update/remove-ceph-stray-daemon branch from 7f6b00e to 1ef09af Compare September 29, 2026 08:22
@openshift-ci

openshift-ci Bot commented Sep 29, 2026

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign dasm for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Sep 29, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/144fc463a5d44938a980e1e05120779d

✔️ openstack-k8s-operators-content-provider SUCCESS in 5h 15m 50s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 24m 50s
✔️ podified-multinode-edpm-deployment-crc-centos-10 SUCCESS in 1h 27m 41s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 33m 33s
✔️ cifmw-crc-podified-edpm-baremetal-minor-update SUCCESS in 2h 04m 17s
❌ cifmw-pod-zuul-files FAILURE in 2m 47s
❌ openstack-k8s-operators-content-provider-bootc FAILURE in 5m 38s
⚠️ cifmw-crc-podified-edpm-baremetal-bootc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider-bootc
✔️ noop SUCCESS in 0s
❌ cifmw-pod-ansible-test FAILURE in 2m 46s
❌ cifmw-pod-pre-commit FAILURE in 2m 59s
❌ cifmw-molecule-update FAILURE in 6m 31s

@michburk

michburk commented Sep 29, 2026

Copy link
Copy Markdown
Contributor

recheck

@michburk

michburk commented Sep 29, 2026

Copy link
Copy Markdown
Contributor

/retest-required

@centosinfra-prod-github-app

centosinfra-prod-github-app Bot commented Sep 29, 2026

Copy link
Copy Markdown

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/rdoproject.org/buildset/fce1bd53efd3439ea59b4b2ee4abe8e0

❌ openstack-k8s-operators-content-provider FAILURE in 5m 42s
⚠️ podified-multinode-edpm-deployment-crc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ podified-multinode-edpm-deployment-crc-centos-10 SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ cifmw-crc-podified-edpm-baremetal SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
⚠️ cifmw-crc-podified-edpm-baremetal-minor-update SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider
✔️ cifmw-pod-zuul-files SUCCESS in 4m 33s
❌ openstack-k8s-operators-content-provider-bootc FAILURE in 5m 26s
⚠️ cifmw-crc-podified-edpm-baremetal-bootc SKIPPED Skipped due to failed job openstack-k8s-operators-content-provider-bootc
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 32s
✔️ cifmw-pod-pre-commit SUCCESS in 7m 58s
✔️ cifmw-molecule-update SUCCESS in 5m 37s

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@srac0 @michburk