Troubleshooting overview
Use this page to triage a CubeCOS issue before you dig into a specific area. Start with the cluster-wide health checks below, then move to the guide for the affected workload.
Before you beginβ
Some checks in the following sections require SSH access to the CubeCOS cluster virtual IP (VIP) as the admin user, or access to the OpenStack CLI on a controller node. Ask your platform administrator for access if you don't have it.
Check the overall cluster healthβ
Start with a cluster-wide health check. Many instance, network, and storage problems trace back to a service reported here.
-
Web UI: Review the health indicator panel in the dashboard. If it reports an error, click Repair to run an automated recovery action.
-
CLI: Log in to the VIP with SSH, then run
cluster check_repair.Check cluster service healthssh admin@<cluster-vip>Run a service health checkcontroller> cluster check_repairEach row lists a service (for example,
Network,Compute,Storage) and a status ofokorFIXING. AFIXINGrow identifies the failing component in brackets, such asneutron(3)for a network issue ornova(8)for a compute issue.For the full command output and an explanation of each service, see Monitor and repair CubeCOS services using the web UI or CLI.
Review logs and eventsβ
If the cluster health check doesn't explain the issue, review the logs for the affected resource.
- Instance action logs: Navigate to Compute > Instances, select the instance, open the Action Logs tab, and click Analyze on the event you want to investigate.
- Cluster-wide log search: Navigate to
http://<cluster-vip>:5601/opensearch-dashboards/app/data-explorer/discoverto query logs across all CubeCOS services.
For more information, see Log analysis in CubeCOS.
Check for existing alertsβ
Navigate to Events > Triggers to see whether an existing trigger already caught the issue, and to review any notifications it sent. For more information, see Manage triggers.