Update CubeOS
Update CubeOS
USB drive
copy CUBE_1.3.10_20200725-0932_a4d7645.pkg into usb drive (format: fat or exfat)
Plug the usb to the server
SCP
upload CUBE_1.3.10_20200725-0932_a4d7645.pkg to your server over scp, directory: /var/update
$ scp CUBE_1.3.10_20200725-0932_a4d7645.pkg [email protected]:/var/update/
Connect to console
$ ssh [email protected]
Warning: Permanently added '192.168.1.x' (ECDSA) to the list of known hosts.
Password:
Run Health Check
CLI: cluster> health
mas> cluster
mas:cluster> health
[ ClusterLink ]
link:
Ping 10.32.2.223 ... OK
[ ClusterSettings ]
etcd:
member 30de40f11f33c57 is healthy: got healthy result from http://10.32.2.223:2379
cluster is healthy
[ HaCluster ]
hacluster:
Last updated: Mon Jul 27 20:29:36 2020 Last change: Mon Jul 27 16:36:03 2020 by root via cibadmin on mas
Stack: corosync
Current DC: mas (version 1.1.14-70404b0) - partition with quorum
1 node and 0 resources configured
Online: [ mas ]
Full list of resources:
[ MsgQueue ]
rabbitmq:
Cluster status of node rabbit@mas ...
[{nodes,[{disc,[rabbit@mas]}]},
{running_nodes,[rabbit@mas]},
{cluster_name,<<"rabbit@localhost">>},
{partitions,[]}]
Listing queues ...
central <[email protected]>
central.mas <[email protected]>
central_fanout_09af33c096b14ed3adc647a04e4468b4 <[email protected]>
cinder-backup <[email protected]>
cinder-backup.mas <[email protected]>
[ IaasDb ]
mysql:
wsrep_cluster_status Disconnected
wsrep_cluster_size 0
[ VirtualIp ]
vip:
non-HA
haproxy_ha:
non-HA
[ Storage ]
ceph:
cluster:
id: c6e64c49-09cf-463b-9d1c-b6645b4b3b85
health: HEALTH_OK
services:
mon: 1 daemons, quorum mas
mgr: mas(active)
mds: cephfs-1/1/1 up {0=mas=up:active}
osd: 6 osds: 6 up, 6 in
rgw: 1 daemon active
data:
pools: 22 pools, 1420 pgs
objects: 743 objects, 723MiB
usage: 6.39GiB used, 504GiB / 511GiB avail
pgs: 1420 active+clean
[ ApiService ]
haproxy:
(mas)
# pxname svname check_status
openstack_horizon localhost L4OK
grafana_backend localhost L4OK
kibana_backend localhost L4OK
cube_lmi localhost L4OK
apache2:
+------------+--------------+------------+
| Status | API Endpoint | Error Code |
+------------+--------------+------------+
| healthy | available | 0 |
+------------+--------------+------------+
lmi:
+------------+--------------+------------+
| Status | API Endpoint | Error Code |
+------------+--------------+------------+
| healthy | available | 0 |
+------------+--------------+------------+
memcache:
+------------+------------+
| Status | Error Code |
+------------+------------+
| healthy | 0 |
+------------+------------+
[ Compute ]
nova:
+----+------------------+------+----------+---------+-------+----------------------------+
| ID | Binary | Host | Zone | Status | State | Updated At |
+----+------------------+------+----------+---------+-------+----------------------------+
| 1 | nova-consoleauth | mas | internal | enabled | up | 2020-07-27T12:29:48.000000 |
| 2 | nova-conductor | mas | internal | enabled | up | 2020-07-27T12:29:40.000000 |
| 3 | nova-scheduler | mas | internal | enabled | up | 2020-07-27T12:29:41.000000 |
| 4 | nova-compute | mas | nova | enabled | up | 2020-07-27T12:29:47.000000 |
+----+------------------+------+----------+---------+-------+----------------------------+
[ Network ]
neutron:
+--------------------------------------+--------------------+------+-------------------+-------+-------+---------------------------+
| ID | Agent Type | Host | Availability Zone | Alive | State | Binary |
+--------------------------------------+--------------------+------+-------------------+-------+-------+---------------------------+
| 485c190c-a74c-4988-9653-6f37e116f55f | Metadata agent | mas | None | :-) | UP | neutron-metadata-agent |
| 751c58d4-ecb9-49d3-8e9a-7ca3aff6bdbf | Linux bridge agent | mas | None | :-) | UP | neutron-linuxbridge-agent |
| f9801373-ad30-4b62-9a0e-8fea0aab1bcd | DHCP agent | mas | nova | :-) | UP | neutron-dhcp-agent |
| fcc0f77f-491f-48c3-b20d-9d55c80a5a10 | L3 agent | mas | nova | :-) | UP | neutron-l3-agent |
+--------------------------------------+--------------------+------+-------------------+-------+-------+---------------------------+
[ Image ]
glance:
+------------+--------------+------------+
| Status | API Endpoint | Images |
+------------+--------------+------------+
| unhealthy | unavailable | N/A |
+------------+--------------+------------+
[ BlockStor ]
cinder:
+------------------+-----------+------+---------+-------+----------------------------+
| Binary | Host | Zone | Status | State | Updated At |
+------------------+-----------+------+---------+-------+----------------------------+
| cinder-backup | mas | nova | enabled | up | 2020-07-27T12:29:55.000000 |
| cinder-volume | cube@ceph | nova | enabled | up | 2020-07-27T12:29:56.000000 |
| cinder-scheduler | mas | nova | enabled | up | 2020-07-27T12:29:48.000000 |
+------------------+-----------+------+---------+-------+----------------------------+
[ FileStor ]
manila:
+----+------------------+------------------+------+---------+-------+----------------------------+
| Id | Binary | Host | Zone | Status | State | Updated_at |
+----+------------------+------------------+------+---------+-------+----------------------------+
| 1 | manila-share | mas@cephfsnative | nova | enabled | up | 2020-07-27T12:29:56.000000 |
| 2 | manila-scheduler | mas | nova | enabled | up | 2020-07-27T12:29:56.000000 |
| 3 | manila-share | mas@generic | nova | enabled | up | 2020-07-27T12:29:56.000000 |
+----+------------------+------------------+------+---------+-------+----------------------------+
[ ObjectStor ]
swift:
+------------+--------------+--------+------------+------------+
| Status | API Endpoint | Tenant | Containers | Objects |
+------------+--------------+--------+------------+------------+
| healthy | available | admin | 0 | 0 |
+------------+--------------+--------+------------+------------+
[ Orchestration ]
heat:
+------------+--------------+------------------+
| Status | API Endpoint | Engine (Up/Down) |
+------------+--------------+------------------+
| unhealthy | unavailable | 0/0 |
+------------+--------------+------------------+
[ LBaaS ]
octavia:
+------------+--------------+------------+
| Status | API Endpoint | Error Code |
+------------+--------------+------------+
| unhealthy | unavailable | 1 |
+------------+--------------+------------+
[ DNSaaS ]
designate:
+------------+--------------+------------+
| Status | API Endpoint | Error Code |
+------------+--------------+------------+
| unhealthy | unavailable | 1 |
+------------+--------------+------------+
[ InstanceHa ]
masakari:
+------------+------------+
| Status | Error Code |
+------------+------------+
| healthy | 0 |
+------------+------------+
[ DisasterRecovery ]
freezer:
+------------+--------------+------------+
| Status | API Endpoint | Error Code |
+------------+--------------+------------+
| unhealthy | unavailable | 1 |
+------------+--------------+------------+
es235:
+------------+------------+
| Status | Error Code |
+------------+------------+
| healthy | 0 |
+------------+------------+
[ DataPipe ]
zookeeper:
+------------+------------+
| Status | Error Code |
+------------+------------+
| unhealthy | 1 |
+------------+------------+
kafka:
+------------+------------+
| Status | Error Code |
+------------+------------+
| healthy | 0 |
+------------+------------+
[ Metrics ]
ceilometer:
+------------+------------+
| Status | Error Code |
+------------+------------+
| healthy | 0 |
+------------+------------+
monasca:
+------------+------------+
| Status | Error Code |
+------------+------------+
| unhealthy | 1 |
+------------+------------+
telegraf:
+------------+------------+
| Status | Error Code |
+------------+------------+
| unhealthy | 1 |
+------------+------------+
grafana:
+------------+--------------+------------+
| Status | API Endpoint | Error Code |
+------------+--------------+------------+
| healthy | available | 0 |
+------------+--------------+------------+
[ LogAnalytics ]
filebeat:
+------------+------------+
| Status | Error Code |
+------------+------------+
| healthy | 0 |
+------------+------------+
auditbeat:
+------------+------------+
| Status | Error Code |
+------------+------------+
| healthy | 0 |
+------------+------------+
logstash:
+------------+------------+
| Status | Error Code |
+------------+------------+
| healthy | 0 |
+------------+------------+
es:
+------------+------------+
| Status | Error Code |
+------------+------------+
| healthy | 0 |
+------------+------------+
kibana:
+------------+--------------+------------+
| Status | API Endpoint | Error Code |
+------------+--------------+------------+
| healthy | available | 0 |
+------------+--------------+------------+
[ Notifications ]
influxdb:
+------------+--------------+------------+
| Status | API Endpoint | Error Code |
+------------+--------------+------------+
| healthy | available | 0 |
+------------+--------------+------------+
kapacitor:
+------------+--------------+------------+
| Status | API Endpoint | Error Code |
+------------+--------------+------------+
| healthy | available | 0 |
+------------+--------------+------------+
[ Node ]
node:
+------------+-------+---------------+---------------+
| | CPU | Disk | Memory |
+------------+-------+-------+-------+-------+-------+
| Host | Usage | Usage | Avail | Usage | Avail |
+------------+-------+-------+-------+-------+-------+
| mas | 16.3% | 10% | 78G | 57% | 9.4G |
+------------+-------+-------+-------+-------+-------+
mas:cluster>
Stop the cluster
mas:cluster> stop
role map
------------------------------------------------------------
all 192.168.1.201
control 192.168.1.201
network 192.168.1.201
compute 192.168.1.201
storage 192.168.1.201
------------------------------------------------------------
Enter 'YES' to confirm: YES
mark control host 192.168.1.201 down
Update CubeOS
mas> update
mas:update> update
1: local
2: usb
3: server
Enter index: 1
1: CUBE_1.3.10_20200725-0932_a4d7645.pkg
Enter index: 1
Firmware update will require an appliance reboot.
Enter 'YES' to confirm: YES
Formatting partition 2
Installing CUBE_1.3.10_20200725-0932_a4d7645
Running install script
Installing postinstall script
Finished updating. Please reboot appliance.
Reboot
mas:update> reboot
Enter 'YES' to confirm: YES
Connection to 192.168.1.x closed by remote host.
Connection to 192.168.1.x closed.
Run bootstrap_cube
Welcome to the Cube Appliance
Enter "help" for a list of available commands
mas> boot
mas:boot> bootstrap_cube
bootstraping cube...
bootstrap successfully
if this is a single node start, just run "boot> cluster_sync"
if this is a cluster start, wait until bootstrap_done is done in all nodes and run "cluster> start" to sync cluster data for all nodes
Run cluster_sync
mas:boot> cluster_sync
cluster_sync successfully
Check CubeOS version
mas:boot> back
mas> update
mas:update> show
Current: 1.3.10
Rollback: 1.3.5
mas:update> back
mas> firmware
mas:firmware> get_info
1: CUBE_1.3.5_20200426-0942_6c7ef1e
2: CUBE_1.3.10_20200725-0932_a4d7645
Enter index: 2
Firmware Version: Cube Appliance 1.3.10
Installation Date: Jul 27, 2020 08:35:34 PM
Installation Type: Upgrade
Last Boot: Jul 27, 2020 08:48:54 PM
mas:firmware>
Run Service check & repair
mas> cluster
mas:cluster> check_repair
Service Status Report
ClusterLink ok [ link(v) ]
ClusterSettings ok [ etcd(v) ]
HaCluster ok [ hacluster(v) ]
MsgQueue ok [ rabbitmq(v) ]
IaasDb ok [ mysql(v) ]
VirtualIp ok [ vip(v) haproxy_ha(v) ]
Storage ok [ ceph(v) ceph_mon(v) ceph_mgr(v) ceph_mds(v) ceph_osd(v) ceph_rgw(v) ]
ApiService ok [ haproxy(v) apache2(v) lmi(v) memcache(v) ]
Compute ok [ nova(v) ]
Network ok [ neutron(v) ]
Image ok [ glance(v) ]
BlockStor ok [ cinder(v) ]
FileStor ok [ manila(v) ]
ObjectStor ok [ swift(v) ]
Orchestration ok [ heat(v) ]
LBaaS ok [ octavia(v) ]
DNSaaS ok [ designate(v) ]
InstanceHa ok [ masakari(v) ]
DisasterRecovery ok [ freezer(v) es235(v) ]
DataPipe ok [ zookeeper(v) kafka(v) ]
Metrics ok [ ceilometer(v) monasca(v) telegraf(v) grafana(v) ]
LogAnalytics ok [ filebeat(v) auditbeat(v) logstash(v) es(v) kibana(v) ]
Notifications ok [ influxdb(v) kapacitor(v) ]
mas:cluster>