Cluster Startup

Single node or Cluster auto startup (New)

CubeCOS starting bootstrap modules

Executing cluster start

Cluster ready

Check and repair services

• run CLI cluster> check_repair

cc1> cluster
cc1:cluster> check_repair
          Service  Status  Report
      ClusterLink      ok  [ link(v) clock(v) dns(v) ]
       ClusterSys      ok  [ bootstrap(v) license(v) ]
  ClusterSettings      ok  [ etcd(v) ]
        HaCluster  FIXING  [ hacluster(3) ]
                       ok  [ hacluster(f) ]
         MsgQueue      ok  [ rabbitmq(v) ]
           IaasDb      ok  [ mysql(v) ]
        VirtualIp      ok  [ vip(v) haproxy_ha(v) ]
          Storage      ok  [ ceph(v) ceph_mon(v) ceph_mgr(v) ceph_mds(v) ceph_osd(v) ceph_rgw(v) rbd_target(v) ]
       ApiService      ok  [ haproxy(v) httpd(v) lmi(v) memcache(v) ]
     SingleSignOn      ok  [ keycloak(v) ]
          Compute      ok  [ nova(v) ]
        Baremetal      ok  [ ironic(v) ]
          Network      ok  [ neutron(v) ]
            Image      ok  [ glance(v) ]
        BlockStor      ok  [ cinder(v) ]
         FileStor      ok  [ manila(v) ]
       ObjectStor      ok  [ swift(v) ]
    Orchestration      ok  [ heat(v) ]
            LBaaS      ok  [ octavia(v) ]
           DNSaaS      ok  [ designate(v) ]
           K8SaaS      ok  [ k3s(v) rancher(v) ]
       InstanceHa      ok  [ masakari(v) ]
 DisasterRecovery      ok  [ freezer(v) ]
    BusinessLogic      ok  [ mistral(v) murano(v) cloudkitty(v) senlin(v) watcher(v) ]
       ApiManager      ok  [ tyk(v) redis(v) mongodb(v) ]
         DataPipe      ok  [ zookeeper(v) kafka(v) ]
          Metrics      ok  [ monasca(v) telegraf(v) grafana(v) ]
     LogAnalytics      ok  [ filebeat(v) auditbeat(v) logstash(v) es(v) kibana(v) ]
    Notifications      ok  [ influxdb(v) kapacitor(v) ]
cc1:cluster>

Single node manual startup

boot> bootstrap_cube

    $ ssh admin@IPADDRESS
    Warning: Permanently added '192.168.X.X' (ECDSA) to the list of known hosts.
    Password:
    Welcome to the Cube Appliance
    Enter "help" for a list of available commands
    controller> boot
    controller:boot> bootstrap_cube
    bootstraping cube...
    if this is a single node start, just run "boot> cluster_sync"
    if this is a cluster start, wait until bootstrap_done is done in all nodes
    and run "cluster> start" to sync cluster data for all nodes
    controller:boot>

boot> cluster_sync

    controller:boot> cluster_sync
    cluster_sync successfully

Run services checking & repair

CLI: cluster> check_repair

controller> cluster
controller:cluster> check_repair
          Service  Status  Report
      ClusterLink      ok  [ link(v) clock(v) dns(v) ]
       ClusterSys      ok  [ bootstrap(v) license(v) ]
  ClusterSettings      ok  [ etcd(v) ]
        HaCluster  FIXING  [ hacluster(3) ]
                       ok  [ hacluster(f) ]
         MsgQueue      ok  [ rabbitmq(v) ]
           IaasDb      ok  [ mysql(v) ]
        VirtualIp      ok  [ vip(v) haproxy_ha(v) ]
          Storage      ok  [ ceph(v) ceph_mon(v) ceph_mgr(v) ceph_mds(v) ceph_osd(v) ceph_rgw(v) rbd_target(v) ]
       ApiService      ok  [ haproxy(v) httpd(v) lmi(v) memcache(v) ]
     SingleSignOn      ok  [ keycloak(v) ]
          Compute      ok  [ nova(v) ]
        Baremetal      ok  [ ironic(v) ]
          Network      ok  [ neutron(v) ]
            Image      ok  [ glance(v) ]
        BlockStor      ok  [ cinder(v) ]
         FileStor      ok  [ manila(v) ]
       ObjectStor      ok  [ swift(v) ]
    Orchestration      ok  [ heat(v) ]
            LBaaS      ok  [ octavia(v) ]
           DNSaaS      ok  [ designate(v) ]
           K8SaaS      ok  [ k3s(v) rancher(v) ]
       InstanceHa      ok  [ masakari(v) ]
 DisasterRecovery      ok  [ freezer(v) ]
    BusinessLogic      ok  [ mistral(v) murano(v) cloudkitty(v) senlin(v) watcher(v) ]
       ApiManager      ok  [ tyk(v) redis(v) mongodb(v) ]
         DataPipe      ok  [ zookeeper(v) kafka(v) ]
          Metrics      ok  [ monasca(v) telegraf(v) grafana(v) ]
     LogAnalytics      ok  [ filebeat(v) auditbeat(v) logstash(v) es(v) kibana(v) ]
    Notifications      ok  [ influxdb(v) kapacitor(v) ]
controller:cluster>

---

Cluster manual startup

Control Node

Run link_check

run CLI boot> link_check to ensure all network links are connected

    $ ssh admin@cc1
    Warning: Permanently added '192.168.X.X' (ECDSA) to the list of known hosts.
    Password:
    Welcome to the Cube Appliance
    Enter "help" for a list of available commands
    cc1> boot
    cc1:boot> link_check
    Ping 192.168.1.211 ... OK
    Ping 192.168.1.212 ... OK
    Ping 192.168.1.213 ... OK
    Ping 192.168.10.211 ... OK
    Ping 192.168.10.212 ... OK
    Ping 192.168.10.213 ... OK

Start Up Order

1. Run CLI cluster > stop (This steps is required if the cluster didn't perform a graceful shutdown)
2. On the first Node run CLI boot > bootstrap_cube, and WAIT for this process to complete before proceed to next steps

    cc1> boot
    cc1:boot> bootstrap_cube
    bootstraping cube...
    if this is a single node start, just run "boot> cluster_sync"
    if this is a cluster start, wait until bootstrap_done is done in all nodes
    and run "cluster> start" to sync cluster data for all nodes
    cc1:boot>

3. When bootstrap_cube on first Node is complete, run CLI boot > bootstrap_cube on the 2nd and 3rd Nodes, You may run it parellel
4. Run CLI cluster> start on the first Node, Once bootstrap_cube on 2nd and 3rd Node is complete

    cc1> cluster
    cc1:cluster> start
             role                                           map
    ------------------------------------------------------------
              all     192.168.1.211,192.168.1.212,192.168.1.213
          control     192.168.1.211,192.168.1.212,192.168.1.213
          network     192.168.1.211,192.168.1.212,192.168.1.213
          compute     192.168.1.211,192.168.1.212,192.168.1.213
          storage     192.168.1.211,192.168.1.212,192.168.1.213
    ------------------------------------------------------------
    mark host 192.168.1.211 up
    mark host 192.168.1.212 up
    mark host 192.168.1.213 up
    cluster start successfully

5. Run services checking & repair, run CLI cluster> check_repair

cc1> cluster
cc1:cluster> check_repair
          Service  Status  Report
      ClusterLink      ok  [ link(v) clock(v) dns(v) ]
       ClusterSys      ok  [ bootstrap(v) license(v) ]
  ClusterSettings      ok  [ etcd(v) ]
        HaCluster  FIXING  [ hacluster(3) ]
                       ok  [ hacluster(f) ]
         MsgQueue      ok  [ rabbitmq(v) ]
           IaasDb      ok  [ mysql(v) ]
        VirtualIp      ok  [ vip(v) haproxy_ha(v) ]
          Storage      ok  [ ceph(v) ceph_mon(v) ceph_mgr(v) ceph_mds(v) ceph_osd(v) ceph_rgw(v) rbd_target(v) ]
       ApiService      ok  [ haproxy(v) httpd(v) lmi(v) memcache(v) ]
     SingleSignOn      ok  [ keycloak(v) ]
          Compute      ok  [ nova(v) ]
        Baremetal      ok  [ ironic(v) ]
          Network      ok  [ neutron(v) ]
            Image      ok  [ glance(v) ]
        BlockStor      ok  [ cinder(v) ]
         FileStor      ok  [ manila(v) ]
       ObjectStor      ok  [ swift(v) ]
    Orchestration      ok  [ heat(v) ]
            LBaaS      ok  [ octavia(v) ]
           DNSaaS      ok  [ designate(v) ]
           K8SaaS      ok  [ k3s(v) rancher(v) ]
       InstanceHa      ok  [ masakari(v) ]
 DisasterRecovery      ok  [ freezer(v) ]
    BusinessLogic      ok  [ mistral(v) murano(v) cloudkitty(v) senlin(v) watcher(v) ]
       ApiManager      ok  [ tyk(v) redis(v) mongodb(v) ]
         DataPipe      ok  [ zookeeper(v) kafka(v) ]
          Metrics      ok  [ monasca(v) telegraf(v) grafana(v) ]
     LogAnalytics      ok  [ filebeat(v) auditbeat(v) logstash(v) es(v) kibana(v) ]
    Notifications      ok  [ influxdb(v) kapacitor(v) ]
cc1:cluster>

Compute Node

Run boot> bootstrap_cube

    $ ssh admin@COMPUTE1
    Warning: Permanently added '192.168.X.X' (ECDSA) to the list of known hosts.
    Password:
    Welcome to the Cube Appliance
    Enter "help" for a list of available commands
    COMPUTE1> boot
    COMPUTE1:boot> bootstrap_cube
    bootstraping cube...
    if this is a single node start, just run "boot> cluster_sync"
    if this is a cluster start, wait until bootstrap_done is done in all nodes
    and run "cluster> start" to sync cluster data for all nodes
    COMPUTE1:boot>

Run boot> cluster_sync

    COMPUTE1> boot
    COMPUTE1:boot> cluster_sync
    (1/9) processing: ceph
    (2/9) processing: keystone
    (3/9) processing: neutron
    (4/9) processing: nova
    (5/9) processing: cinder
    (6/9) processing: manila
    (7/9) processing: octavia
    (8/9) processing: haproxy
    (9/9) processing: telegraf
    cluster_sync successfully