Planning for the procedure
Background knowledge
This procedure assumes that:
-
you are installing into an existing OpenStack deployment
-
The OpenStack deployment must be set up with support for Heat templates.
-
-
you are using an OpenStack version from Icehouse through to Train inclusive
-
you are thoroughly familiar with working with OpenStack machines and know how to set up tenants, users, roles, client environment scripts, and so on.
(For more information, refer to the appropriate OpenStack installation guide for the version that you are using here.) -
you are upgrading an existing downlevel deployment for MAG.
-
you have deployed a SIMPL VM, and have followed all the pre-upgrade steps.
Method of procedure
Refer to the SIMPL VM Documentation for details on the commands mentioned in the procedure. |
Step 1 - Upgrade the initial downlevel MAG VMs
The VM with the Rhino node that has the lowest ID must be upgraded last.
Upgrade all of the other VMs using the following command:
csar update --vnf mag --sites <site> --service-group <service_group> --index-range <range> --sdf <path to SDF>
.
The indexes start from 0, therefore 0 is the first VM.
The --index-range
accepts ranges as well as comma separated indexes (e.g. 1-3,7,9
).
To upgrade the VMs in stages, run the command multiple times using the appropriate --index-range
values.
The following will occur one MAG node at a time:
-
The downlevel node will be quiesced.
-
The uplevel node will be created and boot up.
-
The VM will automatically start applying configuration from the files you uploaded to CDS in the above steps. During this phase, the status of the VM in MDM will be Orange.
-
Once configuration is complete, the status will change to Green, and the node will be ready for service. At this point the
csar update
command will move on to the next MAG VM, or report that the upgrade of the MAG was successful if all nodes have now been upgraded. -
Once the upgrade is complete, place calls and run any additional validation tests to verify the uplevel VMs are working as expected.
Backout procedure
If the upgrade has brought up uplevel VMs to replace the downlevel VMs, then the uplevel VMs can be rolled back to the downlevel VMs. To rollback, repeat the steps above with the downlevel MAG CSAR and downlevel SDF. The lowest uplevel VM must be rolled back last. For example, if VMs 2-5 are in the uplevel, you must rollback VMs 3-5 then rollback VM 2.
You may need to use the --skip pre-update-checks
flag as part of the csar update
command.
The --skip pre-update-checks
flag allows rollbacks when a node is unhealthy.
If the upgrade has failed to bring up the uplevel VMs or the rollback has failed to bring up the downlevel VMs,
then you must redeploy the downlevel VMs.
run csar redeploy --vnf mag --sites <site> --sdf <path to SDF>
.
Diagnostics during the quiesce stage
When the downlevel VMs are quiesced, they upload some diagnostics to the CDS. These may be useful if the upgrade or rollback fails.
To get these diagnostics, follow instructions from Retrieving Initconf and Rhino logs with export-log-history.
Next Step
If you are upgrading a full set of VMs, go to Rolling upgrade MMT CDMA nodes on OpenStack, otherwise follow the post upgrade instructions here: Post rolling upgrade steps