{"id":423,"date":"2024-05-19T17:35:47","date_gmt":"2024-05-19T15:35:47","guid":{"rendered":"https:\/\/binaryvikings.io\/?p=423"},"modified":"2024-05-19T17:35:47","modified_gmt":"2024-05-19T15:35:47","slug":"nutanix-updating-ce2-from-lcm-server-not-coming-back-up","status":"publish","type":"post","link":"https:\/\/binaryvikings.io\/?p=423","title":{"rendered":"Nutanix &#8211; Updating CE2 from LCM, server not coming back up"},"content":{"rendered":"\n<p>If you have updated the Community Edition 2.0, from the LCM (Life Cycle Manager), you may experience that the server is not coming back online. You may experience that the AHV is printing out the following, continuously:<\/p>\n\n\n\n<p><code>dracut-initqueue[682]: Warning: dracut-initqueue timeout - starting timeout scripts<\/code>.<\/p>\n\n\n\n<p>After many outputs of this line, you will end up in the <strong>Dracut Emergency Shell<\/strong>, this, with a warning of <strong>\/dev\/disk\/by-uuid\/{UUID}<\/strong> not existing. This is also a driver issue, like it was with the <a href=\"https:\/\/binaryvikings.io\/?p=421\" data-type=\"page\" data-id=\"288\" target=\"_blank\" rel=\"noreferrer noopener\">Realtek network driver<\/a>.<\/p>\n\n\n\n<p>In order to solve this, you should load the kernel modules.<\/p>\n\n\n\n<p>From the<strong> Dracut Emergency Shell<\/strong>, type in the following if you&#8217;re using a USB (which may be the disk not being read):<\/p>\n\n\n\n<div class=\"hcb_wrap\"><pre class=\"prism line-numbers lang-plain\"><code>insmod \/lib\/modules\/5.10.139-2.el7.nutanix.20220304.385.x86_64\/kernel\/drivers\/usb\/storage\/usb-storage.ko<\/code><\/pre><\/div>\n\n\n\n<p>Make sure to press <strong>TAB<\/strong> to auto complete the version as it may vary for you.<\/p>\n\n\n\n<p>If you&#8217;re also using SATA (AHCI), type in the following, still in<strong> Dracut Emergency Shell<\/strong>, then exit the shell.<\/p>\n\n\n\n<div class=\"hcb_wrap\"><pre class=\"prism line-numbers lang-plain\"><code>modprobe ahci\nexit<\/code><\/pre><\/div>\n\n\n\n<p><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Damage control after update<\/h2>\n\n\n\n<p>As settings were overwritten during the upgrade, we need to disable these changed settings:<\/p>\n\n\n\n<p>Open the file <strong>\/etc\/modprobe.d\/pci-passthru-nx2k.conf <\/strong>and comment out the settings to match below:<\/p>\n\n\n\n<div class=\"hcb_wrap\"><pre class=\"prism line-numbers lang-plain\" data-file=\"\/etc\/modprobe.d\/pci-passthru-nx2k.conf\"><code># Intel SATA AHCI (NX-2000)\n#blacklist ahci\n#blacklist lpc_ich\n#blacklist i2c_i801\n\n# Allow AHCI controller of the multifunction device to be passed through.\n#options vfio_iommu_type1 allow_unsafe_interrupts=1<\/code><\/pre><\/div>\n\n\n\n<p>Additionally we must comment out the settings below, from <strong>\/etc\/modprobe.d\/stig-reqs-usbstorage.conf<\/strong>:<\/p>\n\n\n\n<div class=\"hcb_wrap\"><pre class=\"prism line-numbers lang-plain\" data-file=\" \/etc\/modprobe.d\/stig-reqs-usbstorage.conf\"><code>#install usb-storage \/bin\/true\n#blacklist usb-storage<\/code><\/pre><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Backup and update initramfs<\/h2>\n\n\n\n<p>Navigate to <strong>\/boot<\/strong> and backup the original initramfs file, type <strong>dracut -f<\/strong> to force the creation of a new initramfs image. Lastly, reboot.<\/p>\n\n\n\n<div class=\"hcb_wrap\"><pre class=\"prism line-numbers lang-plain\"><code>cd \/boot\ncp initramfs-5.10.139-2.el7.nutanix.20220304.385.x86_64.img initramfs-5.10.139-2.el7.nutanix.20220304.385.x86_64.img.bak\n\ndracut -f\n\nreboot<\/code><\/pre><\/div>\n\n\n\n<p>Finally, restart the CVM, and the cluster should get back online, with Nutanix showing the correct, updated versions.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>If you have updated the Community Edition 2.0, from the LCM (Life Cycle Manager), you may experience that the server is not coming back online.<\/p>\n","protected":false},"author":1,"featured_media":243,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_eb_attr":"","footnotes":""},"categories":[19,34,17],"tags":[],"class_list":["post-423","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-linux","category-nutanix","category-virtual-machines"],"_links":{"self":[{"href":"https:\/\/binaryvikings.io\/index.php?rest_route=\/wp\/v2\/posts\/423","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/binaryvikings.io\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/binaryvikings.io\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/binaryvikings.io\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/binaryvikings.io\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=423"}],"version-history":[{"count":1,"href":"https:\/\/binaryvikings.io\/index.php?rest_route=\/wp\/v2\/posts\/423\/revisions"}],"predecessor-version":[{"id":424,"href":"https:\/\/binaryvikings.io\/index.php?rest_route=\/wp\/v2\/posts\/423\/revisions\/424"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/binaryvikings.io\/index.php?rest_route=\/wp\/v2\/media\/243"}],"wp:attachment":[{"href":"https:\/\/binaryvikings.io\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=423"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/binaryvikings.io\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=423"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/binaryvikings.io\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=423"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}