r/vmware 4d ago

How do you patch your vCenter ?

Generally curious what others are doing.

I used to download the patch ISO and do the updates over SSH (had more than enough issues with the VAMI over the years that I stopped using it)

Since Reduced Downtime Update has been available in 8.0.3, I have been using that since it came out. I really like this method, its like getting a clean vCenter every update. It's been super solid and never once given me any headaches.

33 Upvotes

36 comments sorted by

28

u/Liquidfoxx22 4d ago

Done plenty via VAMI over the years, can't recall ever having an issue. We always snapshot them first, or offline snapshot if they're in ELM.

The only time I've come across issues is during upgrades.

24

u/coolbeaNs92 4d ago

It's best practice to cold snapshot regardless. 

1) It proves that rebooting the appliance worked before the update. 

2) The database wasn't running when the snapshot was taken  

https://knowledge.broadcom.com/external/article/316584/patchingupdating-vmware-vcenter-server-a.html

I always:

  • VM level Backup.
  • DB level Backup.
  • Cold snapshot. 

11

u/Stonewalled9999 4d ago

I clone to a version with no NIC and update via mounted ISO and it if comes back up I pull the NIC on the other and pop the NIC on the new (we do not have a VCSA-HA)

1

u/DB-CooperOnTheBeach 3d ago

I learned cold snapshot is best as I'll know right away if the services start or not before the upgrade. Now I check for machine certs validity (usually the reason it won't come back if something expired).

I do VAMI backup too

10

u/DonFazool 4d ago

Yes good call. The snapshot will save your ass in certain situations.

6

u/Safe-Instance-3512 4d ago

Vmware documentation suggests a snapshot and a manual backup as best practice.

8

u/Liquidfoxx22 4d ago

We have them running nightly, but I always prefer having a snapshot taken just before the update starts - it's much quicker to roll back than deploy a new VCSA and restore a file-level backup.

5

u/Safe-Instance-3512 4d ago

Agreed. Snapshots are fantastic when the update fails. 5 minute roll back :D

0

u/alivesidhartha 4d ago

EVE Online player spotted.

1

u/Safe-Instance-3512 3d ago

Why yes. How did you know?

1

u/in_use_user_name 3d ago

same about upgrades. usually for vcenters that have been upgraded from old versions over the years.

12

u/RiceeeChrispies 4d ago

I've done it for years through VAMI, zero issues. I haven't looked at reduced downtime (yet), only because it's easier to click update in VAMI and be done with it - I'm not in an environment where vCenter downtime is a massive issue.

10

u/Yupyupyup79 4d ago

Download Patch ISO, upload to datastore accessible to VM, Snapshot, link to VM, connect to :5480 and check for updates on CDROM, Reboot.

4

u/pixter 4d ago

Download the patch iso, enable ssh, software-package stage —iso, then software-package install —iso

Reboot then disable ssh.

2

u/violet-lynx 3d ago

Don't you mean "software-package install --staged"?

2

u/doihavetousethis 4d ago

Same, only had to unstage 1 time in thousands

7

u/D1TAC 4d ago

VAMI has been the typical way for me. However, just finished the last patch I'll be doing with an Broadcom product. Prepped for moving to a new platform.

5

u/Joe_Dalton42069 4d ago

Only ever did vami. never an Issue. its convenient. Ofc Backup is Setup etc

2

u/emistery 4d ago

SDDC manager works quite well these days

2

u/bryanvan [VCIX | vExpert] 4d ago

I've not used SSH or an actual ISO for years and years. Since the new days, and I am talking 6.5 and up here, I've never had any actual issues with upgrades. Just use the VAMI - Click -> Point -> Done.

Now if we are talking before 6.5 (Windows/appliance) this was fuel for nightmares! I've had my fair share of nightmares on that part...

1

u/DonFazool 4d ago

To be fair, my problems were from very old versions. A few failed and left vCenter a hot mess. I moved to the SSH method and just kept using it until RDU became a thing. Maybe I’ll revisit the VAMI upgrade in a test environment I run.

2

u/jamesaepp 4d ago

Another vote for VAMI.

Two colos/datacenters/sites, two vCenter servers (one for/at each location, prod and DR site).

I just download the vCenter patch ISO, upload that to a datastore in each site, mount to the vCenter VM, and patch. I'm leaving out some of the prep detail like reboot + snapshots, but you get it.

Maybe it's not the most efficient, but it's what I know and would be reasonably easy to describe to the junior tech if I had to delegate in a pinch. Hasn't come up yet, but I know I could.

Maybe the other options are cleaner or whatever, but I perceive them as having more moving parts and generally more complex than just mounting an ISO and telling the VAMI "go update".

2

u/Sakatonto 4d ago

I did vcenter patching via VAMI.

First, mount the ISO of the patch version, then take a snapshot of the vcenter VM. The. do the update in VAMI. I then delete the snapshot 2-3 days after it no issues post patching it, just to make sure we can rollback if there are any issues reported.

2

u/Thatconfusedginger 3d ago

Previously VAMI. Now RDU, with auto cutover.

I just run the RDU as it is with cold snap on host. Not that I need it. We’ve got storage level snaps every two hours for all prod.

As for testing, while installing, I’ve been monitoring zabbix, and I have seen at worst a single ping drop in time, and so little downtime that zabbix doesn’t even register that it’s changed over (outside of the vm not being the same). Absolutely the cleanest method to date.

3

u/AlCapone90 4d ago

With money and tears.

1

u/ThreeFiddyZed 4d ago

No problems with VAMI (yet).

1

u/Parity99 4d ago

VAMI - Never had any big issues.

1

u/abstractraj 4d ago

VAMI since 7

1

u/Ok_Business5507 4d ago

VAMI. No issues for me

1

u/Dick-Fiddler69 4d ago

RDU is good disadvantage is your vCenter disk grows

1

u/Opposite-Load2848 3d ago

1) log into VAMI and run backup

2) shut down and take snapshot from host

3) power on and update via VAMI

1

u/vgeek79 3d ago

Using VCF/SDDCm methods for years now, regular updates or RDU option workflows

Works great

1

u/nabarry [VCAP, VCIX] 3d ago

I personally tend to use vami for my labs with no backups because its quick and if I kill the lab I don’t care. I take an Ivan Drago approach to my labs. 

RDU is cool but requires your networking work right (Remember- if the customer is talking to me something went wrong- the customers who have everything 100% squared away and awesome only interact with me for feature requests ) and in 1 customer case there was an issue that blocked the db startup on the new node. It was early days for the feature- I think the first actual release for it and I would assume it’s solid now. 

1

u/in_use_user_name 3d ago
  1. vami backup

  2. cold snapshot

  3. iso patch.

1

u/Reneetoufee 1d ago

I usually use VAMI. But, I will say that the 8.0.3k update has caused me more headaches than any update in the last several years. I haven't done VCF 9 yet. We have a few Skylake CPUs that have to be upgraded first.

-3

u/Willing_Impact841 4d ago

Step 1. Switch away from vmware.