[ubuntu_budgie] Kernel updates in VM with Ubuntu 18.04 host takes very very long time

I noticed that updating the kernel with the Software Updater takes very long time.
The situation is the following.
I am running three different VMs in VirtualBox: Ubuntu 16.04, Ubuntu Budgie 18.04 and Ubuntu 19.04.
The host machine has been running Ubuntu Budgie 18.04 with the original kernel 4.15 for more than a year without issues.
I recently had to reinstall the host machine due to HW failure. I reinstalled using Ubuntu Budgie 18.04.3 and noticed that the kernel is now 5.0.0.x (with HWE).
Now it takes extremely amount of time to update the kernels in the guest VMs.
Obviously this has something to do with the host running 5.0.0.x but how can this be? How can it affect the time it takes to update the kernels in the Virtual machines?

The guest - Ubuntu Budgie 18.04 - updated from 5.0.0.27 to 5.0.0.29 in 2 minutes on a Windows 10 host.
On my Ubuntu Budgie 18.04 host (Intel i5-3570K) the same update took 32 minutes!
I have noticed the same problem with all VMs (guest systems Ubuntu 16.04, Ubuntu Budgie 18.04 and Ubuntu 19.04).
Ubuntu 16.04 is running kernel 4.15.
Would appreciate any suggestion how to solve this issue. If I can't solve it I have to use the Windows host for instead which I do not like :-).

VirtualBox version is 6.0.10.