I assume you are referring to DRS? DRS doesn't do a load balancing, i.e. move guests back. It only migrates workloads in case of resource contention and to meet DRS rules you configured. So if you don't have DRS rules in place and the other hosts aren't low on resources, you need to migrate the VMs back manually.
André
