Remove the guest in case of failure.