I wouldn't call that silly at all. You do have work to attend to before such a thing, but there's no reason why you cannot wish you had the opportunity for it.

[He gets that. You have to prioritize your time wisely, but that doesn't mean you won't miss what you could have been doing.]

I do hope he's able to settle in well enough despite such things. And I hope you have the opportunity to get a chance to know him better as well.