It would be better to grow them in another spot if possible. Late blight will be killed by a freeze, but it's always a good idea to rotate crops.
No worries on the other plants growing there, late blight is airborne, so don't worry about that problem.