How Close Can a Black Hole Be to Earth?