President said distance, and not performers, is reason he won't be at Levi's Stadium on February 8: "It's just too far away"