The singer joined a wave of artists who have backed out of the event organized by Keith Krach, a Trump appointee