After expressing his disappointment that the Compton rapper was chosen over him, Lil Wayne says they spoke, though he doesn't plan to attend