Singer will stage three-night stands in six cities, performing tracks from throughout her catalog as well as new music