quizFile.write('{:>2} What is the capital of {}?\n'.format(questionNum+1, states[questionNum]))
See the question sign? You create the sentence as you want it to look.
So we start with the placeholder for the number of the question then the question with the placeholder for the state including the question sign at the end of the sentence and finally the new line.
You can indent the options also. Line 51, 52. Line 53 is removed and a new line character is added at the end of
'\t{} {}\n'
for index, opt in enumerate('ABCD'):
quizFile.write('\t{} {}\n'.format(opt, answerOptions[index]))