"Mitzvah" is related to the word "tzavta," which means "joining" and "attachment": by performing a mitzvah, a person is joined to the essence of G-d, who issues that particular command. Thus "The reward of a mitzvah is the mitzvah"--being joined with the essence of the Infinite is itself the deed's reward.