I feel you, and your desire to serve with your spouse. I met my spouse while I was serving in Bulgaria, towards the end of my service. I had already planned to study abroad for a year and then apply for a response corps position in Georgia, then perhaps do another full two years. But I can't imagine doing all of that without my husband. Although he would gladly be a PCV, he will never be a US citizen (as we are not intending to move back to the states), so my dreams of doing peace corps again are pretty much crushed.
But, if he can get dual citizenship and you can serve together, that would be great for you. Alternatively, think about response corps positions that would not separate you for such an extended period of time, maybe?