I don't think it's pure science fiction. Our understanding of immunosuppresive mechanisms is advancing quickly, and there are transplants that we are able to perform today that were impossible 20 years ago.
The first penis transplant was performed just 4 years ago, and there have been several more since then. The surgeon who performed the most extensive one ever last year has even suggested that the patient (a wounded soldier) may be able to get off immunosuppresant agents entirely in the next 10 years, thanks to advances in medicine.
There is also the prospect of anorectal transplants, which have been the focus of some study in the last few years due to their potential to reverse permanent colostomies and restore normal function to the lower digestive tract. These are much more tricky than genital transplants, because of the heightened risk of immune system rejection, yet, they have been successfully achieved in rats, pigs, and canines in the last 5 years.
Personally, I think this stuff will be technically achievable sooner than many of us might think. I'm predicting that the biggest obstacles to full reproductive transplantation will be ethical, rather than technical.