And they [the townspeople] spoke, wondering, (not knowing that He was the son of a virgin, or not believing it even if it was told to them, but supposing that He was the son of Joseph the carpenter,) “is not this the carpenter’s son?”5262 And depreciating the whole of what appeared to be His nearest kindred, they said, “Is not His mother called Mary? And His brethren, James and Joseph and Simon and Judas? And His sisters, are they not all with us?”5263 They thought, then, that He was the son of Joseph and Mary. But some say, basing it on a tradition in the Gospel according to Peter,5264 as it is entitled, or “The Book of James,”5265 that the brethren of Jesus were sons of Joseph by a former wife, whom he married before Mary. Now
those who say so wish to preserve the honour of Mary in virginity to the end, so that that body of hers which was appointed to minister to the Word which said, “The Holy Ghost shall come upon thee, and the power of the Most High shall overshadow thee,”5266 might not know intercourse with a man after that the Holy Ghost came into her and the power from on high overshadowed her. And I think it in harmony with reason that Jesus was the first-fruit among men of the purity which consists in chastity, and
Mary among women; for it were not pious to ascribe to any other than to her the first-fruit of virginity.
Origen on Matthew