Not exactly. Whenever Paul quoted the Old Testament, he quoted from Greek (mis)translations of it.
Furthermore, attribution of “Matthew” to Jesus' disciple of the same name is based solely on the testimony of Papias, who tells if via Eusebius' Church History that:
Matthew composed the sayings in the Hebrew tongue, and each one interpreted them to to the best of his ability.
So, the earliest versions of Matthew (at least) were in fact written in Hebrew, not Greek.