Well a point of evidence that disputes this: homosexual men have larger penis sizes on average than heterosexual men [1].This is the opposite of what you'd expect if EDC's are decreasing testosterone and increasing homosexuality.

[1] https://pubmed.ncbi.nlm.nih.gov/10410197/