It traps heat.
Polyester is an extruded plastic. It does not breathe the way a natural fiber does, so heat and moisture sit against the skin. Chronic heat around the body has been linked to lower testosterone; the dyes used on synthetics do not help.