I also feel the same way. I travel with the absolute minimum of synthetic fabric clothing, I have found that by far the best material is wool, especially merino wool, and if that's not an option something that is natural fiber derived modal like bamboo or wood cellulose modal is good. Polyester and other synthetic fabrics repel moisture better, but don't wash by hand or withstand hard wearing as well as natural fibers, and also don't work as well across climates and ecologies.
A layered clothing approach helps a lot. I wear an undershirt (Icebreaker Merino T) every single day, which helps me to regulate my body temperature between hot and cold climates, without requiring a major increase in the amount of clothing I have to bring. The only outerwear I had to bring on my trips was a single wool peacoat and a packable windbreaker/rainjacket. By using layers, I was able to use the same set of clothing between 45C and -25C, across 4 continents with no real trouble.
A layered clothing approach helps a lot. I wear an undershirt (Icebreaker Merino T) every single day, which helps me to regulate my body temperature between hot and cold climates, without requiring a major increase in the amount of clothing I have to bring. The only outerwear I had to bring on my trips was a single wool peacoat and a packable windbreaker/rainjacket. By using layers, I was able to use the same set of clothing between 45C and -25C, across 4 continents with no real trouble.