There were people in the German army (Wehrmacht) who wanted to have nothing in common with those criminals. Some even tried to kill Hitler and get rid of the regime.
Most soldiers who disagreed with the Nazi left the Wehrmacht by 38 (or were pushed out, or were beaten and restrained for month in 'black site', often disaffected warehouses where socialists and Communist were 'retrained', basically proto-concentration camps).
In 42-43 some were reintegrated forcefully, and those I agree do not bear responsibility for the Wehrmacht war crimes.
My grandmother had a lot of stories about the Wehrmacht and was very disappointed that they were basically whitewashed from their pedophilic rapes, public executions and other group punishment.