The preference doesn’t actually do what it says, as mentioned in the original post. Starting with macOS 10.12, it doesn’t always download all the attachments, and even ones that did download (because you viewed the message) may get purged later.