I did an economic history lit survey back in the '80s (lost now unfortunately) which showed that a very substantial portion of UK wealth at that time had a direct lineage back to slavery on sugar plantations. Even if you judge that meritocracy works justly within a generation, without appropriate taxation wealth accumulates over time, often consequent on terrible injustices. It takes some pretty heroic ethical gymnastics to justify that let alone consider it efficient or useful.