There is no such thing as magic soil. Some communities are worse off than others because of cultural norms. All societies commit crimes, some do so at significantly higher rates. This is why some communities are worse off than others. Slavery didn't make them do this.