Nothing illustrates the irrelevance of colonialism compared to modern economic growth more than Spain's estimated GDP per capita over the last 500 years. Ruling vast amounts of the world's surface with access to large amounts of silver doesn't even show up on the graph!