There were more natives in the Americas and Caribbean when the European settlers arrived, too. Only one side had way more advanced military technology and no scruples around genocide and slavery.