It is expected that during his visit, Pence will address the crisis in Venezuela and to recent comments by U.S. President Donald Trump, when he said he refused to rule out military intervention in the South American country on Friday.
"There is an extremist elite in the USA government", he added, "and I really don't know what is happening and what will happen in the world".
Pence is set to meet with Columbian President Juan Manuel Santos on Sunday at the start of a weeklong trip to Latin America that is likely to be dominated by conversations about the deepening crisis in Venezuela, where the USA accuses President Nicolas Maduro of a power grab that has sparked deadly protests and condemnation across the region.
"The bad threats of President Donald Trump are trying to drag Latin America and the Caribbean into a conflict that could permanently alter the stability, peace and security in our region", he said. "We have many options for Venezuela, including a possible military option if necessary", Trump told reporters at his New Jersey golf club.
Peru, one of Maduro's fiercest critics, led the charge in criticising Trump's threat, saying it was against United Nations principles.
Also Saturday, Peru said "any attempted use of force, whether it's external or internal, undermines the objective of restoring democracy ... to Venezuela".
This has been widely derided as a power-grab by Venezuela's President Nicolas Maduro.
Mexico and Colombia joined in with statements of their own.
Also on Saturday, South American trade bloc Mercosur rejected the use of force in Venezuela, according to a statement by Argentina's foreign ministry.
President Nicolas Maduro's socialist administration has been under siege at home and overseas after more than four months of anti-government protests in which 120 people died.
Latin American support for Venezuela against the United States threat comes on the eve of Vice President Mike Pence's trip to the region beginning Sunday.
Revolutionary Armed Forces of Colombia, FARC, spokesperson Rodrigo Granda: Let us not allow an invasion in the style of Granada or Panama to be repeated with impunity.
"So, I dont think he has enough political clout to exert any kind of influence in Latin America".
In Colombia, Pence was expected to highlight trade, business investment and other ties between the nations, including USA support for Bogota's efforts to implement its peace deal with the Revolutionary Armed Forces of Colombia.