Colombia SECOP II Contracts Scraper

Scrapes public contracts from Colombia's SECOP II (Sistema Electronico de Contratacion Publica) platform via the datos.gov.co Socrata API.

Data Source

• API Endpoint: https://www.datos.gov.co/resource/jbjy-vk9h.json
• Platform: datos.gov.co (Colombia's open data portal)
• Data Provider: Colombia Compra Eficiente
• Update Frequency: Daily

API Key

Optional. The scraper works without authentication, but with rate limits:

• Without token: 1,000 requests per hour
• With token: Higher limits (recommended for large extractions)

To use an app token, set the SOCRATA_APP_TOKEN environment variable.

Get a free Socrata app token at: https://dev.socrata.com/register

Input Parameters

Parameter	Type	Required	Default	Description
query	string	No	-	Full-text search in contract object/description
entidad	string	No	-	Filter by contracting entity name (partial match)
departamento	string	No	-	Filter by Colombian department/state (exact match)
estado	enum	No	All	Contract status filter
modalidad	enum	No	All	Type of procurement process
limit	integer	No	100	Maximum contracts to return (1-10,000)

Estado (Contract Status) Values

Value	English
""	All statuses
Borrador	Draft
Publicado	Published
Adjudicado	Awarded
Celebrado	Executed
Liquidado	Liquidated

Modalidad (Procurement Type) Values

Value	English
""	All types
Licitacion publica	Public Tender
Seleccion abreviada	Abbreviated Selection
Concurso de meritos	Merit Contest
Contratacion directa	Direct Contracting
Minima cuantia	Minimum Amount

Output Schema

Each contract record contains the following fields:

{
  "id": "string - Unique contract identifier",
  "proceso": "string - Purchase process ID",
  "referencia": "string - Contract reference number",
  "estado": "string - Contract status",
  "entidad": {
    "nombre": "string - Contracting entity name",
    "nit": "string - Entity tax ID (NIT)"
  },
  "contratista": {
    "nombre": "string - Contractor/vendor name",
    "documento": "string - Contractor ID document"
  },
  "objeto": "string - Contract object/description",
  "tipoContrato": "string - Type of contract",
  "modalidad": "string - Procurement modality",
  "valorContrato": "number - Original contract value",
  "valorTotal": "number - Total value with additions",
  "moneda": "string - Currency code",
  "fechaFirma": "string - Signature date (ISO format)",
  "fechaInicio": "string - Start date (ISO format)",
  "fechaFin": "string - End date (ISO format)",
  "duracion": "string - Duration with additions (days)",
  "departamento": "string - Department/state",
  "ciudad": "string - City",
  "urlProceso": "string - URL to process details on SECOP",
  "esGrupo": "boolean - Is group/consortium",
  "esPyme": "boolean - Is SME (small/medium enterprise)",
  "justificacionModalidad": "string - Justification for procurement type",
  "scrapedAt": "string - Scrape timestamp (ISO format)"
}

Example Input

Search for construction contracts in Bogota

{
  "query": "construccion",
  "departamento": "Bogota D.C.",
  "estado": "Celebrado",
  "limit": 500
}

Find direct contracts from a specific entity

{
  "entidad": "Ministerio de Salud",
  "modalidad": "Contratacion directa",
  "limit": 1000
}

Get all awarded public tenders

{
  "estado": "Adjudicado",
  "modalidad": "Licitacion publica",
  "limit": 2000
}

Example Output

{
  "id": "CO1.PCCNTR.12345678",
  "proceso": "CO1.PRC.123456",
  "referencia": "CT-2024-001",
  "estado": "Celebrado",
  "entidad": {
    "nombre": "MINISTERIO DE TRANSPORTE",
    "nit": "899999055"
  },
  "contratista": {
    "nombre": "CONSTRUCTORA EJEMPLO S.A.S",
    "documento": "900123456"
  },
  "objeto": "Construccion de vias terciarias en el departamento de Cundinamarca",
  "tipoContrato": "Obra",
  "modalidad": "Licitacion publica",
  "valorContrato": 5000000000,
  "valorTotal": 5250000000,
  "moneda": "COP",
  "fechaFirma": "2024-03-15T00:00:00.000",
  "fechaInicio": "2024-04-01T00:00:00.000",
  "fechaFin": "2025-03-31T00:00:00.000",
  "duracion": "365",
  "departamento": "Cundinamarca",
  "ciudad": "Bogota",
  "urlProceso": "https://community.secop.gov.co/Public/Tendering/OpportunityDetail/Index?noticeUID=CO1.NTC.123456",
  "esGrupo": false,
  "esPyme": true,
  "justificacionModalidad": null,
  "scrapedAt": "2024-06-15T14:30:00.000Z"
}

Colombian Departments

Common department values for filtering:

• Amazonas
• Antioquia
• Arauca
• Atlantico
• Bogota D.C.
• Bolivar
• Boyaca
• Caldas
• Caqueta
• Casanare
• Cauca
• Cesar
• Choco
• Cordoba
• Cundinamarca
• Guainia
• Guaviare
• Huila
• La Guajira
• Magdalena
• Meta
• Narino
• Norte de Santander
• Putumayo
• Quindio
• Risaralda
• San Andres y Providencia
• Santander
• Sucre
• Tolima
• Valle del Cauca
• Vaupes
• Vichada

Rate Limiting

The scraper automatically handles rate limiting:

• With Socrata token: 100ms delay between requests
• Without token: 500ms delay between requests

For large extractions (>5,000 contracts), using a Socrata app token is recommended.

Tech Stack

• Node.js 18+
• Apify SDK 3.x
• Crawlee 3.x

Local Development

# Install dependencies
npm install

# Set optional environment variable
export SOCRATA_APP_TOKEN="your-token-here"

# Run locally
npx apify run

Resources

• SECOP II Platform
• datos.gov.co Dataset
• Socrata API Documentation
• Colombia Compra Eficiente

License

This actor is provided as-is for accessing publicly available Colombian government procurement data.