Data Sources

Monopigi ingests data from 8 Greek government sources. Each source is updated daily via automated pipelines.

Source Overview

Source	Type	Records	Update Frequency
data.gov.gr	Open data portal	84 datasets	Daily
MITOS	Organization registry	2,886 orgs	Daily
Diavgeia	Government decisions	31M+ decisions	Daily
TED	EU procurement	18K+ GR notices	Daily
RAE	Energy permits	10K+ permits	Daily
ELSTAT	Statistical data	28 indicators	Daily
KIMDIS	Public contracts	1M+/year	Daily
geodata.gov.gr	Geospatial data	Varies	Daily

data.gov.gr

Greek Open Data Portal — the central open data platform of the Greek government.

Endpoint: /v1/data_gov_gr/documents
Data types: Health statistics, economic indicators, crime data, energy metrics, demographic data
Format: Structured datasets with time series
API: Official REST API with token authentication

monopigi documents data_gov_gr --limit 10

docs = client.data_gov_gr.datasets(limit=10)

MITOS

Government Service Catalog — registry of all Greek public sector organizations and services.

Endpoint: /v1/mitos/documents
Data types: Organization names, addresses, VAT numbers, organizational structure, service descriptions
Format: Structured records
API: Official SOAP/REST API

monopigi documents mitos --limit 10

orgs = client.mitos.organizations(limit=10)

Diavgeia

Clarity Program (Diavgeia) — mandatory transparency portal where all Greek government decisions must be published.

Endpoint: /v1/diavgeia/documents
Data types: Government decisions, budget approvals, appointments, contracts, regulations
Format: Structured metadata + PDF documents
Volume: 31M+ decisions since 2010
API: Official REST API with full-text PDF extraction

Every Greek government decision — from local municipalities to ministries — is legally required to be published on Diavgeia. This makes it one of the most comprehensive government transparency datasets in Europe.

monopigi documents diavgeia --limit 10 --since 2026-01-01

decisions = client.diavgeia.decisions(limit=10, since="2026-01-01")

TED

Tenders Electronic Daily — the EU public procurement portal, filtered for Greek notices.

Endpoint: /v1/ted/documents
Data types: Contract notices, award notices, prior information notices
Format: Structured XML/JSON with CPV codes, contract values, bidder data
Volume: 18K+ Greek notices
API: EU Publications Office API

TED covers all public procurement above EU thresholds. Every major Greek infrastructure project, hospital supply contract, and IT tender is published here.

monopigi documents ted --limit 10 --since 2026-01-01

notices = client.ted.notices(limit=10, since="2026-01-01")

RAE

Regulatory Authority for Energy — permits and licenses for energy projects in Greece.

Endpoint: /v1/rae/documents
Data types: Wind farm permits, solar installation licenses, hydro permits, natural gas licenses
Format: Structured records with GeoJSON locations
Volume: 10K+ permits
API: Official geospatial API

RAE data includes geographic coordinates for every energy installation, enabling spatial analysis of Greece's energy transition.

monopigi documents rae --limit 10

permits = client.rae.permits(limit=10)

ELSTAT

Hellenic Statistical Authority — official statistics of Greece.

Endpoint: /v1/elstat/documents
Data types: GDP, unemployment, trade balance, population, inflation, industrial production
Format: Time series data
Volume: 28 statistical indicators
API: SDMX-compatible data API

monopigi documents elstat --limit 10

datasets = client.elstat.datasets(limit=10)

KIMDIS

Central Electronic Registry of Public Contracts — all Greek public sector contracts.

Endpoint: /v1/kimdis/documents
Data types: Contract terms, vendor data, amounts, procurement methods
Volume: 1M+ contracts per year
API: Official registry API
Also known as: e-Procurement (e_procurement is an alias)

KIMDIS covers contracts below EU thresholds that don't appear in TED, providing complete coverage of Greek public procurement at all levels.

monopigi documents kimdis --limit 10

geodata.gov.gr

National Geospatial Data Portal — geospatial datasets from Greek government agencies.

Endpoint: /v1/geodata/documents
Data types: Administrative boundaries, land use, environmental data, infrastructure maps
Format: GeoServer WFS/WMS + ArcGIS REST services
API: OGC-compliant geospatial services

monopigi documents geodata --limit 10

Data Quality

Every document in Monopigi has a quality_score (0.0 to 1.0) based on:

Completeness — how many fields are populated
Freshness — how recently the document was published
Consistency — whether the document follows expected patterns

Results are sorted by quality score by default, so the best data surfaces first.

Ingestion Pipeline

Source API → Connector → Raw Table (per source)
                              ↓
                        Merger (dedup + standardize)
                              ↓
                        Curated Table (unified schema)
                              ↓
                        API serves from curated table

All connectors support:

Incremental ingestion — only fetch new records since last run
Watermark tracking — resume from where we left off after failures
PDF text extraction — full text extracted from PDF documents (Diavgeia)
Daily scheduling — automated via Dagster orchestration