Skip to content

Expand Pelias with optional address, GeoNames, and interpolation sources #300

Closed as not planned

Description

@Medformatik

What problem would this solve?

The self-hosted Pelias preset imports OpenStreetMap and Who's On First, but leaves several Pelias-supported sources unused. Address coverage and interpolation quality can therefore be much weaker in areas where OSM house numbers are sparse.

What would you like to be able to do?

Make additional Pelias sources modular and region-aware: OpenAddresses, GeoNames, generated street polylines, and US TIGER-backed address interpolation where applicable. Preserve a minimal OSM+WOF profile for smaller deployments.

Acceptance criteria

  • Each optional source has a service/CLI manifest contract, version/checksum metadata, coverage rules, licensing notes, and capacity estimate.
  • Region selection maps deterministically to source downloads and rejects unsupported combinations.
  • OpenAddresses and GeoNames can be downloaded, prepared, and imported independently.
  • Street polylines and the interpolation database are generated in the correct Pelias dependency order.
  • TIGER interpolation is US-only and never silently enabled outside supported coverage.
  • Builds for the expanded profiles are resumable, observable, atomic from the query service's perspective, and recoverable after failure. Preserve the existing whole-tree staging/failure isolation; verify the additional importers and runtime-consumer handoff rather than replacing that groundwork.
  • Operators can choose minimal, address-enhanced, and full profiles with documented CPU/RAM/disk expectations.
  • A multilingual regional evaluation compares baseline and enhanced address/name recall, precision, autocomplete, and reverse geocoding.
  • Duplicate/conflicting records keep source provenance and follow a documented Pelias ranking policy.
  • Integration, smoke, and upgrade tests cover each profile.
  • Documentation states that incremental Pelias refresh is not included unless separately designed.

Alternatives or workarounds

OSM-only keeps operations small but leaves known address gaps. Enabling every importer unconditionally makes regional deployments too expensive and complicates licensing.

Additional context

Reported starting point

  • Pelias, Elasticsearch, Placeholder, and PIP services are defined.
  • integrations/geocoding-pelias/ supports forward, reverse, and autocomplete requests.
  • packages/cli/src/lib/pelias-data.ts builds OSM and Who's On First inputs.
  • Configuration declares interpolation/polyline paths, but the build does not generate/import OpenAddresses, GeoNames, TIGER interpolation, or street polylines.
  • Pelias refreshes currently use a full rebuild contract.
  • The CLI already builds the entire Pelias data tree, including the Elasticsearch index, in a sibling staging directory via withStagedBuildDir. It promotes that tree only after the build succeeds; a caught build failure removes staging and preserves the previous tree, and promotion errors attempt rollback. This is existing failure-safe groundwork, not a resumable optional-source pipeline or a guarantee of uninterrupted live queries.

Area

Geocoding, CLI data preparation, self-hosted services.

References

Activity

  1. added
    needs-triageOpen issue awaiting initial maintainer review
    integrationNew or changed provider, source or backend integration
    on Aug 31, 2026
  2. Medformatik commented on Oct 6, 2026

    @Medformatik
    CollaboratorAuthor

    Linked to regional marginal-coverage pilot #408. This existing issue remains the implementation tracker; no duplicate source/renderer issue was created.

    Rechecked the current OSM + Who's On First build in packages/cli/src/lib/pelias-data.ts. The optional source/interpolation scope here is distinct from on-device regional search (#403). Use #408 to measure marginal regional benefit and rights before selecting the extra inputs.

    Added native issue type and relative Priority/Effort fields under the updated #391 triage conventions. Original scope and acceptance criteria remain intact; unresolved source/renderer decisions retain needs-triage.

  3. updated Effort High and Priority Medium on Oct 6, 2026
  4. Medformatik commented on Nov 1, 2026

    @Medformatik
    CollaboratorAuthor

    Closing as not planned after a backlog review.

    • Pelias is the heaviest of the supported geocoders (four containers, multi-step build). The docs position Photon and Nominatim first (docs/docs/guides/geocoders.md).
    • For the German deployment, TIGER is US-only and GeoNames adds little over Who's On First plus OSM.
    • The acceptance list (source profiles, interpolation service, multilingual evaluation, per-profile upgrade tests) is large relative to the benefit.

    If a concrete address-recall gap shows up for Pelias users, a narrow follow-up such as "optional OpenAddresses import where OA covers the region" would be the right size.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    integrationNew or changed provider, source or backend integration

    Fields

    Priority

    Medium

    Effort

    High

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions