VendorGate Features - Contract-Based Data Validation

A complete validation platform for vendor files, API feeds, and database extracts. Define contracts, catch bad data, and route only clean records to your downstream systems.

Define once. Validate every run.

A contract is a single source of truth for what valid data looks like. Build it once, version it, and reuse it across multiple pipelines.

Visual contract builder

Create contracts without writing code. Define source format, schema, rules, statistics, and anomaly thresholds through a guided interface.

  • CSV, TSV, Excel, JSON, XML, fixed-width, API, and database sources
  • Positional column mapping for headerless files
  • Null values, encodings, delimiters, and line terminators

Schema validation

Every column gets a type and constraints. Records that do not parse are flagged immediately with row and field references.

  • String, integer, decimal, boolean, date, datetime, email, URL, UUID, JSON
  • Required, nullable, min/max length, precision
  • Custom date formats and true/false value mappings

Stateless rules

Check every record in isolation against business rules. Fail fast on bad values before they reach downstream systems.

  • Required, regex, min/max value, allowed values
  • Valid email, URL, and date formats
  • Starts with, ends with, contains, not contains

Stateful rules

Validate properties that require memory of the entire dataset, using an ephemeral SQLite state store.

  • Unique and composite unique checks
  • Group consistency and duplicate row detection
  • Sequence and balance checks

Statistics and baselines

Collect measurements on every run and compare them to historical baselines. Understand normal before you enforce strict thresholds.

  • Row count, averages, sums, min, max, distinct counts
  • Null and duplicate percentages
  • Standard deviation and custom statistics

Anomaly detection

Flag unusual runs based on calibrated baselines. System-assisted threshold calibration reduces false positives.

  • Volume drops, spikes, and percent changes
  • Absolute changes and z-score thresholds
  • Low, medium, and high calibration confidence

Connect to any source. Deliver to any destination.

Source adapters

Pull files and data from wherever your vendors send them, on their schedule or yours.

  • SFTP, FTP, or S3 with file stability detection
  • REST APIs with cursor, page, or offset pagination
  • PostgreSQL, MySQL, MSSQL, and SQLite queries

Delivery destinations

Route valid files to production paths and bad files to quarantine, automatically.

  • SFTP, FTP, and S3 delivery
  • HTTP POST to custom endpoints
  • Database upsert and insert operations

API health monitor

Watch vendor endpoints between file deliveries. Get alerted when an API goes down before your pipeline depends on it.

  • Uptime checks with custom headers and assertions
  • Response time and status code tracking
  • Included on all tiers

Run, review, and audit every feed

Pipelines

One pipeline per data feed. Own the source, schedule, contract, delivery, and alerts independently from the validation logic.

  • Cron, polling, and event-driven schedules
  • Retry logic and source unavailability handling
  • Per-pipeline run history and status

PASS, REVIEW, or FAIL decisions

Every run gets a decision based on findings and your policies. Structural errors fail. Anomalies trigger review. Clean files pass through.

  • Configurable severity thresholds
  • Manual review queue with approval reasons
  • Auto-expire reviews that are not actioned

Alerts and notifications

Notify the right people at the right time with email and webhook alerts for every outcome.

  • Pass, review, fail, source unavailable, and delivery failed alerts
  • Webhook signatures with HMAC-SHA256
  • Recipient scopes by team role

Complete audit trail

Every event in the lifecycle of every run is recorded. Answer any question about any file that passed through the platform.

  • Immutable run artifacts
  • Findings, measurements, anomalies, and decisions
  • Configurable retention policies

File standardizer

Map, join, and normalize files from multiple vendors into a single standardized output. Available from the Growth tier.

  • Field mapping and renaming
  • Multi-file joins and aggregations
  • Orchestrated or independent input flows

Teams and access control

Organize users into teams with scoped access to pipelines, contracts, credentials, and runs.

  • Account owner, team admin, and team member roles
  • Unlimited team members on all tiers
  • Invitation and membership management

See the full platform in action

Watch how to connect a source, build a contract, and catch your first bad file in minutes.