The Python SDK is an internal DataLinks tool that is made available for public use. It is intended for experimentation and lightweight integrations. Feature coverage and update timing may vary. For fully supported functionality and production use, please refer to the DataLinks API documentation.
Features
- Ingestion API: Easily ingest data into namespaces with built-in batching and retry mechanisms.
- Multipart Upload: Reliable large file ingestion via chunked S3 uploads with automatic abort on failure.
- Ingestion Tracking: Poll for async ingestion completion and progress after multipart uploads.
- Inference Workflow Management: Define custom chains of inference and validation steps.
- Entity Resolution: Match entities using configurable exact or geo-based matching methods.
- Namespace Management: Create and manage namespaces with privacy options.
- Data Querying: Query data with options to include/exclude metadata.
- Custom Loaders: Load custom data formats like JSON into defined workflows.
- CLI Tool: Standardized command-line interface for managing ingestion pipelines quickly.
Run Unit Tests
Run the tests against your own interpreter:script
tox runs the full matrix — Python 3.11 through 3.14, plus type checking
and linting — and fails on any interpreter you do not have installed.