Data Packages are code libraries with a live connection to an underlying data source. They provide a powerful interface for querying, access control, versioning, performance optimization and more; over all your data, no matter where it lives. This could be any database or file system.
The Data Package can be installed using a package manager like
pip . Then, it's imported like a library dependency into your code, whether that’s a backend service performing machine learning or enrichment tasks, a customer-facing application, or even an external consumer buying access from you directly to build using the package.
A dpm-agent intelligently routes queries submitted by consumers of a Data Package to the appropriate backend source, enforces access policies and applies performance optimizations.
Today, we're excited to announce support for generated Python packages!
Sign up for early access at www.dpm.sh!