GH Repository · datachain-ai
datachain
The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
- stars
- 2,818
- 30-day movement
- -1-0/day
- Related entries
- 60
- Connections
- 2
pythonclaude-codedata-processingdata-context-layermultimodalharness-engineeringcodexmlopsPythonunstructured-datapydanticai-agentsknowledge-baseagent-app
Datachain provides typed, versioned datasets over unstructured data stored in S3, GCS, and Azure. It is a Python toolchain positioned as a 'context layer' for building AI and agent applications on top of cloud object storage.
Reach for it when you need structured, versioned access to unstructured files in cloud storage for MLOps or agent pipelines.
Use it to
- Build typed datasets over S3, GCS, or Azure objects
- Version unstructured data for ML workflows
- Create knowledge bases for AI agents
- Process multimodal data with Pydantic-style typing
For Python developers building ML and agent pipelines over cloud data
- Role
- agent-app
- Language
- Python
- Licence
- Apache-2.0
- Forks
- 157
- Open issues
- 76
- Last push
- 2026-09-15
- Latest release
- 0.2.5 · 2024-07-11
topicsunstructured-datadata-context-layermlopsai-agentsmultimodaldata-processing