Security, compliance, and governance
Understanding Data and Model Lineage
Data and model lineage is the record of where data and models came from and how they were transformed and evolved. It shows their reliability, biases, and limits.
Source citation and documenting data origins
These support transparency, traceability, and accountability. Documenting origins means recording:
- How the data was collected
- How it was curated and cleaned
- What preprocessing or transformations were applied
Tools and techniques
- Data lineage: tracking data through each transformation
- Cataloging: an inventory of datasets and their metadata
- Model cards: standardized documentation of a model's intended use, performance, and limits, including datasets, sources, licenses, and known biases
Amazon SageMaker Model Cards record intended use, risk rating, training details and metrics, evaluation results, and recommendations. They guide correct use, support audits, and show how a model serves business goals.