AWS Glue Data Catalog indexes location, schema, and metrics
Data discovery and cataloging in AWS Glue - AWS Glue
AWS documentation on Glue’s central metadata catalog, crawlers, manual tables, and links to Athena, Lake Formation, EMR, and SageMaker.
Based on
Data discovery and cataloging in AWS Glue - AWS Glue
The extract presents the AWS Glue Data Catalog as a centralized repository of metadata about an organization’s data sets. It indexes where data lives, its schema, and runtime metrics. Metadata is held in tables, each representing one data store. You can fill the catalog with a crawler that scans sources and extracts metadata, including sources inside and outside AWS, or define table structure, schema, and partitioning by hand.
That catalog is positioned as input for creating and monitoring ETL jobs and as a shared view for other AWS analytics services. Amazon Athena can store and query table metadata for S3 data with SQL. AWS Lake Formation can define fine-grained access policies and audit access. Amazon EMR can use catalog-defined sources for big data processing. Amazon SageMaker AI is listed for building, training, and deploying models against those sources. Key aspects called out are a metadata repository organized into databases and tables, and crawlers that discover new or updated sources so the catalog stays current and assets are easier to find and reuse.
For teams that care about governed, shared meaning, a catalog that holds location and schema in one place is the hinge between raw stores and consumers. Crawlers reduce manual drift; manual definitions keep intentional shapes when auto-discovery is wrong. When Athena, Lake Formation, EMR, and SageMaker all read the same catalog entries, schema and access policy become reusable contracts rather than per-tool copies—closer to a semantic layer for discovery, ETL, and AI workflows.
Put this to work on CoreModels
Related connectors and recipes
Take the next step
Try CoreModels, talk with our team, or explore more resources.