Listen to this post
AWS have released a new service called Glue.
As the launch site says: https://aws.amazon.com/glue/
“AWS Glue is a fully managed ETL service that makes it easy to move data between your data stores. AWS Glue simplifies and automates the difficult and time-consuming data discovery, conversion, mapping, and job scheduling tasks.”
This is such a simple concept, yet appears to have been missed by many companies. Cyberscience however, have had their Data Dictionary since the early 1980’s that is used with their eCQ and CS products. I would strongly suggest you learn more about CQCS from Cyberscience 🙂
Microsoft also have their Azure Data Catalogue that provides similar functionality. https://azure.microsoft.com/en-gb/services/data-catalog/