The Road to Standardization for Data Management and Governance in Apache Hadoop
Metadata, lineage and auditing are all critical components of any comprehensive data management solution. Especially for big data, this information is essential for many stakeholders — from end users and data stewards, to corporate compliance and risk management. But this metadata, lineage and auditing doesn't exist in a vacuum. They are inherently interdependent on other systems. As big data systems like Hadoop power more and more critical, production applications, it is imperative that these systems have open integrations so both governance-related information can flow freely between systems to ensure a unified governance architecture.