Learning Objectives
By the end of this lesson, learners should be able to:
- Define data management and explain its organizational importance.
- Describe the data management lifecycle.
- Distinguish data management from data analysis.
- Explain the roles of data owners, custodians and stewards.
- Identify major components of an effective data management environment.
- Explain how effective data management supports business analytics.
- Meaning of Data Management
Data management is the discipline of planning, organizing, controlling, protecting and maintaining data so that
it remains accessible, reliable, secure and fit for its intended purposes.
Data management covers the entire journey of data, from its creation or acquisition through storage, use,
sharing, retention and eventual disposal.
A simplified representation is:
Create/Acquire → Store → Maintain → Use → Share → Retain/Dispose
- Why Data Management Matters
Organizations depend on data for:
- Decision-making.
- Financial reporting.
- Customer management.
- Operational planning.
- Risk management.
- Regulatory compliance.
- Performance measurement.
- Business analytics.Poorly managed data can create:
- Incorrect reports.
- Conflicting information.
- Inefficient processes.
- Security exposures.
- Compliance problems.
- Poor analytical conclusions.
Data management is therefore an organizational capability rather than merely an IT activity.
- Data Management and Data Analytics
Data management and analytics perform different but interconnected functions.
Data management focuses on ensuring that data is properly acquired, stored, maintained, protected and
made available.
Data analytics focuses on examining data to generate insights and support decisions.
A useful relationship is:
Data Management → Reliable Data → Analytics → Insight → Decision
Analytics cannot consistently produce reliable results when the underlying data environment is poorly
managed.
- The Data Management Lifecycle
The data lifecycle describes the major stages through which data passes.
4.1 Data Creation or Acquisition
Data may be generated internally or obtained from external sources.
4.2 Data Storage
Data is stored in systems such as:
- Databases.
- Data warehouses.
- Data lakes.
- Cloud platforms.
- Document repositories.4.3 Data Maintenance
Data may need to be:
- Updated.
- Corrected.
- Standardized.
- Validated.
- Integrated.
4.4 Data Use
Users may access data for:
- Operations.
- Reporting.
- Analytics.
- Research.
- Decision-making.
4.5 Data Sharing
Data may be shared across departments, systems or authorized external parties.
4.6 Data Retention and Disposal
Data should be retained according to business, legal and regulatory requirements and securely disposed of
when it is no longer required.
- Data Architecture
Data architecture describes the structures and systems through which data is collected, stored, integrated
and accessed.
It may include:
- Operational databases.
- Data warehouses.
- Data lakes.
- Integration platforms.
- Metadata repositories.
- Analytical platforms.
A sound architecture should support organizational requirements while addressing security, scalability,
performance and governance.6. Databases, Data Warehouses and Data Lakes
Databases
Databases generally support structured storage and operational transactions.
Data Warehouses
A data warehouse is designed primarily to consolidate data for reporting and analytical use.
Data Lakes
A data lake can store large volumes of data in various formats, including structured and unstructured data.
The choice between these environments depends on organizational requirements and analytical objectives.
- Data Ownership
Data ownership concerns accountability for particular categories or domains of organizational data.
A data owner may be responsible for:
- Defining appropriate use.
- Establishing access requirements.
- Approving policies.
- Ensuring accountability.
Ownership is primarily an accountability function rather than simply technical possession of a database.
- Data Stewardship
A data steward helps ensure that data is properly defined, maintained and used according to organizational
standards.
Responsibilities may include:
- Data definitions.
- Quality monitoring.
- Metadata maintenance.
- Issue resolution.
- Governance compliance.Data stewards often serve as a bridge between business requirements and technical data management.
- Metadata
Metadata is information that describes data.
Examples include:
- Field name.
- Definition.
- Data type.
- Source.
- Owner.
- Date created.
- Permitted values.
Metadata helps users understand what data means and how it should be interpreted.
For example, a field named Revenue is ambiguous without knowing whether it represents:
- Gross revenue.
- Net revenue.
- Monthly revenue.
- Annual revenue.
- Revenue before or after certain adjustments.
A clear definition reduces analytical ambiguity.
- Master Data
Master data refers to relatively stable core information shared across organizational processes.
Examples include:
- Customers.
- Products.
- Suppliers.
- Employees.
- Locations.
If different systems maintain inconsistent versions of the same customer or product, reporting and analytics
can become unreliable.11. Data Integration
Organizations often have data distributed across multiple systems.
Data integration combines data from different sources so that it can be accessed and analyzed consistently.
Integration challenges may arise because systems use different:
- Formats.
- Identifiers.
- Definitions.
- Data structures.
- Update schedules.
Effective integration requires appropriate technical and governance controls.
- Data Management and Business Value
Effective data management can improve:
- Decision quality.
- Operational efficiency.
- Regulatory compliance.
- Customer understanding.
- Analytical reliability.
- Risk management.
However, data management also involves costs.
Organizations must consider:
- Storage.
- Infrastructure.
- Security.
- Personnel.
- Governance.
- Maintenance.
The objective is therefore not to preserve every possible piece of data indefinitely, but to manage data
according to its business value, risk and purpose.
Lesson Summary
Data management provides the foundation upon which reliable analytics can be built.It encompasses the acquisition, storage, maintenance, use, sharing, protection, retention and disposal of data.
Important concepts include:
- Data lifecycle.
- Data architecture.
- Data ownership.
- Data stewardship.
- Metadata.
- Master data.
- Data integration.
Effective data management ensures that data is accessible, understandable, reliable, secure and fit for
purpose.
References
- DAMA International — DAMA-DMBOK
DAMA International
- ISO — ISO 8000 Data Quality
ISO 8000 Data Quality
- ISO/IEC — Information Technology Standards
ISO/IEC JTC 1 Information Technology
- NIST — Cybersecurity Framework
NIST Cybersecurity Framework
Review Questions
- What is data management?
- Why should data management be viewed as an organizational capability?
- How does data management differ from data analytics?
- What are the major stages of the data lifecycle?
- What is the role of a data owner?
- How does a data steward contribute to data quality?
- Why is metadata important?
- What is master data?
- Why is data integration necessary in modern organizations?
- How can poor data architecture affect analytics?
- Why should organizations consider data retention and disposal?
- How does effective data management contribute to business value?