Ascending the Data Infrastructure Hierarchy
The Five Stages of Data Infrastructure Management Maturity
"[In a self-actualizing person], everything now comes of its own accord, pouring out, without will, effortlessly, purposelessly. He acts now totally and without deficiency."--Abraham Maslow1
What can a psychologist teach us about data infrastructure management? Plenty, it turns out. Legendary psychologist Abraham Maslow, for one, argued that less-developed individuals and societies tend to be stuck in a daily grind of trying to satisfy lower-order requirements, such as biological survival and safety, and are therefore less capable of higher-level pursuits, such as creativity, community and the advancement of knowledge. Once individuals or societies are able to address their lower-level basic needs in some systematic or automatic fashion, they are freer to engage in higher-order pursuits.
Maslow's groundbreaking work Hierarchy of Needs, published in 1954, reflected the continuum of individuals and societies from dependency and disorder toward accomplishment and fulfillment. At the bottom level of a pyramid Maslow used to describe the continuum, individuals are consumed with simply making it through the day - foraging for the staples of life, such as food and water. There's little time for higher-level personal development.
If the individual is able to meet these very basic needs in a more systematic fashion, he or she is freer to move to the next level of needs, including shelter and health. Eventually, as all these needs are met on an ongoing and automatic basis, the individual reaches the highest stage, at the top of the pyramid, which Maslow described as "self-actualization."
This analogy can be applied to the way data is managed in organizations. The more effectively an organization is able to meet rudimentary data management needs, the more likely it is able to move up the continuum to become a well-developed, peak-performer. While many companies remain mired in reactive and idiosyncratic practices, high performers rely on disciplined, proactive and predictive approaches to Data Infrastructure Management (Data IM). In return, a peak performing organization can devote all its resources to advancing the business - be it stock trading, manufacturing, or retailing.
How does an organization advance from a relative state of immediacy to a higher-value operation? By first understanding and recognizing the five essential stages that an organization moves through as it becomes increasingly proficient at Data IM.
Level 1: Tribal
It used to be common to have database administrators or developers who lived with the system from the day it was installed. They almost had a "sixth sense" for anomalies as soon as they emerged. Such is the way things are done at the Tribal level, the most basic form of Data IM. At this level, an organization may manage to function from day to day, but without any formal processes or systematic management. Instead, Data IM is left to the whims of individuals, who carry all relevant knowledge and know-how in their heads.
Unfortunately, when a company relies on tribal knowledge, there is no clear understanding of what data professionals are doing, and how they do it. Documentation of individual duties does not exist, and professionals simply go about their duties, whether it's backing up data, monitoring networks, or administering patches to servers. Many such individuals may be highly proficient at what they do; it's just that there is no formal system assigning the tasks at hand. There is no formal method of tracking and documenting how well they succeeded in those tasks.
Of course, today's business simply does not allow for this approach. At the Tribal management level, there is no ability to comply with mandates such as Sarbanes-Oxley in an organized way. Plus, having so few people with so much company knowledge may even be a security or business continuity risk.
The informal network of professionals that is typically seen at the Tribal level also results in inconsistent performance across various systems. Different individuals have knowledge on different systems, and, as a result, the quality of support across systems will vary.
Or, as Maslow put it in his oft-quoted phrase: "When the only tool you own is a hammer, every problem begins to resemble a nail."
Level 2: Enforced
As a company advances to the next level of the Data IM Hierarchy, the Enforced stage, it begins to adopt some semblance of governance, which includes writing down standard operating procedures and putting controls in place to better manage workflow within its data environment. This may include deployment of a repository, in which data professionals are required to document changes or processes they have completed.
At the Enforced stage, stronger management takes hold, and data professionals gain a greater focus on performing tasks in a more systemized fashion - doing what is needed, versus what they want to do at that moment. A greater sense of teamwork begins to evolve at this stage.
Level 3: Standardized
As organizations advance from the Enforced stage to the next level, they reach the Standardized stage, in which, as the name suggests, processes are established to handle various aspects of Data IM, and automation is introduced. At this stage, Data IM is less dependent on individual discretion, and is more likely to take advantage of automated or systematic approaches. In addition, standards begin to get established across the various data environments, providing a more cohesive approach for assuring the viability of enterprise data sources. The organization may even establish a data warehouse or metadata repository at this stage to more effectively collect data from across the enterprise in a more consistent fashion.
There are change management practices in place, and many of these processes may be automated. The company will have established standard operating procedures for maintaining data libraries, for doing backups, for performance and tuning, upgrades, and all other aspects of Data IM.
The organization will also have formal procedures in place for its operational workflow. For example, this may include a formal system for vetting and testing new systems and applications. The organization may emulate the best practices of other companies in its own workflows and processes.
When an organization reaches the Standardized level in its Data IM evolution, it has reached an important transition point. No longer are data management operations precariously managed on an ad-hoc basis by overworked staff members. All worked is now thoroughly documented and replicable, and many mundane or routine tasks are now automated.
Level 4: Actualized
In the Actualized stage, organizations are able to start getting more creative with their data. Data can be extracted from across the enterprise - as well as from outside sources - and combined to create useful information and applied to create new knowledge and therefore new value to the business. No longer is data confined to silos, and all data management issues are addressed on a systematic basis.
As an organization moves into the Actualized stage, it is able to explore using data assets as leverage in new and higher-value ways, as its underlying Data IM is managed in a systematic and highly automated way. Data IM delegates workflow to the best resources available, freeing up data management professionals to engage with the business as consultants. As a result, greater alignment with the business is achieved.
The organization now has a standard operating procedure for handling changes that are logged into the system. The system automatically determines who in the organization is assigned the work and what is going to happen. Service-level agreements (SLAs) are also automatically tracked, along with the length of time to complete tasks, and whether the SLA is met.
Because the organization is freed from the constraints of Data IM, it has achieved the flexibility and agility to compete on analytics, since it has access to a wealth of enterprise data that is reliable and up-to-date. The management and maintenance of this data is highly automated, and decision-makers are assured that the information they are using to steer the company is the right information, delivered at the right time. A company in the Actualized stage can even put automated decision making into place, in which the system can deliver decisions almost instantaneously based on data received and mapped against rules and patterns.
Level 5: Peak Performance
At last, the organization reaches the pinnacle of development, where it can devote all its resources to high-level strategic initiatives, rather than administrative issues. Once the organization has attained Peak Performance, it no longer needs to spend inordinate resources to data management issues. Data IM is self-managing, automatic, and embedded into every system and process of the organization. In essence, the data infrastructure manages itself.
Personnel turnover, which is capable of creating so much chaos in lower-level organizations, is almost a non-event at Peak Performing organizations. When a member of the Data IM team leaves, new personnel can be quickly inserted and brought up to speed on standard operation procedures. In addition, these standard operating procedures are continually upgraded or re-evaluated as new circumstances arise.
At this stage, IT leaders are actively looking for ways to capitalize on their data. They are even competing on the analytics that are derived from their data foundations. They are fully focused on their competitive differentiators - the parts of the business that bring unique value to the marketplace. And they are actively engaged in efforts to drive collaboration with partners, suppliers and customers. They are thinking far beyond the boundaries of the organization to continuously drive entry into new markets.
Where Are You?
Many companies may be still in the lower stages of Data IM, as they struggle with better ways to develop more streamlined and systematic ways to manage their data assets. With today's increasing competition, along with government mandates, it's not too soon to make the move up the continuum. A company with an IT or data management staff consumed with administration issues - performing fixes, patches, or various unplanned activities on a daily or weekly basis - is not in a position to effectively compete in today's data-driven marketplace. By contrast, a well-managed organization that has attained a "Peak Performance" state of Data IM is able to devote its full attention and resources to high-value activities.
1Abraham Maslow, Toward a Psychology of Being, Third Edition.
About the Author
John Bostick is president and CEO of dbaDIRECT, which provides data infrastructure management services to Fortune 1000 and Private 500 firms including SC Johnson, Procter & Gamble, Timberland, Hanesbrands, Warner Brothers, Duke Energy and Old National Bank. He can be reached at firstname.lastname@example.org.
Copyright ©2007 Auerbach Publications.