HP's Top 10 Trends in BI (and HIT) for 2009: #7 Without Data Integration, Nothing

Aug. 16, 2011
Hewlett-Packard put together a brief white paper in February of this year laying out their view of Business Intelligence (BI) for 2009 (and beyond).

Sometimes vendors do get it (mostly) right. Hewlett-Packard put together a brief white paper in February of this year laying out their view of Business Intelligence (BI) for 2009 (and beyond). I think that they got it largely right. Their #7 trend is an increasing corporate focus on rigorous data integration, including data cleansing, Master Data and Metadata Management, all as part of a comprehensive Enterprise Information Management (EIM) Strategy. Below is a summary of the trend, my thoughts on whether HP got it right and what the trend may mean for HIT.

HP Predicts: New pressures are being placed on successful Data Warehousing (DWH) and Business Intelligence (BI) initiatives. Automation of DWH analysis increasingly removes human judgement from report creation and validation; the extension of DWH/BI into the operational realm demands near-real time data, thereby significantly contracting or even completely eliminating the traditional ETL window; recessionary pressures have invigorated cost-control projects, projects which increasingly require cross-functional, and therefore cross-silo, analysis; historically recessions have also spawned mergers & acquisitions (M&A)-driven market consolidations, an attendant sequela is the need to reconcile often wildly divergent datasets; existing DWH and BI applications are being “modernized”, that is new hardware and software architectures and infrastructures which support ever larger data volumes, query complexities and user bases, the net result is the desire, need and ability to combine datamarts, reduce the number of servers, and implement data governance; and the final pressure noted by HP is the steady erosion of domain boundaries between Customer Relationship Management (CRM), Enterprise Resource Planning (ERP), DWH/BI and product lifecycle management. Together, these pressures mandate an enterprise-wide, strategic investment in creating and implementing an EIM. The Verdict: Yes, yes and yes. Before Data Integration (DI), there was Data Governance (DG), before DG there was Master Data Management (MDM), before MDM there was Data Quality (DQ), before DQ there was Data Cleansing (DC) and before DC there was Extract, Transfer and Load (ETL). In the beginning ETL included all of the above (and more) although often not explicitly. Over time DC, DQ, MDM, DG and DI all have split off from ETL, mutating into stand-alone products only to cross-breed and hybridize as various specialty vendors have merged or been acquired. As DI is the most recent branching, it is all the buzz – white papers abound, analyst opinions are legion and many organizations have embarked on or renewed their emphasis on the DI journey. That being said, the DI branch arose in response to the very pressures mentioned in the HP report.

HIT Impact: Sine Qua Non. If the impact of Trend #3 was immense, I’m not sure if there is a word expansive enough for the impact of Trend #7. The two trends are obviously related and both are in the critical path to achieving “meaningful use”, even as hazily defined as it is in ARRA. However, DI goes far beyond DQ and DG (many experts argue that DI is inclusive of both). By definition, the scope of DI is inter-source and inter-application, whereas DQ and DG minimally only require an intra-source, intra-application scope. Articles and opinions too numerous to cite have unequivocably identified redundancy, inconsistent and conflicting syntaxes, and poor coordination as key drivers of inefficiency and cost in the U.S. Healthcare system. Effective, efficient and correct DI is a necessary (albeit not sufficient) pre-condition for fixing our broken healthcare system.

Disclaimer: The opinions expressed herein are my own personal opinions and do not represent my employer's view in any way.

Sponsored Recommendations

Admit it, your EHR can’t do everything: Strategies for efficiency and better consumer experiences

Discover strategies to overcome EHR limitations and boost efficiency in your practice. Join industry leaders as they explore how a unified care enablement model can streamline...

Driving top quality performance through data-driven actionable insights.

Join us to explore how data-driven insights are transforming healthcare. Learn how leveraging big data and analytics can enhance patient care, optimize workflows, and drive top...

CMS Interoperability and Prior Authorization Final Rule: What no one is thinking about but should be

Join our panel as we explore the overlooked challenges of the CMS Interoperability and Prior Authorization Final Rule. Discover key implications for payers and providers, and ...

The Race to Replace POTS Lines: Keeping Your People and Facilities Safe

Don't wait until it's too late—join our webinar to learn how healthcare organizations are racing to replace obsolete POTS lines, ensuring compliance, reducing liability, and maintaining...