Home » Business » Big Data » Infographic: How to reduce big data silos in the enterprise
Big data silos are a common problem for many organizations. However, when proper access controls are in place and data can be shared, companies are better able to increase productivity and make stronger business decisions.
In health care, allowing data to be accessed by multiple parties drives an even deeper importance as that shared data can potentially save patient lives.
The nonprofit Translational Genomics Research Institute (TGen) worked with data recovery company Systems Imagination to build a robust solution that combines the analytical tools of Dell Statistica with the Apache Hadoop open-source solution and Dell Boomi cloud integration platform. They’ve demonstrated how bringing multiple platforms together can allow organizations to gain significant results toward finding cures for devastating diseases.
One important demonstration of eliminating silos and building access to multiple platforms across an organization is in how TGen was able to develop a robust repository of data on melanoma.
“We want to use all of these tools in concert to create an end-to-end solution for our partners,” said Spyro Mousses, president and chief scientific officer at Systems Imagination.
Additionally, the results from sharing data can reduce storage costs in an organization, according to an IDC report.
Of 600 IT decision makers across Asia Pacific and India, 40 percent said they still manage their backup, recovery, data protection and analytics strategies at a departmental level rather than across an organization.
“This necessary shift in the way data is stored, managed and analyzed requires organizations to move from departmental (or siloed) approaches when managing their data assets to an integrated data-driven culture,” Daniel-Zoe Jimenez, IDC’s senior program manager for big data, analytics, enterprise applications & social, said in a statement.
Data silos are “clearly a big problem, and you have to really integrate data with different organizational structures, and that requires clever things like looking at how different data structures can be merged,” Donald E. Brown, director of the Data Science Institute at the University of Virginia, told Power More.
There’s no universal method for reducing data silos. However, investment in a deployment of an Apache Hadoop open-source platform can be a flexible and cost-effective option.
“Invest in the time and resources to combine the different data among the different organizations,” Brown advised.
There are many examples of how taking control of data by beginning to eliminate data silos can build, grow or protect organizations. By integrating data, companies can gain awareness of patterns to detect when breaches occur, said Jeff Cotrupe, industry director for big data and analytics at Frost & Sullivan.
“Big data is a great source of information that has informed some of the security measures out there,” Cotrupe said.
From getting started on a big data journey to moving into advanced analytics, eliminating data silos is an imperative step. To bring data together from different applications or systems on different hardware, companies can extract, transform and load (ETL) jobs using the Dell | Cloudera | Syncsort Data Warehouse Optimization – ETL Offload Reference Architecture.This platform can be an effective first use case in Hadoop for organizations without a need to learn new code or hire specialized consultants.
In addition, near real-time analytics can enable organizations to respond immediately to the insights delivered from data. The global market for big data and predictive analytics services is expected to grow to $125 billion in 2015, IDC reported.
Check out the infographic below to learn more about steps companies can take to reduce big data silos.