Big-data is on the to-do lists of enterprises everywhere, but increasing demand for appropriate skills and underlying infrastructure are putting the pressure on IT departments in Europe.
An enterprise embarking on a big-data project requires knowledge and skills from different disciplines. It must also assemble technical and business input from across an organization. Those entrusted with the project must excel at statistical analysis and information management; have mastered the multitude of technologies needed to gather, store, and search huge data sets; and fully understand the strategic and financial goals of the business.
This is generally a team effort, but companies are now putting more pressure on their IT departments to supply knowledge -- as well as infrastructure -- when it comes to big-data. According to ComputerWeekly, a recent survey commissioned by Teradata found that CEOs in the UK, France, and Germany were concerned about a lack of big-data skills and hoping their IT staff will fill in the gaps.
The impending shortage of big-data scientists has been widely publicized, and CEOs are feeling the effects, at least in Europe. More than 60 percent of the Teradata survey respondents agreed there was a data science skills shortage, and 42 percent were recruiting or planning to recruit employees in that role. However, 54 percent said potential applicants lacked the combination of business, IT, analytics, and communication skills required.
Alternatively, 46 percent of C-level executives were looking to existing IT staff to fill data scientist roles. That could be because effective data analysis depends so much on the underlying technology. When CEOs were evaluating experience, 53 percent valued technical experience most, followed by problem solving at 43 percent, and creativity at 35 percent.
Although big-data clearly presents an opportunity for IT growth, it may be expecting too much of too few. Duncan Ross, director of data science EMEA at Teradata, said that he was "surprised" at the high percentage of CEOs recruiting data scientists from the IT ranks. He told ComputerWeekly, "That's concerning because any business trend that looks to IT [to this extent] is in trouble."
While IT may be up to the challenge, it could be already overtaxed with building the infrastructure for big-data. TechNavio's "Global Big Data Storage and Server Market 2012-2016" report shows the market growing almost 32 percent annually over the forecast period. IT departments no doubt are struggling to adapt to the demand of such high growth rates, especially in the datacenter.
The report explains:
One of the main challenges is the increasing consolidation of network infrastructure. Due to consolidation, there is a problem in centralizing the storage and server infrastructure. Enterprises are looking at consolidation of the infrastructure to a single centralized location as a solution to solve the crisis.
IT is already mired in building the virtual datacenters and private clouds to perform data analysis. Should we expect IT staff to also be responsible for the data analysis itself? Let us know in the comments if embracing big-data is a burden or an opportunity for IT.