Skip to main content

Table 8 Detailed analysis of the big data ecosystem challenges and their frequency and distribution

From: Secure big data ecosystem architecture: challenges and solutions

DAMA knowledge area

Challenge

Study

Frequency

Percentage

Data architecture

Timeliness

s4, s5, s9, s12, s13, s15, s19, s24, s28, s37, s38, s40, s44, s47

14

18

 

Device heterogeneity

s14, s22, s30, s41

4

5

Data modeling and design

Data deluge

s11, s12, s13, s17, S23, s24, s27, s28S37, s38, s44, s46, s54

13

16

 

Inappropriate analytics

s6, s8, s13, s15, s18, s21, s23, s24, s44

9

11

 

Technology gap

s6, s13, s21, s23, s24, s36, s37, s38, s47

9

11

Data storage and operations

Data storage and sharing

s4, s12, s13, s17, s21, s23, s24, s26, s28, s36, s38

11

13

 

Data collection

s2, s4, s8, s12, s13, s18, s23, s24, s28, s68

9

11

 

Availability

s3, s7, s8, s9, s11, s14, s19, s21, s22, s26, s28, s38, s39, s48, s54, s57

16

20

Data security

Privacy and security

s2, s4, s5, s7, s9, s11, s13, s14, s16, s17, s18, s20, s21, s22, s24, s26, s28, s29, s30, s31, s37, s38, s39, s42, s44, s48, s49, s52, s53, s55, s56, s57, s59, s61, s62, s64, s66s67, 69, s70, s71, s73, s74, s78, s79

45

53

 

Confidentiality

s9, s16, s21, s30, s41, s74

6

8

 

Lack of skills

s5, s9, s13, s15, s18, s22, s23, s27, s34, s37

10

17

Data integration and interoperability

Data management

s23, s28, s29, s30, s36, s37

6

8

 

Data transfer

s4, s19, s23, s28, s37, s41, s44

7

9

Documents and contents

Complexity

s9, s13, s15, s22, s24, s35, s40, s42, s54

9

11

 

Different data types and formats

S38, s37, s36, s30, s24, s14, S13, s9, s13, s14, s24, s30, s36, s37, s38, s55

16

20

Reference and master data

   

0

Data warehousing and business intelligence

Establishing a data-driven culture

S2, s15, s20, s21, s24, s31, s35, s39

8

10

 

Organizational resistance

s15, s24, s31

3

4

 

Cost/budget

s6, s9, s13, s15, s22, s24, s26, s35, s37, s38, s40, s45, s46, s53, s54

15

19

Meta-data

    

Data quality

Accuracy

S9, s13, s16, s23, s24, s35, s38, s67, s71

7

9

 

Incompleteness and inconsistency

s8, s13, s16, s17, s23, s24, s38, s42, s44

9

11

 

Vagueness

s2, s6, s10, s13, s29, s42, s44

7

9

Data Governance

Governance bodies

s1, s9, s13, s19, s21, s24, s25, s28, s29, s31, s35, s38, s39, s44, s45, s47, s49

17

22