Measuring the 3V’s of Big Data: A Rigorous Approach
octubre 30 @ 1:45 pm - 2:15 pm
Although the success of big data technologies depends highly on the quali-ty of underlying data, no standard measurement model has been yet estab-lished for assessing quantitatively the quality of big data. This research aims at investigating thoroughly the quality of big data and laying rigorous foundations for its theoretically valid measurement. We recently proposed a quality measurement hierarchy for methodically selected 10V’s of big da-ta, based on the existing ISO/IEC standards, and NIST (National Institute of Standards and Technology) definitions and taxonomies. In this paper, pur-suant to our latest research, we derive measurement information model for the most widely used 3V’s of big data: Volume, Velocity and Variety. The proposed 3V’s measures, declined into a hierarchy of 3 indicators, 2 de-rived measures and 4 base measures, are validated theoretically based on the representational theory of measurement. Our future research will enhance the theoretical findings presented in this paper with empirical evidences through evaluation of these measures with open-access data.
Dr. Olga Ormandjieva is a professor in the Computer Science and Software Engineering (CSSE) Department at Concordia University, Montreal, Quebec (Canada) and a member of the Ordre des Ingénieurs du Québec (OIQ). Dr Ormandjieva has conducted extensive research in the area of Measurement in Software Engineering and its extension to the development of formal methods for modelling and monitoring functional and nonfunctional requirements with category theory. Her recent research findings tackle automatic detection of cyber-predators in social media using Artificial Intelligence (AI) technology and best Software Engineering practices. Dr. Ormandjieva’s new research direction aims at exploring different approaches to big data quality modeling and measurement. She has over 125 peer-reviewed journal and conference papers to her name, as well as seven book chapters. Dr. Ormandjieva has received several grant fundings from the Natural Sciences and Engineering Research Council (NSERC) and other sources since 2002. She graduated several doctoral and Master’s (thesis option) students and is held in very high esteem by all those she supervises. Currently Dr. Ormandjieva is teaching software engineering courses at Concordia University.