This module provides a roadmap to understanding the way big data is redefining how we gather, store, manage, and apply information. A variety of topics are covered including big data’s role in changing societal organization, privacy and legal issues, and the advantage disadvantages, and ethical implications of the use of big data in planning and decision-making across business and government.

Resource List
These resources provide a baseline of understanding, but as the strategic environment continues to evolve, new data will become available.
Organizations:
- Council for Big Data, Ethics, and Society: The Council for Big Data, Ethics and Society provides social and cultural perspectives on big data initiatives. The council addresses issues on security, privacy, equality, and access, to help guard against known mistakes and inadequate preparation in the use of big data, through Council public commentary, white papers and direct engagement with data analytics projects. http://bdes.datasociety.net/.
- IEEE Computer Society: The IEEE Computer Society strives to advance the theory, design, practice and application of computer and information processing science and technology. IEEE Computer Society offers professional education on a variety of topics including big data. https://www.computer.org/. Big data eLearning courses: https://www.computer.org/web/education/big-data-elearning-courses.
- Data and Civil Rights Conference: Data and Civil Rights is an annual conference that brings together leaders in civil rights, government, industry, and academic research to address how we preserve and strengthen civil rights in the face of data-driven technological change. Conference workshop and breakout session write-ups and primers are provided. http://www.datacivilrights.org/. Conference details: http://www.datacivilrights.org/2014/ and http://www.datacivilrights.org/2015/.
Recent Publications and Journal Articles:
- The World’s Technological Capacity to Store, Communicate, and Compute Information: In this study, researchers estimated the world’s technological capacity to store, analyze, and communicate information by tracking analog and digital technologies during a twenty-year period (1986-2007). Implications for necessary storage growth rates based on increased calculation rates are discussed and supporting material is provided.
- Citation: Hilbert, M., & López, P. “The World’s Technological Capacity to Store, Communicate, and Compute Information”. Science (2011), 332(6025):60 –65. Accessed 10 April 2017, http://www.martinhilbert.net/WorldInfoCapacity.html/.
- Information Management and Big Data: A Reference Architecture: There has been a significant rise in the number of organizations using big data technologies to interpret and manage their data for use in fact-based decision-making. There are a number of big data technologies and just as many ways to implement and combine systems to manage a data set. This white paper explores big data within the context of Oracle’s Information Management Reference Architecture as well as the background behind big data and how information can be structured into a single information resource.
- Citation: Oracle White Paper. “Information Management and Big Data: A Reference Architecture”, Oracle. (2014). September. http://www.oracle.com/technetwork/database/bigdata-appliance/overview/bigdatarefarchitecture-2297765.pdf.
- Data Quality Management, Data Usage Experience and Acquisition Intention of Big Data Analytics: In this study, the researchers review key issues and drivers in adopting big data technology by organizations including the acquisition intent and continued use of big data analytics.
- Citation: Kwon, Ohbyung. “Data Quality Management, Data Usage Experience and Acquisition Intention of Big Data Analytics”. International Journal of Information Management (2014), 34(3):387. http://www.sciencedirect.com/science/article/pii/S0268401214000127.
- Big Data and Society Journal: This Open Access peer-reviewed scholarly journal publishes interdisciplinary work principally in the social sciences, humanities, and computing and their intersections with the arts and natural sciences about the implications of big data for societies. The Journal’s key purpose is to provide a space for connecting debates about the emerging field of big data practices and how they are reconfiguring academic, social, industry, business and governmental relations, expertise, methods, concepts and knowledge. Browse Journal articles here: http://journals.sagepub.com/loi/bds.
- National and Transnational Security Implications of Big Data in the Life Sciences: This report is an evaluation of the drives of big data in the life sciences, possible risks benefits of big data analytics, and existing or needed solutions to address the risks identified. Risks include, but are not limited to, vulnerabilities of datasets to cyber intrusion and design of biological weapons derived from the integration and analysis of big data in the life sciences.
- Citation: American Association for the Advancement of Science. “National and Transnational Security Implications of Big Data in the Life Sciences”. (2014). Prepared by the American Association for the Advancement of Science in conjunction with the Federal Bureau of Investigation and the United Nations Interregional Crime and Justice Research Institute. 26 Jun 2017, https://www.aaas.org/sites/default/files/AAAS-FBI-UNICRI_Big_Data_Report_111014.pdf
- Big Data Deep Learning: Challenges and Perspectives: As the capacity for data acquisition and storage grows so does the need for harnessing data for meaningful applications. Deep learning, a research area in machine learning and pattern recognition, is one such application avenue. This paper provides an overview of deep learning and highlights current research efforts and challenges and as well as future trends of applying deep learning to big data analysis.
- Citation: Chen, Xue-Wen and Xiatong Lin. “Big Data Deep Learning: Challenges and Perspectives,” IEEE Access (2014), 2:514-525. Accessed 10 April 2017, http://ieeexplore.ieee.org/document/6817512/.
- Challenges of Big Data Analysis: This article presents an overview of the opportunities and challenges associated with big data, with emphasis on the distinguished features of big data and statistical and computational methods as well as computing architecture to deal with them.
- Citation: Fan, Hianqing, Fang Han, and Han Liu. “Challenges of Big Data Analysis,” National Science Review (2014) June 1(2):293-314. Accessed 10 April 2017, https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4236847/.
- Big Data and Privacy: A Technological Perspective: This report examines the nature of current technologies for managing and analyzing Big Data and for preserving privacy, considers how those technologies are evolving, and explains what the technological capabilities and trends imply for the design and enforcement of public policy intended to protect privacy in Big-data contexts.
- Citation: PCAS. “Report to the President: Big Data and Privacy: A Technological Perspective” (2014), May. Executive Office of the President, President’s Council of Advisors on Science and Technology, Office of Science & Technology Policy, The White House. Accessed 10 April 2017. https://obamawhitehouse.archives.gov/sites/default/files/microsites/ostp/PCAST/pcast_big_data_and_privacy_-_may_2014.pdf.
- Will Democracy Survive Big Data and Artificial Intelligence?: Big data, artificial intelligence, cybernetics and behavioral economics are transforming the way society is organized. Smart technologies are changing the way we run businesses, governments, and cities and the potential for America to become a ‘data-controlled society.’ This article explores a number of topics including privacy, data manipulation, ‘big-nudging’ and the right to personal data. It also reviews what is means for America’s democratic values to be influenced by big data and artificial intelligence as well as the advantages and disadvantages of big data and artificial intelligence integration. The authors provide a list of fundamental principles to allow humanity to benefit from the digital revolution without causing societal harm.
- Citation: Helbing, Dirk, Bruno S. Frey, Gerd Gigerenzer, Ernst Hafen, Michael Hagner, Yvonne Hofstetter, Jeroen van den Hoven, Roberto V. Zicari, Andrej Zwitter. “Will Democracy Survive Big Data and Artificial Intelligence?” Scientific American (2017) February 25. Accessed 10 April 2017. https://www.scientificamerican.com/article/will-democracy-survive-big-data-and-artificial-intelligence/.
- The Big Data Divide: This article extends the notion of a “big data divide” to describe the unequal relationship between those who collect, store, and mine large quantities of data, and those whom data collection targets. It is difficult to anticipate the uses of data that result from large data-mining processes and therefore the types of analysis and targeting that may follow. The author also discusses the potential implications in terms of internet privacy.
- Citation: Andrejevic, Mark. “Big Data, Big Questions- The Big Data Divide,” International Journal of Communication (2014) June (8):1673-89. Accessed 11 April 2017. http://ijoc.org/index.php/ijoc/article/view/2161.
- Ebola: Mapping the Outbreak: Researchers use big data to map the outbreak and predict what is going to happen next.
- Citation: BBC News. “Ebola: Mapping the Outbreak,” BBC News. 2016 January 14. Accessed 14 April 2017, http://www.bbc.com/news/world-africa-28755033.
- U.S. Mines Personal Health Data to Find the Vulnerable in Emergencies: Personal health data can be used to warn those with severe health issues about current and forecasted weather emergencies. Information about emergency services or directions for emergency preparedness can be disseminated quickly to ensure these vulnerable individuals get the care they need.
- Citation: S. Fink. “U.S. Mines Personal Health Data to Find the Vulnerable in Emergencies”. The New York Times. 2014. Accessed 14 April 2017, https://www.nytimes.com/2014/05/16/us/us-mines-personal-health-data-to-aid-emergency-response.html.
Books:
- Big Data Management: This textbook presents an interdisciplinary approach to big data, focusing on the engineering and technology of big data systems as well as administrative aspects of management. Applications of big data in management are offered through a series of real-life case studies.
- Citation: Garcia Marquez, Fausto Pedro and Benjamin Lev (eds). “Big Data Management”. (2016). Springer International Publishing. Available for purchase: http://www.springer.com/us/book/9783319454979#aboutBook.
- Big Data: A Revolution that Will Transform How We Live, Work, and Think: A survey of big data’s growing effect on business, government, science and medicine. This book covers how big data can provide important developments and innovations in various fields and presents challenges and threats to organizations, culture, and the individual.
- Citation: Cukier, Kenneth and Viktor Mayer-Schoenberger. “Big Data: A Revolution that will Transform How We Live, Work, and Think”. 2014. John Murray Publishers, London, England. Available for purchase: https://www.amazon.com/Big-Data-Revolution-Transform-Think/dp/0544227751.
- Application of Big Data for National Security: This book contextualizes the big data concept and how it relates to national security and crime detection and prevention; presents strategic approaches for big data technologies in preventing terrorism and reducing crime; and presents a series of case studies that demonstrate the applicability of big data in national security.
- Citation: Babak Akhgar, Gregory B. Saathoff, Hamid R. Arabnia, Richard Hill, Andrew Staniforth and Saskia Bayerl. “Application of Big Data for National Security”. 2015. Butterworth Heineman, Waltham, MA. Book available online at: http://www.sciencedirect.com/science/book/9780128019672.
- Wired for Innovation: How Information Technology is Reshaping the Economy: A guide for policy makers and economists looking to understand how information technology is transforming the economy and the value of investing in information technology services as data creation and storage continues to increase. The authors argue that businesses who invest in technological innovation are investing in more than just technology, they are also inventing new forms of organizational capital to become digital businesses that improve business practices, production, and employee relations.
- Citation: Brynjolfsson, Erik and Adam Saunders. “Wired for Innovation”. (2010). The MIT Press, Cambridge, Massachusetts. Available online at: https://s3.amazonaws.com/zanran_storage/ia.ucpel.tche.br/ContentPages/107751226.pdf. Available for purchase: https://www.amazon.com/Wired-Innovation-Information-Technology-Reshaping/dp/0262518619
Other Resources:
- Six Big Data Trends to Watch in 2017: This article reviews six anticipated big data trends for 2017. These trends include: movement of data to the cloud, aggregation of digital unstructured and machine IoT data, use of dark data, stronger administration of data security permissions, immediately gratifying analytics, and business evaluations of big data projects.
- Citation: Shacklett, Mary. “Six Big Data Trends to Watch in 2017,” Tech Republic (2016) December 23. Accessed 10 April 2017. http://www.techrepublic.com/article/6-big-data-trends-to-watch-in-2017/.
- Big Data and the Future of Business: This article focuses on big data’s potential to disrupt the economy. Three policy areas are covered including employment, privacy, and regulation. Potential changes to business, health, and science institutions and the implications for the greater society are also reviewed.
- Citation: Cukier, Kenneth. “Big Data and the Future of Business”, OpenMind. Accessed 10 April 2017. https://www.bbvaopenmind.com/en/article/big-data-and-the-future-of-business/?fullscreen=true.
- Report on Big Data and Privacy: A Technological Perspective: This fact sheet summarizes the 2014 White House Office of Science and Technology Policy’s report on big data and privacy including policy recommendations.
- Citation: PCAST. Fact Sheet: “PCAST Report on Big Data and Privacy: A Technological Perspective” (2014), May 1. Office of Science & Technology Policy, The White House. Accessed 10 April 2017, https://obamawhitehouse.archives.gov/sites/default/files/microsites/ostp/PCAST/pcast_fact_sheet_on_bdp_report_-_final_formatted.pdf.
- Big Data Will Impact Every Part of Your Life: New computing technologies combined with increased internet speeds has changed the way data is captured, stored and available for use. In this TEDx talk, Dr. Charlie Stryker, talks about how big data has influenced all aspects of our daily lives and ways it is helping doctors diagnose illnesses. Accessed 11 April 2017, https://www.youtube.com/watch?v=0Q3sRSUYmys.
- What is Big Data and Why Does it Matter?: Donna Green talks about the amount of data we are generating and how to leverage all of that data to solve the world’s biggest problems. This talk touches on proactive management of systems through real-time monitoring and diagnostics using advanced analytics and the industrial internet and the cooperative efforts of data scientists and specialists (engineers, doctors, etc.). Accessed 11 April 2017, https://www.youtube.com/watch?v=qXyzDd2heK8
- Using Big Data to Influence Public Policy: The Wall Street Journal interviews Dan Kaufman, the director of DARPA to discuss the benefits and challenges of using big data to influence public policy. Accessed 13 April 2017. http://www.wsj.com/video/using-big-data-to-influence-government-policy/5C5D6086-BD0E-4B6D-B0E6-109FFD95114E.html
- Big Data, Ethical Futures: This articles discusses ways to make social media, digital networks research, and digital data collection more ethical. The author argues that data science and computational social science research, like other social science research (anthropology, sociology, psychology, etc.), is conducted using human subjects and should be subject to the same ethical and review standards.
- Citation: Gray, Mary L. “Big Data, Ethical Futures”, Anthropology News. January 13, 2017. Accessed 11 April 2017, http://www.anthropology-news.org/index.php/2017/01/13/big-data-ethical-futures/.
- The Four V’s of Big Data: Infographic discussing the four v’s of big data: volume, variety, velocity, and veracity, Accessed 11 April 2017, http://www.ibmbigdatahub.com/infographic/four-vs-big-data.
- The Internet of Things and Big Data: Making the Connection: This short blog post discusses the relationship between the Internet of Things (IoT) and the collection of data. Accessed 11 April 2017, http://www.huffingtonpost.com/philip-kushmaro/the-iot-and-big-data-maki_b_12116608.html.
- The Landscape of Big Data and the Economy: Infographic with statistics showing how big data has impacted the economy. Accessed 11 April 2017, https://www.mushroomnetworks.com/infographics/the-landscape-of-big-data-infographic.
- 37 Big Data Case Studies: A summary of 37 studies that used big data to answer important questions in their field. Accessed 13 April 2017, https://www.businessesgrow.com/2016/12/06/big-data-case-studies/.
These materials were developed as an initiative of the Advanced Thinking in Homeland Security (HSx) curriculum at the Center for Homeland Defense and Security.