MindMap Gallery What is big data
Xiaobai understood the knowledge of big data and introduced the connotation and extension of big data. Technical challenges and scientific significance, data science, etc.
Edited at 2024-04-12 12:08:01One Hundred Years of Solitude is the masterpiece of Gabriel Garcia Marquez. Reading this book begins with making sense of the characters' relationships, which are centered on the Buendía family and tells the story of the family's prosperity and decline, internal relationships and political struggles, self-mixing and rebirth over the course of a hundred years.
One Hundred Years of Solitude is the masterpiece of Gabriel Garcia Marquez. Reading this book begins with making sense of the characters' relationships, which are centered on the Buendía family and tells the story of the family's prosperity and decline, internal relationships and political struggles, self-mixing and rebirth over the course of a hundred years.
Project management is the process of applying specialized knowledge, skills, tools, and methods to project activities so that the project can achieve or exceed the set needs and expectations within the constraints of limited resources. This diagram provides a comprehensive overview of the 8 components of the project management process and can be used as a generic template for direct application.
One Hundred Years of Solitude is the masterpiece of Gabriel Garcia Marquez. Reading this book begins with making sense of the characters' relationships, which are centered on the Buendía family and tells the story of the family's prosperity and decline, internal relationships and political struggles, self-mixing and rebirth over the course of a hundred years.
One Hundred Years of Solitude is the masterpiece of Gabriel Garcia Marquez. Reading this book begins with making sense of the characters' relationships, which are centered on the Buendía family and tells the story of the family's prosperity and decline, internal relationships and political struggles, self-mixing and rebirth over the course of a hundred years.
Project management is the process of applying specialized knowledge, skills, tools, and methods to project activities so that the project can achieve or exceed the set needs and expectations within the constraints of limited resources. This diagram provides a comprehensive overview of the 8 components of the project management process and can be used as a generic template for direct application.
Big Data
Overview
Data: a general term for all symbols that can be input into a computer and processed by a computer program
Classification of data: structured, semi-structured, unstructured
The value contained in data: explain phenomena; discover patterns and then make predictions
The connotation and extension of big data
Data Era: Human-machine-thing integration
What is big data? ——①Wikipedia: Data that is large in scale and complex in structure, and difficult to obtain, manage, and process within a tolerable time through existing commercial tools and technologies. ② National Institute of Standards and Technology: It is characterized by large scale, variety, rapid growth and frequent changes, and requires a scalable architecture to effectively store, process and analyze extensive data sets.
Role and significance: economic, social, scientific
Technical challenges and scientific significance
General process of data processing
Data acquisition: After data acquisition, the data needs to be transformed, cleaned and other preprocessing to output data that meets the data application requirements.
Data management: classifying, encoding, storing, indexing and querying data
Data analysis: descriptive analysis, diagnostic analysis, predictive analysis and prescriptive analysis
Data visualization and interactive analysis: Help business personnel rather than data processing experts better understand the results of data analysis
Are there any challenges in computing itself?
Security and privacy: ① Big data has become a prominent target of network attacks, and a massive amount of data is obtained in one attack, increasing the hacker's "profit rate"; ② Centralized storage of data increases the risk of leakage; ③ Big data has become a means of hacker attack, and hackers collect it to the maximum extent Useful information to make attacks more precise.
Sharing and gathering
law and ethics
Relationship with cloud computing and artificial intelligence: Data and analysis of data objectively support the development of human artificial intelligence tasks.
data science
In 2001, Bell Labs scientist Wiliam SCleveland proposed for the first time: The technical content related to science and data is expanded in the following six aspects. Later, a new independent discipline "data science" was formed 1. Multidisciplinary Investigations; 2. Models and Methods for Data; 3. Computing with Data; 4. Data Science Tutorial (Pedagogy); 5. Tool Evaluation; 6. Theory (Theor)