Questions and Answers
What is data?
A set of facts, numbers, words, sounds, or pictures that can be recorded and stored.
Which of the following types of data is organized and has a predefined format?
What defines Big Data?
What does the term 'velocity' refer to in Big Data?
Signup and view all the answers
Volume is not an important characteristic of Big Data.
Signup and view all the answers
What is the definition of a data lake?
Signup and view all the answers
The _____ refers to the quality, reliability, and accuracy of data in Big Data.
Signup and view all the answers
Match the following types of data with their descriptions:
Signup and view all the answers
What does value refer to in Big Data?
Signup and view all the answers
Study Notes
Introduction to Big Data
- Data consists of facts, numbers, words, sounds, or images that can be recorded and stored, serving as the foundation for information and knowledge derivation.
- Raw, unprocessed data is the base, while processed and organized data is termed information; knowledge refers to the understanding derived from the information.
Types of Data
- Structured Data: Highly organized, resembling spreadsheets with rows and columns; easy to search and analyze.
- Unstructured Data: Lacks a predefined format; includes text documents, emails, social media posts, images, and videos; more complex to analyze.
- Semi-structured Data: Falls between structured and unstructured; has some internal organization but does not conform to a strict format, such as JSON files with key-value pairs.
What is Big Data?
- Big Data encompasses data generated frequently, in high volumes, and in various forms; defined by not only its size but also its variety and velocity.
Big Data Characteristics
- Volume: Refers to the amount of data created; for instance, Facebook hosts over 250 billion images and grows daily.
- Velocity: Indicates the speed at which data is generated; Twitter accounts for over 500 million tweets daily.
- Variety: Pertains to different data types; Instagram generates diverse formats like photos, videos, and text.
- Veracity: Relates to data reliability, quality, and accuracy; poor quality can lead to flawed insights and decisions.
- Value: Reflects the importance and usefulness of data for deriving business insights and benefits; considered the most crucial "V" in a business context.
Data Storage
- Data storage involves saving digital information in mediums, like hard drives or cloud services, for later access, management, and retrieval.
-
Multi-Temperature Storage:
- Hot Storage: Frequently accessed data needing fast read/write speeds; used for real-time applications.
- Warm Storage: Occasionally accessed data, which doesn't require rapid access, suitable for historical but relevant reporting.
- Cold Storage: Rarely accessed data kept for long-term retention, like archived historical records.
Data Repositories
- Data Lake: A flexible storage solution that accommodates both structured and unstructured data at scale, allowing raw data storage in its native format.
- Data Warehouse: Structured storage optimized for analyzing large datasets, facilitating data extraction and reporting.
- Data Mart: A subset of a data warehouse focusing on a specific business line or team function, providing specialized data access.
Studying That Suits You
Use AI to generate personalized quizzes and flashcards to suit your learning preferences.
Description
This quiz explores fundamental concepts of Big Data, including data storage, ETL vs ELT, data warehousing, and data modeling. You'll gain insights into levels of abstraction and schema types, enhancing your comprehension of Big Data architecture. Perfect for newcomers or those refreshing their knowledge!
