Questions and Answers
Which of the following stream processing systems utilizes automated scaling?
What is the primary purpose of Stream Analytics in the radio frequency electromagnetic spectrum?
What is the primary goal of dimensionality reduction techniques?
Which operation is responsible for transforming data into a visual representation?
Signup and view all the answers
Which architecture combines both stream and batch functionalities?
Signup and view all the answers
What type of processing accumulates new data into disjunctive groups and processes them later?
Signup and view all the answers
What is the primary difference between the Kappa architecture and traditional stream processing systems?
Signup and view all the answers
What is the purpose of real-time notifications in Stream Analytics?
Signup and view all the answers
What is the primary purpose of compression in stream processing?
Signup and view all the answers
Which of the following is an application of stream analytics?
Signup and view all the answers
Which of the following organizations is focused on promoting open standards and interoperability for industrial IoT systems?
Signup and view all the answers
What is the primary advantage of stream processing over batch processing?
Signup and view all the answers
What is the primary function of the Spectrum Streamer?
Signup and view all the answers
What is the primary advantage of Stream Analytics in IoT systems?
Signup and view all the answers
What is the primary goal of summarization in stream processing?
Signup and view all the answers
Which of the following is a characteristic of stream processing architectures?
Signup and view all the answers
What is the primary aim of the data access platform in the context of IoT?
Signup and view all the answers
What is HyperCat?
Signup and view all the answers
What is the purpose of discovery in the context of IoT data?
Signup and view all the answers
What is metadata in the context of IoT data?
Signup and view all the answers
What is the main benefit of DCAT in the context of IoT data?
Signup and view all the answers
What is a dataset in the context of IoT data?
Signup and view all the answers
What is an information consumer in the context of IoT data?
Signup and view all the answers
What are the three main aspects of interoperability in the context of IoT data?
Signup and view all the answers
What is the primary purpose of the Vulnerabilities Equities Process (VEP)?
Signup and view all the answers
What is a decentralized database managed by multiple participants across multiple nodes?
Signup and view all the answers
What is a recognizable symbol that can be combined with color coding and/or letters, numbers, etc., to indicate levels of trust, compliance, security, etc.?
Signup and view all the answers
What is a performance measure used to evaluate the efficiency or profitability of an investment or to compare the efficiency of several different investments?
Signup and view all the answers
What is a state statue intended to enhance privacy rights and consumer protection for residents of California in the United States?
Signup and view all the answers
What are the benefits of blockchain?
Signup and view all the answers
What is a declarative query language developed specifically for expressing queries used for searching and retrieving the data found in archetype-based repositories?
Signup and view all the answers
What is a centralized function within an organization employing people, processes, and technology to continuously monitor and improve an organization's security posture while preventing, detecting, analyzing, and responding to cybersecurity incidents?
Signup and view all the answers
Which wave of IoT development focuses on data management, processing, and analytics?
Signup and view all the answers
What type of device converts an electrical signal into a physical quantity?
Signup and view all the answers
What is the primary function of a customer edge device?
Signup and view all the answers
What is the primary function of a mobile edge computer?
Signup and view all the answers
Which stakeholder in the IoT ecosystem produces applications that process available data to produce actionable insights?
Signup and view all the answers
What is edge processing?
Signup and view all the answers
What is the primary function of an access network?
Signup and view all the answers
What is a centralized IoT platform?
Signup and view all the answers
Which wave of IoT development focuses on hardware-related breakthroughs?
Signup and view all the answers
What is the primary function of an actuator in IoT?
Signup and view all the answers
Which stakeholder in the IoT ecosystem provides storage and computing infrastructure?
Signup and view all the answers
What is the primary function of edge processing in IoT?
Signup and view all the answers
Which type of device receives data from and sends commands to IoT devices?
Signup and view all the answers
What is the primary function of a mobile edge computer in IoT?
Signup and view all the answers
Which type of IoT platform provides powerful central storage and processing capability for IoT use cases?
Signup and view all the answers
What is the primary function of an access network in IoT?
Signup and view all the answers
What does the IoT Runtime Environment provide beyond the container management level?
Signup and view all the answers
What is Node-RED?
Signup and view all the answers
What is the primary function of the Information Broker module?
Signup and view all the answers
What is the purpose of the Protocol Adapter module?
Signup and view all the answers
What is the primary function of the Rules Engine module?
Signup and view all the answers
What is the primary function of the Management and Security module?
Signup and view all the answers
What is the primary function of the Use Case Specific module?
Signup and view all the answers
What is the primary function of the Information Provider module?
Signup and view all the answers
What is the primary goal of Stream Analytics in the radio frequency electromagnetic spectrum?
Signup and view all the answers
Which stream processing system is suitable for streaming data and does not enforce a relational view?
Signup and view all the answers
What is the primary purpose of the Spectrum Streamer?
Signup and view all the answers
What is the primary benefit of Lambda architecture?
Signup and view all the answers
Which organization is focused on promoting open standards and interoperability for industrial IoT systems?
Signup and view all the answers
What is the primary purpose of real-time notifications in Stream Analytics?
Signup and view all the answers
What is the primary application of Stream Analytics?
Signup and view all the answers
Which architecture is suitable for processing data exclusively as streams?
Signup and view all the answers
What is the primary purpose of stream processing?
Signup and view all the answers
What is the main goal of dimensionality reduction techniques?
Signup and view all the answers
What is the primary purpose of summarization in stream processing?
Signup and view all the answers
What is the primary purpose of compression in stream processing?
Signup and view all the answers
What is the primary purpose of visualization in stream processing?
Signup and view all the answers
Which of the following is a characteristic of stream processing architectures?
Signup and view all the answers
What is the primary benefit of learning and mining in stream processing?
Signup and view all the answers
What is the primary purpose of batch processing?
Signup and view all the answers
What is the primary function of an EHR?
Signup and view all the answers
What is the purpose of a Laboratory Information System (LIS)?
Signup and view all the answers
What is the primary function of a vMCM?
Signup and view all the answers
What is the primary purpose of a vBCP?
Signup and view all the answers
What is the primary function of a vAAA?
Signup and view all the answers
What is the primary purpose of NoSQL?
Signup and view all the answers
What is the primary function of an AMI?
Signup and view all the answers
What is the primary function of a vSON?
Signup and view all the answers
What is the primary purpose of Spectrum Streamer?
Signup and view all the answers
Which organization is focused on promoting open standards and interoperability for industrial IoT systems?
Signup and view all the answers
What is the primary advantage of Stream Analytics in IoT systems?
Signup and view all the answers
Which type of data processing accumulates new data into disjunctive groups and processes them later?
Signup and view all the answers
What is the primary purpose of real-time notifications in Stream Analytics?
Signup and view all the answers
What is the primary function of statistical reporting in Stream Analytics?
Signup and view all the answers
Which architecture combines both stream and batch functionalities?
Signup and view all the answers
Which wave of IoT development focuses on new sensors and materials as well as communication technologies and protocols?
Signup and view all the answers
What is the primary function of an actuator in IoT?
Signup and view all the answers
Which stakeholder in the IoT ecosystem produces applications that process available data to produce actionable insights?
Signup and view all the answers
What is edge processing in IoT?
Signup and view all the answers
What is the primary function of an access network in IoT?
Signup and view all the answers
Which type of device receives data from and sends commands to IoT devices?
Signup and view all the answers
What is the primary function of a mobile edge computer in IoT?
Signup and view all the answers
Which type of IoT platform provides powerful central storage and processing capability for IoT use cases?
Signup and view all the answers
What does the IoT Runtime Environment provide beyond the container management level?
Signup and view all the answers
What is Node-RED?
Signup and view all the answers
What is the primary purpose of summarization in stream processing?
Signup and view all the answers
What is the purpose of a protocol adapter in IoT?
Signup and view all the answers
What is dimensionality reduction?
Signup and view all the answers
What is the function of an information broker in IoT?
Signup and view all the answers
What is the purpose of a Rules Engine in IoT?
Signup and view all the answers
What is the primary purpose of compression in stream processing?
Signup and view all the answers
What is the function of an information provider in IoT?
Signup and view all the answers
What is the primary purpose of learning and mining in stream processing?
Signup and view all the answers
What is the primary function of the Management and Security module in IoT?
Signup and view all the answers
What is visualization in stream processing?
Signup and view all the answers
What is the purpose of a Secure Runtime Environment in IoT?
Signup and view all the answers
What is batch processing in stream analytics?
Signup and view all the answers
What is stream processing in stream analytics?
Signup and view all the answers
What are the five main operations performed on streaming data?
Signup and view all the answers
What is the primary function of vBCP in IoT?
Signup and view all the answers
What is the function of vAAA?
Signup and view all the answers
What is the purpose of vMCM?
Signup and view all the answers
What is NoSQL?
Signup and view all the answers
What is the purpose of LIS?
Signup and view all the answers
What is an EHR?
Signup and view all the answers
What is AMI?
Signup and view all the answers
What is the primary function of vSON?
Signup and view all the answers
Match the following IoT data types with their descriptions:
Signup and view all the answers
Match the following IoT concepts with their primary goals:
Signup and view all the answers
Match the following IoT standards with their descriptions:
Signup and view all the answers
Match the following IoT roles with their descriptions:
Signup and view all the answers
Match the following IoT data formats with their descriptions:
Signup and view all the answers
Match the following IoT data aspects with their descriptions:
Signup and view all the answers
Match the following IoT platforms with their primary functions:
Signup and view all the answers
Match the following IoT data processing concepts with their primary goals:
Signup and view all the answers
Match the following stream processing architectures with their characteristics:
Signup and view all the answers
Match the following stream analytics applications with their purposes:
Signup and view all the answers
Match the following organizations with their focuses:
Signup and view all the answers
Match the following stream processing concepts with their definitions:
Signup and view all the answers
Match the following stream processing systems with their characteristics:
Signup and view all the answers
Match the following stream analytics concepts with their purposes:
Signup and view all the answers
Match the following stream processing architectures with their advantages:
Signup and view all the answers
Match the following stream analytics applications with their benefits:
Signup and view all the answers
Match the IoT ecosystem stakeholders with their roles:
Signup and view all the answers
Match the IoT development waves with their focus areas:
Signup and view all the answers
Match the IoT devices with their functions:
Signup and view all the answers
Match the IoT network components with their functions:
Signup and view all the answers
Match the IoT concepts with their descriptions:
Signup and view all the answers
Match the IoT stakeholders with their roles:
Signup and view all the answers
Match the IoT devices with their functions:
Signup and view all the answers
Match the IoT development waves with their focus areas:
Signup and view all the answers
Match the following concepts with their definitions:
Signup and view all the answers
Match the following stream processing architectures with their characteristics:
Signup and view all the answers
Match the following concepts with their purposes:
Signup and view all the answers
Match the following data compression techniques with their purposes:
Signup and view all the answers
Match the following stream analytics applications with their purposes:
Signup and view all the answers
Match the following dimensionality reduction methods with their purposes:
Signup and view all the answers
Match the following stream processing architectures with their advantages:
Signup and view all the answers
Match the following concepts with their advantages:
Signup and view all the answers
Match the following concepts with their descriptions:
Signup and view all the answers
Match the following terms with their meanings:
Signup and view all the answers
Match the following concepts with their features:
Signup and view all the answers
Match the following terms with their descriptions:
Signup and view all the answers
Match the following concepts with their benefits:
Signup and view all the answers
Match the following terms with their meanings:
Signup and view all the answers
Match the following concepts with their descriptions:
Signup and view all the answers
Match the following terms with their meanings:
Signup and view all the answers
A fixed sensor's location can be regarded as a ______ property of the sensor.
Signup and view all the answers
There are __ main operations performed on streaming data.
Signup and view all the answers
Compression reduces the occupied ______ for storing and/or the required bandwidth for transmitting.
Signup and view all the answers
Dimensionality reduction reduces the number of ______ under consideration.
Signup and view all the answers
Summarization transforms the data to provide to the human and machine ______ consumers a representation that best describes the time series under consideration.
Signup and view all the answers
Learning refers to methods that automate ______ building from recorded data.
Signup and view all the answers
Visualization methods transform the data into a ______ representation targeted at a human consumer.
Signup and view all the answers
Batch processing accumulates new data into disjunctive groups and processes them ______.
Signup and view all the answers
In the IoT ecosystem, the ______ produces applications that process available data to produce actionable insights.
Signup and view all the answers
The primary function of a ______ is to convert an electrical signal into a physical quantity.
Signup and view all the answers
The ______ wave of IoT development focuses on data management, processing, and analytics.
Signup and view all the answers
The primary function of ______ processing is to perform data aggregation, manipulation, bandwidth reduction, and other logic directly on an IoT sensor or device.
Signup and view all the answers
A ______ edge device receives data from and sends commands to IoT devices, and provides limited local storage, processing, and networking functions.
Signup and view all the answers
The primary function of a ______ is to reduce transmission cost and provide fast interactive response in the computation of off-loading resources, focused on data aggregation, data compression, and data transformation.
Signup and view all the answers
The ______ wave of IoT development focuses on hardware-related breakthroughs.
Signup and view all the answers
A ______ IoT platform provides powerful central storage and processing capability for IoT use cases, delivering important capabilities such as data interoperability and uniform data access, management functions.
Signup and view all the answers
There are two main types of stream data processing systems: one type based on existing relational database principles, and the second type more suitable for streaming data as they do not enforce a relational view and enable the creation of custom operators that consume and transform data streams and generate new data ______.
Signup and view all the answers
Stream analytics is important for sensing what is happening in the radio frequency electromagnetic spectrum, with relatively low-cost ______.
Signup and view all the answers
In Kappa architecture, the batch layer is not present, and all data are processed exclusively as ______.
Signup and view all the answers
Real-time notifications are detected transmissions that can be used to update spectrum occupancy databases or directly notify other devices that a transmission is happening in a certain ______.
Signup and view all the answers
Spectrum Streamer is a streaming architecture and an open-source library used to ingest time, frequency, and energy values of data in ______.
Signup and view all the answers
Statistical reporting references a report delivered by computational statistics of the detected events, primarily targeting human users for report ______.
Signup and view all the answers
Custom applications can be developed to subscribe to the output of the spectrum streamer for ______ generation.
Signup and view all the answers
Industrial Internet Consortium (IIC) is a nonprofit organization created for the promotion of open standards and interoperability for technologies used in industrial and machine-to-machine (M2M) ______.
Signup and view all the answers
The main purpose of the data access platform is to reduce the technical barriers faced by both providers and consumers of information in which they have a shared ______.
Signup and view all the answers
In the context of IoT data, ______ is a set of data that describes and presents information about other data.
Signup and view all the answers
The three main aspects of interoperability in the context of IoT data are ______, access control, and usage.
Signup and view all the answers
In the context of IoT data, a ______ is a key-value pair of data that is relational to the initial query of data from a sensor.
Signup and view all the answers
An ______ consumer wants to join the data revolution and build a new application that draws on multiple disparate sources of data.
Signup and view all the answers
HyperCat is a specification for representing and exposing IoT platform catalogues over Web technologies, using ______ and URI.
Signup and view all the answers
DCAT is a W3C recommendation aimed at facilitating interoperability between data catalogues, specifying a ______ description framework.
Signup and view all the answers
Sensor data is the initial value required for ______ to be gathered.
Signup and view all the answers
A _______________ is a decentralized database managed by multiple participants across multiple nodes.
Signup and view all the answers
The BSI _______________ is a recognizable symbol that can be combined with color coding and/or letters, numbers, etc., to indicate levels of trust, compliance, security, etc.
Signup and view all the answers
The California Consumer Privacy Act (CCPA) is a state statue intended to enhance privacy rights and consumer protection for residents of _______________.
Signup and view all the answers
The _______________ is a process used by the U.S. federal government to determine on a case-by-case basis how it should treat zero-day computer security and vulnerabilities.
Signup and view all the answers
Return on investment (RoI) is a performance measure used to evaluate the efficiency or profitability of an _______________.
Signup and view all the answers
A _______________ is a centralized function within an organization employing people, processes, and technology to continuously monitor and improve an organization's security posture while preventing, detecting, analyzing, and responding to cybersecurity incidents.
Signup and view all the answers
The Archetype Query Language (AQL) is a _______________ query language developed specifically for expressing queries used for searching and retrieving the data found in archetype-based repositories.
Signup and view all the answers
The benefits of blockchain include _______________, resilience, adaptability, fault tolerance, and security.
Signup and view all the answers
Study Notes
Streaming Data
- There are two main types of stream data processing systems: one based on existing relational database principles and another more suitable for streaming data.
- Flink is a second-generation stream processing system that utilizes automated scaling.
- Lambda architecture supports both stream and batch functionalities, providing accurate and up-to-date, near-real-time results.
- Kappa architecture does not have a batch layer, and all data are processed exclusively as streams.
- Stream analytics is important for sensing what is happening in the radio frequency electromagnetic spectrum with relatively low-cost sensors.
- Spectrum Streamer is a streaming architecture and an open-source library used to ingest time, frequency, and energy values of data in real-time.
- Real-time notifications are detected transmissions that can be used to update spectrum occupancy databases or directly notify other devices that a transmission is happening in a certain channel.
- Statistical reporting references a report delivered by computational statistics of the detected events, primarily targeting human users for report generation.
- Custom applications can be developed to subscribe to the output of the spectrum streamer for report generation.
Organizations
- Standards development organizations (SDOs) work to formulate health and safety standards.
- Industrial Internet Consortium (IIC) is a nonprofit organization created for the promotion of open standards and interoperability for technologies used in industrial and machine-to-machine (M2M) environments.
Processing Data
- Batch processing is a process that accumulates new data into disjunctive groups and processes them later.
- Stream processing is a process that handles each new piece of data at the time the data is being created, either individually or inside of a rolling window.
- Five main operations performed on streaming data: compression, dimensionality reduction, summarization, learning, and visualization.
- Compression reduces the occupied space for storing and/or the required bandwidth for transmitting data.
- Dimensionality reduction reduces the number of random variables (or dimensions) under consideration.
- Summarization transforms the data to provide a representation that best describes the time series under consideration.
- Learning and mining involve automating model building from recorded data and using models to extract insights and understand large datasets.
- Visualization transforms the data into a visual representation targeted at a human consumer.
Information Consumer
- An information consumer wants to join the data revolution and build a new application that draws on multiple disparate sources of data.
IoT Standards
- HyperCat is a specification for representing and exposing IoT platform catalogues over Web technologies.
- DCAT is a W3C recommendation aimed at facilitating interoperability between data catalogues.
Interoperability
- Three main aspects of interoperability: discovery, access control, and usage.
- Discovery involves identifying which aggregators contain information of interest and finding specific data sets.
- Access control involves facilities that allow information providers to retain control over access.
- Data access involves reducing technical barriers faced by both providers and consumers of information.
Types of Data
- Sensor data is the initial value required for metadata to be gathered.
- Metadata is a set of data that describes and presents information about other data.
- Dataset is a key-value pair of data that is relational to the initial query of data from a sensor.
IoT Evolution
- First Wave: Hardware related breakthrough that aimed to connect everyday objects to networks.
- Second Wave: Development of new sensors and materials as well as communication technologies and protocols.
- Third Wave: Data management processing and analytics as well as security, privacy, and trust.
IoT Ecosystem
- IoT ecosystem is a set of stakeholders that participate in the deployment of IoT technology and the relationship between them.
- Stakeholders include information providers, platform providers, application developers, and end users.
IoT Components
- Actuator: a device that converts an electrical signal into a corresponding physical quantity such as movement, force, or sound.
- Edge processing: a process of data aggregation, manipulation, bandwidth reduction, and other logic directly on an IoT sensor or device.
- Access network: part of the network concerned with moving data to and from a sensor or edge.
- Customer edge device: receives data from and sends commands to IoT devices, provides limited local storage, processing, and networking functions.
- Mobile edge computer: reduces transmission cost and provides fast interactive response in the computation of off-loading resources.
IoT Architecture
- Industrial Internet Reference Architecture (IIRA) is a standards-based architectural template and methodology that enables Industrial Internet of Things.
Security and Privacy
- BSI Kitemark is a recognizable symbol that indicates levels of trust, compliance, security, etc.
- California Consumer Privacy Act (CCPA) is a state statue intended to enhance privacy rights and consumer protection for residents of California in the United States.
- Vulnerabilities Equities Process (VEP) is a process used by the U.S. federal government to determine how it should treat zero-day computer security and vulnerabilities.
Blockchain
- Distributed Ledger Technology (DLT) is a decentralized database managed by multiple participants across multiple nodes.
- Permissionless DLTs allow any actor to become a node.
- Federated DLT is a permissioned DLT shared across more than one organization.
- Features of blockchains: decentralization, immutability, auditability, fault tolerance, and resilience.
- Benefits of blockchain: trust, resilience, adaptability, fault tolerance, security, and complete decentralization.
Streaming Data
- Two main types of stream data processing systems:
- First type based on existing relational database principles
- Second type suitable for streaming data, enables creation of custom operators and generation of new data streams
- Flink: second-generation stream processing system that utilizes automated scaling
- Lambda architecture: supports both stream and batch functionalities, provides accurate and up-to-date results
- Kappa architecture: batch layer is not present, and all data are processed exclusively as streams
Stream Analytics
- Important for sensing what is happening in the radio frequency electromagnetic spectrum, with relatively low-cost sensors
- Spectrum Streamer: streaming architecture and open-source library used to ingest time, frequency, and energy values of data in real-time
- Real-time notifications: detected transmissions that can be used to update spectrum occupancy databases or directly notify other devices
- Statistical reporting: report delivered by computational statistics of the detected events, targeting human users for report generation
- Custom applications: can be developed to subscribe to the output of the spectrum streamer for report generation
Organizations
- Standards development organizations (SDOs): work to formulate health and safety standards
- Industrial Internet Consortium (IIC): nonprofit organization created for the promotion of open standards and interoperability for technologies used in industrial and machine-to-machine (M2M) environments
IoT Concepts
- Journeys: represented as geospatial features (e.g., point, line, or polygon) with arbitrary associated properties described in metadata
- Geographical features: represented as geospatial features (e.g., point, line, or polygon) with arbitrary associated properties described in metadata
- Situations: includes an aggregation of sensor-based data and other data, as well as interpretation, relevant to a time and specified locations
Processing Data
- Batch processing: accumulates new data into disjunctive groups and processes them later, defined by criteria such as batch size or age
- Stream processing: handles each new piece of data at the time the data is being created, either individually or inside of a rolling window
- Five main operations performed on streaming data:
- Compression: reduces occupied space for storing and/or the required bandwidth for transmitting
- Dimensionality reduction: reduces the number of random variables (or dimensions) under consideration
- Summarization: transforms the data to provide a representation that best describes the time series under consideration
- Learning and mining: automated model building from recorded data and using models to extract insights and understand large datasets
- Visualization: transforms the data into a visual representation targeted at a human consumer
IoT Ecosystem
- IoT Ecosystem: a set of stakeholders that participate in the deployment of IoT technology and the relationship between them
- Stakeholders in IoT Ecosystems:
- Information Providers: owners of sensor deployments that may share information and data for the general good
- Platform Providers: provide storage and computing infrastructure as well as analytics services
- Application Developers: produce applications that process the available data within a specific context to produce actionable insight for end users
- End Users: use the information and applications that are made available by other stakeholders
IoT Concepts
- Actuator: device that converts an electrical signal into a corresponding physical quantity such as movement, force, or sound
- Edge processing: process of data aggregation, manipulation, bandwidth reduction, and other logic directly on an IoT sensor or device
- Access network: part of network which is concerned with moving data to and from a sensor or edge
- Customer edge device: receives data from and sends commands to IoT devices & provides limited local storage, processing, and networking functions
- Mobile edge computer: reduces transmission cost and provides fast interactive response in the computation of off-loading resources
- Centralized IoT platform: powerful central storage and processing capability for IoT use cases delivering important capabilities
- IoT Runtime Environment: provides additional functionality beyond the container management level that enables remote management of information flows between multiple IoT applications and external endpoints
- Device management: encompasses the areas of initial device configuration and on-going management
- Secure Runtime Environment: component represents a comprehensive collection of tools that reduce the attack space through measures such as identity access management (IAM), secure boot, device attestation, TPMs, and trusted execution environments (TEEs)
IoT Tools and Technologies
- NodeJS: JavaScript for servers
- Node-RED: flow-based development tool meant for IoT, built on NodeJS
- Protocol adapter: protocol specific module enabling the transformation of incoming sensor data or outgoing actuator commands to a common format
- Information broker: on-board storage module that allows storage of recently received data from sensors or from the cloud or other modules
- Rules Engine: module to route the incoming data from other modules based on predefined rules
- Use case specific: module that is produced by a developer to perform a specialist function
- Management and Security: module that allows registration of the IoT device to the system and manages modules and configuration, handles security features
Healthcare and Energy
- Electronic health record (EHR): the electronic, systematized collection of patient and population health information stored in a digital format that can be shared across different healthcare settings
- Laboratory information system (LIS): software-based solution with features that support a modern laboratory's operations
- NoSQL: provides a mechanism for storage and retrieval of data that is modeled in means other than the tabular relations
- Advanced metering infrastructure (AMI): integrated system of smart meters, communications networks, and data management systems that enable two-way communication between utilities and customers
- SM: smart meter
- IED: intelligent energy device
- PMU: phasor measurement unit
- VNF: virtual network function
- vMCM: virtual machine cloud machine function, offers digital twin services of the on-field physical assets
- vBCP: virtual blockchain processing function, gateway to blockchain infrastructures, allowing interaction of vBCP service-compliant devices with the blockchain
- vAAA: VNF delivering AAA, features two distinct service modes, namely blockchain-based and OAUTH2.0 service
- vMME: virtual mobility management entity responsible for registering devices to the network and advertising their presence on it
- vSON: virtual self-organizing networks enabling multihop and multiprotocol connectivity of IoT devices without direct access to 5g networking
- vTSD: virtual terminal service discovery responsible for effectively handling IoT devices services discovery
Streaming Data
- Two main types of stream data processing systems:
- First type based on existing relational database principles
- Second type suitable for streaming data, enables creation of custom operators and generation of new data streams
- Flink: second-generation stream processing system that utilizes automated scaling
- Lambda architecture: supports both stream and batch functionalities, provides accurate and up-to-date results
- Kappa architecture: batch layer is not present, and all data are processed exclusively as streams
Stream Analytics
- Important for sensing what is happening in the radio frequency electromagnetic spectrum, with relatively low-cost sensors
- Spectrum Streamer: streaming architecture and open-source library used to ingest time, frequency, and energy values of data in real-time
- Real-time notifications: detected transmissions that can be used to update spectrum occupancy databases or directly notify other devices
- Statistical reporting: report delivered by computational statistics of the detected events, targeting human users for report generation
- Custom applications: can be developed to subscribe to the output of the spectrum streamer for report generation
Organizations
- Standards development organizations (SDOs): work to formulate health and safety standards
- Industrial Internet Consortium (IIC): nonprofit organization created for the promotion of open standards and interoperability for technologies used in industrial and machine-to-machine (M2M) environments
IoT Concepts
- Journeys: represented as geospatial features (e.g., point, line, or polygon) with arbitrary associated properties described in metadata
- Geographical features: represented as geospatial features (e.g., point, line, or polygon) with arbitrary associated properties described in metadata
- Situations: includes an aggregation of sensor-based data and other data, as well as interpretation, relevant to a time and specified locations
Processing Data
- Batch processing: accumulates new data into disjunctive groups and processes them later, defined by criteria such as batch size or age
- Stream processing: handles each new piece of data at the time the data is being created, either individually or inside of a rolling window
- Five main operations performed on streaming data:
- Compression: reduces occupied space for storing and/or the required bandwidth for transmitting
- Dimensionality reduction: reduces the number of random variables (or dimensions) under consideration
- Summarization: transforms the data to provide a representation that best describes the time series under consideration
- Learning and mining: automated model building from recorded data and using models to extract insights and understand large datasets
- Visualization: transforms the data into a visual representation targeted at a human consumer
IoT Ecosystem
- IoT Ecosystem: a set of stakeholders that participate in the deployment of IoT technology and the relationship between them
- Stakeholders in IoT Ecosystems:
- Information Providers: owners of sensor deployments that may share information and data for the general good
- Platform Providers: provide storage and computing infrastructure as well as analytics services
- Application Developers: produce applications that process the available data within a specific context to produce actionable insight for end users
- End Users: use the information and applications that are made available by other stakeholders
IoT Concepts
- Actuator: device that converts an electrical signal into a corresponding physical quantity such as movement, force, or sound
- Edge processing: process of data aggregation, manipulation, bandwidth reduction, and other logic directly on an IoT sensor or device
- Access network: part of network which is concerned with moving data to and from a sensor or edge
- Customer edge device: receives data from and sends commands to IoT devices & provides limited local storage, processing, and networking functions
- Mobile edge computer: reduces transmission cost and provides fast interactive response in the computation of off-loading resources
- Centralized IoT platform: powerful central storage and processing capability for IoT use cases delivering important capabilities
- IoT Runtime Environment: provides additional functionality beyond the container management level that enables remote management of information flows between multiple IoT applications and external endpoints
- Device management: encompasses the areas of initial device configuration and on-going management
- Secure Runtime Environment: component represents a comprehensive collection of tools that reduce the attack space through measures such as identity access management (IAM), secure boot, device attestation, TPMs, and trusted execution environments (TEEs)
IoT Tools and Technologies
- NodeJS: JavaScript for servers
- Node-RED: flow-based development tool meant for IoT, built on NodeJS
- Protocol adapter: protocol specific module enabling the transformation of incoming sensor data or outgoing actuator commands to a common format
- Information broker: on-board storage module that allows storage of recently received data from sensors or from the cloud or other modules
- Rules Engine: module to route the incoming data from other modules based on predefined rules
- Use case specific: module that is produced by a developer to perform a specialist function
- Management and Security: module that allows registration of the IoT device to the system and manages modules and configuration, handles security features
Healthcare and Energy
- Electronic health record (EHR): the electronic, systematized collection of patient and population health information stored in a digital format that can be shared across different healthcare settings
- Laboratory information system (LIS): software-based solution with features that support a modern laboratory's operations
- NoSQL: provides a mechanism for storage and retrieval of data that is modeled in means other than the tabular relations
- Advanced metering infrastructure (AMI): integrated system of smart meters, communications networks, and data management systems that enable two-way communication between utilities and customers
- SM: smart meter
- IED: intelligent energy device
- PMU: phasor measurement unit
- VNF: virtual network function
- vMCM: virtual machine cloud machine function, offers digital twin services of the on-field physical assets
- vBCP: virtual blockchain processing function, gateway to blockchain infrastructures, allowing interaction of vBCP service-compliant devices with the blockchain
- vAAA: VNF delivering AAA, features two distinct service modes, namely blockchain-based and OAUTH2.0 service
- vMME: virtual mobility management entity responsible for registering devices to the network and advertising their presence on it
- vSON: virtual self-organizing networks enabling multihop and multiprotocol connectivity of IoT devices without direct access to 5g networking
- vTSD: virtual terminal service discovery responsible for effectively handling IoT devices services discovery
Streaming Data
- There are two main types of stream data processing systems: one based on existing relational database principles and another more suitable for streaming data.
- Flink is a second-generation stream processing system that utilizes automated scaling.
- Lambda architecture supports both stream and batch functionalities, providing accurate and up-to-date, near-real-time results.
- Kappa architecture does not have a batch layer, and all data are processed exclusively as streams.
- Stream analytics is important for sensing what is happening in the radio frequency electromagnetic spectrum with relatively low-cost sensors.
- Spectrum Streamer is a streaming architecture and an open-source library used to ingest time, frequency, and energy values of data in real-time.
- Real-time notifications are detected transmissions that can be used to update spectrum occupancy databases or directly notify other devices that a transmission is happening in a certain channel.
- Statistical reporting references a report delivered by computational statistics of the detected events, primarily targeting human users for report generation.
- Custom applications can be developed to subscribe to the output of the spectrum streamer for report generation.
Organizations
- Standards development organizations (SDOs) work to formulate health and safety standards.
- Industrial Internet Consortium (IIC) is a nonprofit organization created for the promotion of open standards and interoperability for technologies used in industrial and machine-to-machine (M2M) environments.
Processing Data
- Batch processing is a process that accumulates new data into disjunctive groups and processes them later.
- Stream processing is a process that handles each new piece of data at the time the data is being created, either individually or inside of a rolling window.
- Five main operations performed on streaming data: compression, dimensionality reduction, summarization, learning, and visualization.
- Compression reduces the occupied space for storing and/or the required bandwidth for transmitting data.
- Dimensionality reduction reduces the number of random variables (or dimensions) under consideration.
- Summarization transforms the data to provide a representation that best describes the time series under consideration.
- Learning and mining involve automating model building from recorded data and using models to extract insights and understand large datasets.
- Visualization transforms the data into a visual representation targeted at a human consumer.
Information Consumer
- An information consumer wants to join the data revolution and build a new application that draws on multiple disparate sources of data.
IoT Standards
- HyperCat is a specification for representing and exposing IoT platform catalogues over Web technologies.
- DCAT is a W3C recommendation aimed at facilitating interoperability between data catalogues.
Interoperability
- Three main aspects of interoperability: discovery, access control, and usage.
- Discovery involves identifying which aggregators contain information of interest and finding specific data sets.
- Access control involves facilities that allow information providers to retain control over access.
- Data access involves reducing technical barriers faced by both providers and consumers of information.
Types of Data
- Sensor data is the initial value required for metadata to be gathered.
- Metadata is a set of data that describes and presents information about other data.
- Dataset is a key-value pair of data that is relational to the initial query of data from a sensor.
IoT Evolution
- First Wave: Hardware related breakthrough that aimed to connect everyday objects to networks.
- Second Wave: Development of new sensors and materials as well as communication technologies and protocols.
- Third Wave: Data management processing and analytics as well as security, privacy, and trust.
IoT Ecosystem
- IoT ecosystem is a set of stakeholders that participate in the deployment of IoT technology and the relationship between them.
- Stakeholders include information providers, platform providers, application developers, and end users.
IoT Components
- Actuator: a device that converts an electrical signal into a corresponding physical quantity such as movement, force, or sound.
- Edge processing: a process of data aggregation, manipulation, bandwidth reduction, and other logic directly on an IoT sensor or device.
- Access network: part of the network concerned with moving data to and from a sensor or edge.
- Customer edge device: receives data from and sends commands to IoT devices, provides limited local storage, processing, and networking functions.
- Mobile edge computer: reduces transmission cost and provides fast interactive response in the computation of off-loading resources.
IoT Architecture
- Industrial Internet Reference Architecture (IIRA) is a standards-based architectural template and methodology that enables Industrial Internet of Things.
Security and Privacy
- BSI Kitemark is a recognizable symbol that indicates levels of trust, compliance, security, etc.
- California Consumer Privacy Act (CCPA) is a state statue intended to enhance privacy rights and consumer protection for residents of California in the United States.
- Vulnerabilities Equities Process (VEP) is a process used by the U.S. federal government to determine how it should treat zero-day computer security and vulnerabilities.
Blockchain
- Distributed Ledger Technology (DLT) is a decentralized database managed by multiple participants across multiple nodes.
- Permissionless DLTs allow any actor to become a node.
- Federated DLT is a permissioned DLT shared across more than one organization.
- Features of blockchains: decentralization, immutability, auditability, fault tolerance, and resilience.
- Benefits of blockchain: trust, resilience, adaptability, fault tolerance, security, and complete decentralization.
Streaming Data
- There are two main types of stream data processing systems: one based on existing relational database principles and another more suitable for streaming data.
- Flink is a second-generation stream processing system that utilizes automated scaling.
- Lambda architecture supports both stream and batch functionalities, providing accurate and up-to-date, near-real-time results.
- Kappa architecture does not have a batch layer, and all data are processed exclusively as streams.
- Stream analytics is important for sensing what is happening in the radio frequency electromagnetic spectrum with relatively low-cost sensors.
- Spectrum Streamer is a streaming architecture and an open-source library used to ingest time, frequency, and energy values of data in real-time.
- Real-time notifications are detected transmissions that can be used to update spectrum occupancy databases or directly notify other devices that a transmission is happening in a certain channel.
- Statistical reporting references a report delivered by computational statistics of the detected events, primarily targeting human users for report generation.
- Custom applications can be developed to subscribe to the output of the spectrum streamer for report generation.
Organizations
- Standards development organizations (SDOs) work to formulate health and safety standards.
- Industrial Internet Consortium (IIC) is a nonprofit organization created for the promotion of open standards and interoperability for technologies used in industrial and machine-to-machine (M2M) environments.
Processing Data
- Batch processing is a process that accumulates new data into disjunctive groups and processes them later.
- Stream processing is a process that handles each new piece of data at the time the data is being created, either individually or inside of a rolling window.
- Five main operations performed on streaming data: compression, dimensionality reduction, summarization, learning, and visualization.
- Compression reduces the occupied space for storing and/or the required bandwidth for transmitting data.
- Dimensionality reduction reduces the number of random variables (or dimensions) under consideration.
- Summarization transforms the data to provide a representation that best describes the time series under consideration.
- Learning and mining involve automating model building from recorded data and using models to extract insights and understand large datasets.
- Visualization transforms the data into a visual representation targeted at a human consumer.
Information Consumer
- An information consumer wants to join the data revolution and build a new application that draws on multiple disparate sources of data.
IoT Standards
- HyperCat is a specification for representing and exposing IoT platform catalogues over Web technologies.
- DCAT is a W3C recommendation aimed at facilitating interoperability between data catalogues.
Interoperability
- Three main aspects of interoperability: discovery, access control, and usage.
- Discovery involves identifying which aggregators contain information of interest and finding specific data sets.
- Access control involves facilities that allow information providers to retain control over access.
- Data access involves reducing technical barriers faced by both providers and consumers of information.
Types of Data
- Sensor data is the initial value required for metadata to be gathered.
- Metadata is a set of data that describes and presents information about other data.
- Dataset is a key-value pair of data that is relational to the initial query of data from a sensor.
IoT Evolution
- First Wave: Hardware related breakthrough that aimed to connect everyday objects to networks.
- Second Wave: Development of new sensors and materials as well as communication technologies and protocols.
- Third Wave: Data management processing and analytics as well as security, privacy, and trust.
IoT Ecosystem
- IoT ecosystem is a set of stakeholders that participate in the deployment of IoT technology and the relationship between them.
- Stakeholders include information providers, platform providers, application developers, and end users.
IoT Components
- Actuator: a device that converts an electrical signal into a corresponding physical quantity such as movement, force, or sound.
- Edge processing: a process of data aggregation, manipulation, bandwidth reduction, and other logic directly on an IoT sensor or device.
- Access network: part of the network concerned with moving data to and from a sensor or edge.
- Customer edge device: receives data from and sends commands to IoT devices, provides limited local storage, processing, and networking functions.
- Mobile edge computer: reduces transmission cost and provides fast interactive response in the computation of off-loading resources.
IoT Architecture
- Industrial Internet Reference Architecture (IIRA) is a standards-based architectural template and methodology that enables Industrial Internet of Things.
Security and Privacy
- BSI Kitemark is a recognizable symbol that indicates levels of trust, compliance, security, etc.
- California Consumer Privacy Act (CCPA) is a state statue intended to enhance privacy rights and consumer protection for residents of California in the United States.
- Vulnerabilities Equities Process (VEP) is a process used by the U.S. federal government to determine how it should treat zero-day computer security and vulnerabilities.
Blockchain
- Distributed Ledger Technology (DLT) is a decentralized database managed by multiple participants across multiple nodes.
- Permissionless DLTs allow any actor to become a node.
- Federated DLT is a permissioned DLT shared across more than one organization.
- Features of blockchains: decentralization, immutability, auditability, fault tolerance, and resilience.
- Benefits of blockchain: trust, resilience, adaptability, fault tolerance, security, and complete decentralization.
Studying That Suits You
Use AI to generate personalized quizzes and flashcards to suit your learning preferences.
Description
Learn about the two main types of stream data processing systems, including Flink and Lambda architecture, which support both stream and batch functionalities.