SIT Internal Systems Engineering Fundamentals (AY 2024 TRI2) PDF

SIT Internal SEM4607 System Integration, Verification & Validation Topic 02 Systems Engineering Process Fundamentals AY 2024/25 TRI 2 Assoc Pro...

SIT Internal SEM4607 System Integration, Verification & Validation Topic 02 Systems Engineering Process Fundamentals AY 2024/25 TRI 2 Assoc Prof Ng Bor Kiat [email protected] 1 SIT Internal  SIT Internal Systems Integration, Verification and Validation Module Outline Topic #1 1. Systems Engineering Overview Topic #2 Topic #5 5. Industry Application Sharing 2. Systems Engineering Process Fundamentals Topic #4 Requirements 4. Verification & Validation Topic #3 Architecture 3. Systems Integration Specifications [Source: https://en.wikipedia.org/wiki/V‐Model] V‐Model System Development Process 3 Learning Activities SEM4607 Systems Integration, Verification & Validation: AY 2024-25 TRI 2 Lecture Tutorial Week (Monday 9‐12pm, (Thursday 9‐11am, Lecture Tutorial Assessment Due LT2C) SR3M) 1 06.01.2025 09.01.2025 Topic 1 Topic 1 2 13.01.2025 16.01.2025 Topic 02 Project Activity 3 20.01.2025 23.01.2025 Topic 02 Project Activity 4 27.01.2025 30.01.2025 Topic 03 - PH – No Class 5 03.02.2025 05.02.2025 Topic 03 / Project Activity (Wed 2pm to 4pm) Recap Make-Up Class 06.02.2025 Project Activity Quiz #1 6 10.02.2025 13.02.2025 Topic 04 Project Activity 7 Term Break (17.02.2025 to 23.02.2025) 8 24.02.2025 27.02.2025 Topic 04 Project Status Update Submit Assignment #1 Presentation 9 03.03.2025 06.04.2025 Topic 04 Project Activity 10 10.03.2025 13.03.2025 Topic 04 Project Activity 11 17.03.2025 20.03.2025 Topic 05: Guest Guest 01: Case Study Review 01 12 24.03.2025 27.03.2025 Topic 05:Guest Guest 02: Case Study Review Submit Assignment #2 02 13 31.03.2025 02.04.2025 - Case Study Review 7 PH - No Class (Wed 2pm to 4pm) Make-Up Class 03.04.2025 - Module Debrief 14 07.04.2025 Exam Week Submit Assignment #3 4  SIT Internal SEM 4607 Contents Topic Contents 1 Systems Engineering Overview 2 Systems Engineering Process Fundamentals 3 Systems Implementation & Integration 4 Systems Verification & Validation 5 Industry Applications Sharing 6 5  SIT Internal System Life Cycle Stages 6  SIT Internal Objective of INCOSE International Council on Systems Engineering Handbook SYSTEMS ENGINEERING HANDBOOK SEH: A GUIDE FOR SYSTEM LIFE CYCLE PROCESSES AND ACTIVITIES To describe key process activities performed by Systems Engineers. Descriptions in SEH: Show what each SE process activity entails in the context of designing for required performance and life cycle considerations. FOUR T H E D I T I O N Source: Systems Engineering Handbook INCOSE –TP- 2003-002-04(2015)  SIT Internal INCOSE Systems Engineering Handbook (SEH) Chapter 1. Systems Engineering Handbook Scope 2. Systems Engineering Overview 3. Generic Life Cycle Stages 4. Technical processes 5. Technical Management Processes 6. Agreement Processes 7. Organisational Project-enabling Processes 8. Tailoring Process and Application of Systems Engineering 9. Cross-cutting Systems Engineering Methods 10. Specialty Engineering Activities  SIT Internal Systems Life Cycle Stages: ISO/IEC 15288 Five stages used in the ISO/IEC 15288: 1. Concept 2. Development IV&V ? 3. Production 4. Utilization 5. Support 6. Retirement Need to understand the purpose for each of these stages and its link to the IV&V activities and processes. 9  SIT Internal Systems Integration, Verification and Validation Module Outline Topic #1 1. Systems Engineering Overview Topic #2 Topic #5 5. Industry Application Sharing 2. Systems Engineering Process Fundamentals Topic #4 Requirements 4. Verification & Validation Topic #3 Architecture 3. Systems Integration Specifications [Source: https://en.wikipedia.org/wiki/V‐Model] V‐Model System Development Process 10  SIT Internal Outline: Topic #2 Systems Engineering Technical Process Requirement Statement Systems Design / Architecture Requirement Allocation Requirement Traceability 11  SIT Internal Systems Engineering Handbook Chapter 1. Systems Engineering Handbook Scope 2. Systems Engineering Overview 3. Generic Life Cycle Stages 4. Technical Processes 5. Technical Management Processes 6. Agreement processes 7. Organisational Project-enabling Processes 8. Tailoring Process and Application of Systems Engineering 9. Cross-cutting Systems Engineering Methods 10. Specialty Engineering Activities SIT Internal  SIT Internal By connecting to Choa Chu Kang and Boon Lay MRT Stations on the North-South and East-West Lines, commuters travelling from the northern region of Singapore will be able to access the Jurong region using the JRL, without going through the heavily-used Jurong East MRT Station. 14  SIT Internal SIT Internal RTS IV&V and Testing 15  SIT Internal Technical processes SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal  SIT Internal Technical processes SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal  SIT Internal Description (3) – (Integration) SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal 53  SIT Internal Contents Overview [4.9.1] – Purpose [4.9.1.1] – Content/Description [4.9.1.2] – Inputs/Outputs [4.9.1.3] – Process Activities [4.9.1.4] Elaboration [4.9.2] – Notion of Verification Action [4.9.2.1] – Verification Techniques [4.9.2.2] – Integration, Verification, and Validation of the System [4.9.2.3] – Verification Level per Level [4.9.2.4] 54  SIT Internal Purpose [ISO/IEC/IEEE 15288] [6.4.9.1] The purpose of the Verification process is to provide objective evidence that a system or system element fulfils its specified requirements and characteristics. 55  SIT Internal Description (1) (Verification) this process is an instance of a verification process appliedto a SOI, or any system or system element that compose it, to establish that it has been “built right” can be applied to any engineering element that has contributed to the definition and realization of the system itself – e.g., verification of a system requirement, a function, an input/output flow, a system element, an interface, a design property, a verification procedure 56  SIT Internal Description (2) (Verification) verification is a transverse activity to every life cycle stageof the system in particular during the development of the system, verification applies onto any activity and product resulting from the activity 57  SIT Internal Elaboration Elaboration [4.9.2] – Notion of Verification Action [4.9.2.1] – Verification Techniques [4.9.2.2] – Integration, Verification, and Validation of the System [4.9.2.3] – Verification Level per Level [4.9.2.4] 58  SIT Internal Notion of Verification Action (1) a verification action describes – what must be verified e.g., a requirement, a characteristic, or a property as reference – on which item e.g., requirement, function, interface, system element, system) – the expected result (deduced from the reference) – the verification technique to apply e.g., inspection, analysis, demonstration, test – on which level of decomposition of the system e.g., SOI, intermediate level system element, leaf level system element 59  SIT Internal Notion of Verification Action (2) the definition of a verification action applied to an engineering item (e.g., stakeholder requirement, system requirement, function, interface, system element, procedure, and document) includes: – the identification of the item on which the verification action will be performed – the reference used to define the expected result – the appropriate verification technique 60  SIT Internal Notion of Verification Action (3) the performance of a verification action onto the submitted item provides an obtained result which is compared withthe expected result the comparison enables the correctness of the item to be determined (see Fig. 4.14) 61  SIT Internal Notion of Verification Action (4) 62  SIT Internal Notion of Verification Action (4) Examples of Verification Actions (1): – Verification of a Stakeholder Requirement or a SystemRequirement to check the application of syntactic and grammatical rules and characteristics defined in the Stakeholder Needs and Requirements Definition process and the System Requirements Definition process such as necessity, implementation‐free, unambiguous, consistent, complete, singular, feasible, traceable, and verifiable – Verification of the Architecture of a System to check the correct application of the appropriate patterns and heuristics used and the correct usage of modeling techniques or methods – Verification of the Design of a SystemElement to check the correct usage of patterns, trade rules, or state of the art related to the concerned technology (e.g., software, mechanics, electronics, chemistry) 63  SIT Internal Examples of Verification Actions (2): – Verification of a System (product, service, or enterprise) or System Element to check its realized characteristics or properties (e.g., as measured) against its specified requirements, expected architectural characteristics, and design properties (as described in the requirements, architecture, and design documents) 64  SIT Internal Notion of Verification Action (5) Considerations in selecting a verification approach include – practical limitations of accuracy, – uncertainty, – repeatability that are imposed by the verification enablers, – the associated measurement methods, – the availability, accessibility, and interconnection with the enablers 65  SIT Internal Verification Techniques: Inspection based on visual or dimensional examination of an element; – relies on the human senses or – uses simple methods of measurement and handling is generally non‐destructive and typically includes the use of – sight, hearing, smell, touch, and taste; – simple physical manipulation; – mechanical and electrical gauging; and – measurement no stimuli (tests) are necessary technique is used to check properties best determined by observation (e.g., paint color, weight, documentation, listing of code) peer reviews of process artifacts are also considered a type of inspection 66  SIT Internal Verification Techniques: Analysis is based on analytical evidence obtained without any intervention on the submitted element using: – mathematical or probabilistic calculation, – logical reasoning (including the theory of predicates), – modeling, and/or simulation under defined conditions to show theoretical compliance mainly used where testing to realistic conditions cannot be achieved or is not cost‐effective 67  SIT Internal Verification Techniques: Demonstration is used to show correct operation of the submitted element against operational and observable characteristics without using physical measurements (no or minimal instrumentation or test equipment) uses generally a set of actions selected to show that the element response to stimuli is suitable or to show that operators can perform their assigned tasks when usingthe element observations are made and compared with pre‐ determined/expected responses 68  SIT Internal Verification Techniques: Test technique is performed onto the submitted element by which functional, measurable characteristics, operability, supportability, or performance capability is quantitatively verified when subjected to controlled conditions that are real or simulated testing often uses special test equipment or instrumentation to obtain accurate quantitative data to be analyzed 69  SIT Internal Verification Techniques: Analogy or Similarity technique (often considered as a type of analysis technique) is based on evidence of similar elements to the submitted element or on experience feedback it is absolutely necessary to show by prediction that the context is invariant and that the outcomes are transposable – e.g., models, investigations, experience feedback analogy or similarity can only be used if: – the submitted element is similar in design, manufacture, anduse; – equivalent or more stringent verification actions were used for the similar element; – the intended operational environment is identical to or less rigorousthan the similar element 70  SIT Internal Verification Techniques: Sampling technique is based on verification of characteristics using samples the number, tolerance, and other characteristics must be specified and be in agreement with the experience feedback Note: – For techniques that do not include stimuli of the system element, no characteristics (exogenous attributes) can be observed only properties (endogenous attributes). 71  SIT Internal Integration, Verification, & Validation of the System in most of the cases, it is more appropriate to begin verification activities during development and to continue them into deployment and use – verification does not always occurs after integration and before validation once system elements have been realized, their integrationto form the whole system is performed – integration assembles developed capabilities (via system elements) in preparation for verification actions as stated in the integration process 72  SIT Internal Verification Level per Level (1) generally, the SOI has a number of layers of systems (made up of system elements at the next lower level) every system and system element is verified, and any findings possibly corrected before being integrated into the system of the higher level, as shown in Figure 4.15 every time the term verify is used means that the corresponding verification process is invoked 73  SIT Internal Verification Level per Level (2) 74  SIT Internal Verification Level per Level (3) as necessary, systems and system elements are partially integrated in subsets (aggregates) in order to limit the number of properties to be verified within a single step for each level, it is necessary to make sure by a set of verification actions that features stated at preceding level are not adversely affected a compliant result obtained in a given environment can turn noncompliant if the environment changes as long as the system is not completely integrated and/or doesn’t 75  SIT Internal References INCOSE Systems Engineering Handbook: A Guide for System Life Cycle Processes and Activities, Fourth Edition. Edited by David D. Walden, Garry J. Roedler, Kevin J. Forsberg, R. Douglas Hamelin and Thomas M. Shortell. © 2015 John Wiley & Sons, Inc. Published 2015 by John Wiley & Sons, Inc. reference section of SEH 76  SIT Internal Technical processes SIT Internal 78 SIT Internal SIT Internal SIT Internal  SIT Internal Description (Transition) SIT Internal  SIT Internal Technical processes SIT Internal SIT Internal SIT Internal  SIT Internal Description (2) (Validation) SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal  SIT Internal Technical processes SIT Internal SIT Internal SIT Internal  SIT Internal Description (2) (Operation) SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal  SIT Internal Technical processes SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal  SIT Internal recommended details that should be considered in a maintenance concept document (2): –Levels of Maintenance/Repair (1) User/Operator Maintenance –some routine and simple maintenance tasks are able to – be performed by the system operators or users –operator maintenance includes routine (e.g., filter changes, recording data) and corrective (e.g., “software” resets, install a ready spare, tire change) tasks In Situ Maintenance and Repair (sometimes referred to as “field” maintenance) –maintenance tasks performed by a trained maintainer at, or near, the operational location SIT Internal SIT Internal SIT Internal SIT Internal  SIT Internal Maintenance Enabling Systems the maintenance process includes other enabling systems that need to be considered that can be different from other processes (4): –Facilities and Infrastructure facilities (e.g., buildings, warehouses, hangars, waterways) and infrastructure (e.g., IT services, fuel, water, electrical service, machine shops, dry docks, test ranges) required for system maintenance –Tools and Support Equipment common and special purpose tools (e.g., hand tools, meters) and support equipment (e.g., test sets, cranes) used to support system maintenance SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal SIT Internal 146  SIT Internal Contents Overview [4.14.1] – Purpose [4.14.1.1] – Description [4.14.1.2] – Inputs/Outputs [4.14.1.3] – Process Activities [4.14.1.4] 147  SIT Internal Purpose [ISO/IEC/IEEE 15288] [6.4.14.1] The purpose of the Disposal process is to end the existence of a system element or system for a specified intended use, appropriately handle replaced or retired elements, and to properly attend to identified critical disposal needs. The disposal process is conducted in accordance with applicable guidance, policy, regulations, and statutes throughout the system life cycle. 148  SIT Internal Description (Disposal) disposal is a life cycle support process because concurrent consideration of disposal during the development stage generates requirements and constraints that must be balanced with defined stakeholders’ requirements and other design considerations environmental concerns drive the designer to consider reclaiming the materials or recycling them into new systems this process can be applied for the incremental disposal requirements at any point in the life cycle – e.g.: prototypes that are not to be reused or evolved, waste materials during manufacturing, or parts that are replaced during maintenance 4 149  SIT Internal References INCOSE Systems Engineering Handbook: A Guide for System Life Cycle Processes and Activities, Fourth Edition. Edited by David D. Walden, Garry J. Roedler, Kevin J. Forsberg, R. Douglas Hamelin and Thomas M. Shortell. © 2015 John Wiley & Sons, Inc. Published 2015 by John Wiley & Sons, Inc. reference section of SEH 150