Data Processing Lecture Notes PDF
Document Details
Uploaded by EventfulQuantum
null
Tags
Related
- Lecture #6.1 - Data Processing - Apache Spark Graph API.pdf
- Big Data Processing and Analysis Lecture Notes PDF
- Scientific Research Methods and Statistical Application (June 2024) PDF
- Scientific Research Methods and Statistical Application (June 2024) PDF
- APznzaY4g_-WovsJOsJwnHQAMnDI5Wo_ilhmzJtVLh2Sa-Xf9gJ_gNuoSOrxo7DqD3u2qUA0OuW2x8k8cD1ho301ZByianD7VnvX4KJ-neiRIN_ZdUpsyNL1SYopHQ8dqWnsgG613DeeBPrjkZR-mqJYdKE9do6K5PH1iZ0LEdYph9gauaoLuYqt6b9Yi7lmSl5t.pdf
- Chapter 3 Study Designs, Area, Populations, Data Processing PDF
Summary
These lecture notes cover the data processing cycle, from data collection to storage. The document includes various stages in the cycle, such as collection, preparation, input, processing, and output, along with an explanation of different processing types. It also touches on the use of computers in data analysis.
Full Transcript
Data Processing 28/09/20 24 Data Processing Data in its raw form is not useful to any organization. Data processing is the method of collecting raw data and translating it into usable information. The Data Processing Operations A. Data Collection Methods of data collections 1. Observat...
Data Processing 28/09/20 24 Data Processing Data in its raw form is not useful to any organization. Data processing is the method of collecting raw data and translating it into usable information. The Data Processing Operations A. Data Collection Methods of data collections 1. Observation 2. Questionnaire 3. Interview 4. Surveys 5. Expérimental devices 3 1 Data Processing B. Data preparation (Validation) : Ensuring that supplied data is correct and relevant. A process of examining the collected raw data to detect errors and correct these when possible. C. Sorting Arranging the clean data in some sequence and/or in different sets. Here data is sorted on the basis of common characteristics which can either be: - descriptive or - numerical 3 2 Data Processing D. Input In this step, the sorted raw data is converted into machine readable form and fed into the processing unit. This can be in the form of data entry through a keyboard, scanner or any other input source. E. Processing (Analysisng data) Data can be analysed either manually or with the help of a computer I- Manual Data Analysis: This can be done if the number of data is very small. Manual data analysis is extremely time consuming. 3 3 Data Processing II- Data Analysis Using a Computer: If you want to analyse data using computer, you should be familiar with the appropriate program. In this area, knowledge of computer and statistics plays an important role. F. Data output/interpretation The output/interpretation stage is the stage at which data is finally usable to non-data scientists. It is translated, readable, and often in the form of graphs, videos, images, plain text, etc.). 3 4 Data Processing G. Storage The last step of the data processing cycle is storage, where data and metadata are stored for further use. This allows for quick access and retrieval of information whenever needed, and also allows it to be used as input in the next data processing cycle directly. Types of Data Processing There are different types of data processing based on the source of data and the steps taken by the processing unit to generate an output. 35 Types of Data Processing TYPE USES Data is collected and processed in batches. Used Batch Processing for large amounts of data. Real-time Data is processed within seconds when the input Processing is given. Used for small amounts of data. Eg: withdrawing money from ATM Online Processing Data is automatically fed into the CPU as soon as it becomes available. Used for continuous processing of data. Eg: barcode scanning Time-sharing Allocates computer resources and data in time slots to several users simultaneously.3 6