Lecture 10- Database Administrator and Database Applications.pptx

Chapter 4: Organizing and Storing Data Lecture 10: Database Administrator and Database Applications  OVERVIEW Principals Learning Outcomes 5.3 The number and type of Identify and discuss current database applications will database applicatio...

Chapter 4: Organizing and Storing Data Lecture 10: Database Administrator and Database Applications  OVERVIEW Principals Learning Outcomes 5.3 The number and type of Identify and discuss current database applications will database applications continue to evolve and yield real business benefits  Database Utilities » A data loading utility: – Which allows easy loading of data from the external format without writing programs. » A backup utility: – Which allows to make copies of the database periodically to help in cases of crashes and disasters. » Recovery utility: – Which allows to reconstruct the correct state of database from the backup and history of transactions. » Monitoring tools: – Which monitors the performance so that internal schema can be changed and database access can be optimized.  Functions of DBMS (1 of 2) » Data Definition: The DBMS provides functions to define the structure of the data in the application. – These include defining and modifying the record structure, – the type and size of fields – and the various constraints to be satisfied by the data in each field. » Data Manipulation: Once the data structure is defined, data needs to be inserted, modified or deleted. These functions which perform these operations are part of DBMS.  Functions of DBMS (2 of 2) » Data Security & Integrity: The DBMS contains modules which handle the security and integrity of data in the application. » Data Recovery and Concurrency: Recovery of the data after system failure and concurrent access of records by multiple users is also handled by DBMS. » Data Dictionary Maintenance: Maintaining the data dictionary which contains the data definition of the application is also one of the functions of DBMS. » Performance: Optimizing the performance of the queries is one of the important functions of DBMS.  Role of the Database Administrator » Typically there are three types of users for a DBMS: 1. The END User who uses the application. Ultimately he is the one who actually puts the data into the system into use in business. This user need not know anything about the organization of data in the physical level. 2. The Application Programmer who develops the application programs. He/She has more knowledge about the data and its structure. He/she can manipulate the data using his/her programs. He/she also need not have access and knowledge of the complete data in the system. 3. The Data base Administrator (DBA) who is like the super- user of the system.  Database Administration Role of the database administrator (DBA) is to plan, design, create, operate, secure, monitor, and maintain databases The DBA works with both users and programmers A data administrator is responsible for defining and implementing consistent principles for a variety of data issues, including setting data standards and data definitions; a nontechnical position  Database Administrator Role/Functions The role of DBA is very important and is defined by the following functions: Defining the schema: The DBA defines the schema which contains the structure of the data in the application. – The DBA determines what data needs to be present in the system and how this data has to be presented and organized. Liaising with users: The DBA needs to interact continuously with the users to understand the data in the system and its use. Defining Security & Integrity checks: The DBA finds about the access restrictions to be defined and defines security checks accordingly. – Data Integrity checks are defined by the DBA.  Database Administrator Role/Functions Defining Backup/Recovery Procedures: The DBA also defines procedures for backup and recovery. Defining backup procedure includes specifying – what data is to be backed up – the periodicity of taking backups – and also the medium and storage place to backup data. Monitoring performance: The DBA has to continuously monitor the performance of the queries and take the measures to optimize all the queries in the application.  Selecting a DBMS The DBA often selects the DBMS for an organization. The process begins by analyzing database needs and characteristics. The information needs of the organization affect the type of data that is collected and the type of DBMS that is used. Important characteristics of databases to consider – Database size – Database cost – Concurrent users – Performance – Integration: the ability to be integrated with other applications and database – Vendor  5.3 Database Applications Today’s database applications manipulate the content of a database to produce useful information Common manipulations are searching, filtering, synthesizing, and assimilating the data contained in a database using a number of database applications  Linking Databases to the Internet Linking databases to the Internet is important for many organizations and people Developing a seamless integration of traditional databases with the Internet is often called ‘Semantic Web’ – Allows people to access and manipulate a number of traditional databases at the same time through the Internet  Big Data Applications Much of the data that organizations store comes from their Transaction Processing Systems However firms are storing less well-structured data such as: photos, videos, data from customers, blogs, data from social networks and their own website, including the order in which people view their web pages – All this is often called Big Data-large amounts of unstructured data that are difficult or impossible to capture and analyze using traditional DBMSs. – Big Data can provide valuable insights to help organizations achieve their goals – It can reveal which potential customers are most likely to purchase which products. – It can identify where and where and when a customer tends to shop; it can even determine how much a customer would be willing to pay for a product.  Big Data Applications Special Big Data hardware and software tools have been developed to collect, store and analyze this type of data. – Apache Hadoop is an open source database that can manage large unstructured datasets in conjunction with relational. – Yahoo! For example uses Hadoop to analyze exabytes (millions of terabytes) of data.  Data Warehouses & Data Mining Data warehouse: database that collects business information from many sources in the enterprise, covering all aspects of the company’s processes, products, and customers.  Data Mining (1 OF 2) Data mining is the process of analyzing data to try to discover patterns and relationships within the data. Typically, a data warehouse is mined Like gold mining, data mining sifts through mountains of data to find a few nuggets of valuable information There are a number of data mining tools and techniques Association rules algorithms are used to find associations between items in the data. A question that an association rule algorithm might be used to answer is, if someone buys eggs, how likely is it that they will also buy cheese? This information could be used in a supermarket to lay out the goods in the best configuration.  Data Mining (2 of 2) Data mining is used extensively in marketing to: improve customer retention identify cross-selling opportunities manage marketing campaigns market, channel, and pricing analysis and customer segmentation analysis (especially one- to-one marketing) Data-mining tools help users find answers to questions they haven’t thought to ask Common Data-Mining Applications  Business Intelligence Business intelligence (BI): process of gathering enough of the right information in a timely manner and usable form and analyzing it to have a positive impact on business strategy, tactics, or operations – Turns data into useful information that is then distributed throughout an enterprise » Competitive intelligence is one aspect of BI and is limited to information about competitors and the ways that knowledge affects strategy, tactics and operations.  Other Types of Databases Distributed database – Database in which the data may be spread across several smaller databases connected via telecommunications devices – Gives corporations more flexibility in how databases are organized and used Replicated database – Database that holds a duplicate set of frequently used data Figure 5.12 The Use of a Distributed Database  Online Analytical Processing (OLAP) Software that allows users to explore data from a number of different perspectives. Online does not mean internet but that a query is made and answered immediately  Visual, Audio, and Other Database Systems Databases for storing images Databases for storing sound Virtual database systems: allow different databases to work together as a unified database system Other special-purpose database systems – Spatial data technology: stores and accesses data according to the locations it describes and permits spatial queries and analysis  Summary Relational Database: a collection of tables used to store data Primary Key: a field or set of fields in a record that is used to identify the record Database approach to data management: a pool of related data is shared by multiple application programs Database design: list of tables with primary and foreign keys identified  Summary Database Management System (DBMS): group of programs used as an interface between a database and application programs or a database and the user Role of the Database Administrator (DBA): plan, design, create, operate, secure, monitor, and maintain databases  Summary Data Warehouse: database that collects business information from all aspects of a company’s processes, products, and customers Data Mining: information-analysis tool for the automated discovery of patterns and relationships in a data warehouse