Beruflich Dokumente
Kultur Dokumente
CP1500 Revision Notes Concurrency Control: interleaving actions of different user programs can lead to inconsistency (eg: check is cleared while account balance is computed). DBMS ensures such problems dont arise; instead database appears to be a single-user system.
Structure of DBMS
note: A typical DBMS has a layered architecture. The figure does not show the concurrency control and recovery components. This is one of several possible architectures; each system has its own variations.
DB
Structure of DBMS
name
Employees supervisor subordinate
ssn Employees
Reports_To
ER Model Basics
A database schema in the ER Model can be represented pictorially using an ER diagrams. Entity: An entity is described (in DB) using a set of attributes Entity Set: All entities in an entity set have the same set of attributes (unless ISA hierarchy applies) Each entity set has a key. Each attribute has a domain.
ssn
Employees
Manages
Departments
Key Constraints
Consider Works_In: An employee can work in many departments; a dept can have many employees. In contrast, each dept has at most one manager, according to the key constraint on Manages.
1-to-1
1-to Many
Many-to-1
Many-to-Many
Participation Constraints
Does every department have a manager? If so, this is a participation constraint: the participation of Departments in Manages is said to be total (as opposed to partial). Every did value in Departments table must appear in a row of the Manages table (with a non-null ssn value!)
Works_In
since
Weak Entities
A weak entity can be identified uniquely name cost only by considering the primary key of ssn lot another (owner) entity. Owner entity set and weak entity set Policy Employees must participate in a one-to-many relationship set (one owner, many weak entities). Weak entity set must have total participation in this identifying relationship set.
pname age
Dependents
name
ssn
lot
Hourly_Emps
Contract_Emps
Aggregation
Used when we have to model a relationship involving entity sets and a relationship set. Aggregation: indicates that a relationship participates in another relationship set. Aggregation allows us to treat a relationship set as an entity set for purposes of participation in (other) relationships.
pid Projects
ssn
name
lot
Employees
Monitors
until
started_on pbudget
since did
Sponsors
ssn
name
lot Works_In3
did
Employees
Duration to from eg: Should Address be an attribute of Employees or an entity (connected by a relationship)? It depends upon the use we want to make of address information, and the semantics of the data: If we have several addresses per employee, address must be an entity (since attributes cannot be set-valued). If the structure (city, street, etc.) is important, (eg: we want to retrieve employees in a given city) then address must be modeled as an entity (since attribute values are atomic). Works_In2 does not allow an employee to work in a department for 2 periods. Similar to the problem of wanting to record several since dbudget addresses for an employee: we want to record several name dname values of the descriptive attributes for each instance of ssn lot did budget this relationship.
Employees Manages2 Departments dname budget Departments
Employees
Bad design
Employees Purchaser
Dependents
Beneficiary
Better design
policyid
Policies cost
Constraints
Entity Integrity Constraint: states that no primary key value can be null. This is because the primary key value is used to uniquely identify individual tuples. Entity constrains can be violated if the primary key of the new tuple is null. Referential Integrity Constraint: specified between two relations and is used to maintain the consistency among tuples of the two relations. Referential integrity can be violated if the value of any foreign key in refers to a tuple that does not exist in the referenced relation. Domain constraints can be violated if an attribute value is given that does not appear in the corresponding domain. Key constraints can be violated if a key value in the new tuple already exists in another tuples in the same relation.
Types of Sets
Subset: A set S2 is a subset of another set S1 if every element in S2 is in S1. S1 may have exactly the same elements as S2. Proper Subset: A set S2 is a proper subset of another set S1 if every element in S2 is in S1 and S1 has some elements, which are not in S2.
Key Information
Primary Key: A set of attributes that uniquely identify a particular entity (or relationship) Candidate Key: The primary key is the key selected by the DBA from among the group of candidate keys. Foreign Key: (a foreign key can refer to its own relation) Super key: A set of attributes that properly contains a key.
Employees
Policy
Dependents
Monitors
until
since did
Sponsors
name lot
did pid
Reports_To
Reports_To supervisor_ssn
subordinate_ssn
Employees
ssn
name
lot
since
ssn name lot Works_In2 did dname budget Departments
ssn
Employees
address
Locations capacity
Employees ssn
name login Jones jones@ cs Smith smith@ eecs Smith smith@ math
A major strength of the relational model: supports simple, powerful querying of data. Queries can be written intuitively, and the DBMS is responsible for efficient evaluation. The key: precise semantics for relational queries. Developed by IBM (system R) in the 1970s Need for a standard since it is used by many vendors: Standards: SQL-86, SQL-89 (minor revision), SQL-92 (major revision, current standard), SQL99 (major extensions) eg. Find all 18-year-old students: SELECT * FROM Student S WHERE S.age = 18 note: renaming for simplification eg. Find A grade enrolled students (multiple query relation): SELECT S.name, E.cid FROM Student S, Enrolled E WHERE S.sid = E.sid AND E.grade = A
Enrolled
sid cid grade
sid name Foreign key: Set of fields in one relation used to 53666 Carnatic101 C 53666 Jones refer to a tuple in another relation (note: must 53666 Reggae203 B 53688 Smith 53650 Topology112 A correspond to primary key of the second 53650 Smith 53666 History105 B relation). Like a logical pointer. eg. sid is a foreign key referring to Students: CREATE TABLE Enrolled (sid CHAR(20), cid CHAR(20), grade CHAR(2), PRIMARY KEY (sid,cid), FOREIGN KEY (sid) REFERENCES Students) note: Only students listed in the Students relation should be allowed to enroll for courses. If all foreign key constraints are enforced, referential integrity is achieved (ie no dangling references).
Students
Views
A view is just a relation, but we store a definition, rather than a set of tuples. (note: views can be dropped using DROP VIEW command) eg. CREATE VIEW YoungActiveStudent (name,grade) AS SELECT S.name, E.grade FROM Student S, Enrolled E WHERE S.sid=E.sid and S.age<21 note: Views can be used to present necessary information (a summary), while hiding details in underlying relation. Review of tables and equivalent SQL see chapter 3
Two mathematical QLs form the basis for real languages (eg. SQL), and for implementation: Relational Algebra: More operational, very useful for representing execution plans. Relational Calculus: Lets users describe what they want, rather than how to compute it. (Nonoperational, declarative.)
Preliminaries
A query is applied to relation instances, and the result of a query is also a relation instance. Schemas of input relations for a query are fixed (but query will run regardless of instance!) The schema for the result of a given query is also fixed! Determined by definition of query language constructs. Positional vs. named-field notation (note: both used in SQL): Positional notation easier for formal definitions, named-field notation more readable.
R1 sid
22 58
S1 sid
22 31 58
S2 sid
Relational Algebra
Basic operations: Selection () Selects a subset of rows from relation. Projection () Deletes unwanted columns from relation. Cross-product (X) Allows us to combine two relations. Set-difference () Tuples in reln. 1, but not in reln. 2. Union () Tuples in reln. 1 and in reln. 2. Additional operations: Intersection (), join (), division, renaming useful, not essential. Since each operation returns a relation, operations can be composed! (Algebra is closed.)
sname rating age 28 yuppy 9 35.0 31 lubberbid 8 day 55.5 R1 sid 44 guppy 5 35.0 22 101 10/10/96 58 rusty 10 35.0 58 103 11/12/96 22 31 58 sname rating age dustin 7 45.0 lubber 8 55.5 rusty 10 35.0 sname rating age yuppy 9 35.0 lubber 8 55.5 guppy 5 35.0 rusty 10 35.0
age 35.0 55.5
S1 sid
S2 sid
Projection
Deletes attributes that are not in projection list. Schema of result contains exactly the fields in the projection list, with the same names that they had in the (only) input relation. (note: duplicates are eliminated)
28 31 44 58
Selection
Selects rows that satisfy selection condition. (note: duplicates are eliminated) Schema of result identical to schema of (only) input relation. Result relation can be the input for another relational algebra operation (operator composition).
sname rating yuppy 9 rusty 10
age(S2)
10
22 31 58 44 28
7 8 10 5 9
S1 S2
sid sname rating age 31 lubber 8 55.5 58 rusty 10 35.0
Cross-Product
Each row of S1 is paired with each row of R1. Result schema has one field per field of S1 and R1, with field names `inherited if possible. note: Both S1 and R1 have a field called sid conflict
(sid) sname rating age (sid) bid day 22 dustin 22 dustin 31 lubber 31 lubber 58 rusty 58 rusty 7 7 8 8 10 10 45.0 45.0 55.5 55.5 35.0 35.0 22 58 22 58 22 58 101 10/ 10/ 96 103 11/ 12/ 96 101 10/ 10/ 96 103 11/ 12/ 96 101 10/ 10/ 96 103 11/ 12/ 96
S1 S2
sid sname rating age 22 dustin 7 45.0
S1 S2
R1 sid
22 58
S1 sid
Joins
(sid) sname rating age (sid) bid day 22 dustin 7 45.0 58 103 11/ 12/ 96 31 lubber 8 55.5 58 103 11/ 12/ 96
22 31 58
S2 sid
sname rating age dustin 7 45.0 lubber 8 55.5 rusty 10 35.0 sname rating age yuppy 9 35.0 lubber 8 55.5 guppy 5 35.0 rusty 10 35.0
S1
R1
Condition Join: (eg: RcS = c (RxS)) Result schema same as that of cross-product. Fewer tuples than cross-product, might be able to compute more efficiently Sometimes called a theta-join. Equi-Join: A special case of condition join where the condition c contains only equalities.
sid 22 58 sname rating age bid day dustin 7 45.0 101 10/ 10/ 96 rusty 10 35.0 103 11/ 12/ 96
28 31 44 58
S1
sid
R1
Result schema similar to cross-product, but only one copy of fields for which equality is specified. Natural Join: Equi-join on all common fields.
Division
sno pno pno p n o Not supported as a primitive operator, but useful for expressing p2 s1 p1 p 2 certain queries (eg. Find sailors who have reserved all boats) s1 p2 p4 Let A have 2 fields, x and y; B have only field y: B1 s1 p3 B2 ie. A/B contains all x tuples (sailors) such that for every y s1 p4 tuple (boat) in B, there is an xy tuple in A. sno s2 p1 s1 s2 p2 Or: If the set of y values (boats) associated with an x sno s3 p2 s2 value (sailor) in A contains all y values in B, the x value is s1 s3 s4 p2 in A/B. s4 s4 s4 p4 In general, x and y can be any lists of fields; y is the list of fields A/B1 A/B2 A in B, and x y is the list of fields of A. Division is not essential operator; just a useful shorthand (also true of joins, but joins are so common that systems implement joins specially) idea: For A/B, compute all x values that are not `disqualified by some y value in B. x value is disqualified if by attaching y value from B, we obtain an xy tuple that is not in A.
pno p1 p2 p4
B3
sno s1
A/B3
11
Query Examples
eg. Find names of sailors whove reserved boat #103 1: sname (( bid=103 Reserves) Sailors) 2: sname ( bid=103 (Reserves Sailors)) eg. Find names of sailors whove reserved a red boat note: Information about boat color only available in Boats; so need an extra join: 1: sname { sid ({ bid color=red Boats} Reserves) Sailors)} eg. Find sailors whove reserved a red or a green boat note: can identify all red or green boats, then find sailors whove reserved one of these boats: p (Tempboats, color=red v color = green Boats) sname (Tempboats Reserves Sailors) eg. Find sailors whove reserved a red and a green boat note: Previous approach wont work! Must identify sailors whove reserved red boats, sailors whove reserved green boats, then find the intersection: 1: p (Temp_red, sid (( color=red Boats) Reserves) p (Temp_green, sid (( color=green Boats) Reserves) sname ((Temp_red Temp_green) Sailors) eg. Find the names of sailors whove reserved all interlake boats note: Uses division; schemas of the input relations to must be carefully chosen: 1: p (Temp_sids, ( sid,bid Reserves) / ( bid ( btype=interlake Boats)) sname (Temp_sids Sailors)
Summary
The relational model has rigorously defined query languages that are simple and powerful. Relational algebra is more operational; useful as internal representation for query evaluation plans. Several ways of expressing a given query; a query optimizer should choose the most efficient version.
12
SELECT [DISTINCT] targe t-list Target-list: A list of attributes (fields) of relations in relation-list FROM re lation-list Relation-list: A list of relation names possibly with a range-variable (field WHERE qualification abbreviated as letter) after each name. Qualification: Comparisons (Attr op const or Attr1 op Attr2, where op is one of day R1 sid bid (<, >, , , =, ) combined using (AND, OR and NOT). 22 101 10/10/96 DISTINCT optional keyword indicating no duplicates. By default 58 103 11/12/96 duplicates are not eliminated!
S1 sid
22 31 58
S2 sid
sname rating age dustin 7 45.0 lubber 8 55.5 rusty 10 35.0 sname rating age yuppy 9 35.0 lubber 8 55.5 guppy 5 35.0 rusty 10 35.0
28 31 44 58
AS and = two ways to name/rename fields in results. LIKE used for string matching. _ stands for any one character. % for 0 characters. eg. SELECT S.sname, S.age AS yearsold FROM Sailors S WHERE S.sname LIKE Mc_% UNION used to compute the union of any two union-compatible sets of tuples (from SQL queries). eg. Find sids of sailors whove reserved a red or a green boat
1: (SELECT S.sid FROM Sailors S, Boats B, Reserves R WHERE S.sid=R.sid AND R.bid=B.bid AND 2: SELECT S.sid FROM Sailors S, Boats B, Reserves R WHERE S.sid=R.sid AND R.bid=B.bid AND (B.color=red OR
B.color=red)
UNION
(
SELECT S.sid FROM Sailors S, Boats B, Reserves R WHERE S.sid=R.sid AND R.bid=B.bid AND
B.color=green)
B.color=green) INTERSECT: Can be used to compute the intersection of any two union-compatible sets of tuples. Included in the SQL/92 standard, but some systems dont support it. Contrast symmetry of the UNION and INTERSECT queries with how much the other versions differ. eg. Find sids of sailors whove reserved a red and a green boat
1: SELECT S.sid FROM Sailors S, Boats B, Reserves R WHERE S.sid=R.sid AND R.bid=B.bid AND B.color=red INTERSECT SELECT S.sid FROM Sailors S, Boats B, Reserves R WHERE S.sid=R.sid AND R.bid=B.bid 2: SELECT S.sid FROM Sailors S, Boats B1, Reserves R1,
13
eg:
SELECT Tagnum, Comp_Id FROM PC WHERE EXISTS (SELECT * FROM Software S WHERE PC.Tagnum = S.Tagnum AND Pack_Id = A205)
Nested Queries
Powerful SQL feature: WHERE, FROM and HAVING clauses can contain their own queries. To understand semantics of nested queries, think of a nested loops evaluation (eg. For each sailors tuple, check the qualification by computing the subquery). eg. Find sailors who havent reserved #103. SELECT S.sname FROM Sailors S WHERE S.sid NOT IN (SELECT R.sid FROM Reserves R WHERE R.bid=103) eg: Find name and age of the oldest sailor(s) SELECT S.sname, S.age FROM Sailors S WHERE S.age = (SELECT MAX (S2.age) FROM Sailors S2)
Division in SQL
eg. Find sailors who have reserved all boats SELECT S.sname FROM Sailors S WHERE NOT EXISTS ((SELECT B.bid FROM Boats B)
EXCEPT
(SELECT R.bid
FROM Reserves R WHERE R.sid=S.sid))
Aggregate Operators
Significant extension of relational algebra. COUNT (*) COUNT ( [DISTINCT] A) SUM ( [DISTINCT] A) AVG ( [DISTINCT] A) MAX (A) MIN (A)
14
15
So far, weve applied aggregate operators to all (qualifying) tuples. Sometimes, we want to apply them to each of several groups of tuples. A group is a set of tuples that have the same value for all attributes in the grouping-list. eg: Find the maximum student percentile for each year with 10 students with 90 percentiles. SELECT S.year, MAX (S.percentile)=highest FROM Students S WHERE S.percentile >=90 GROUP BY S.year HAVING COUNT (*) >=10 note: The target-list contains attribute names and terms with aggregate operations (eg: MIN (S.age)). The attribute list must be a subset of grouping-list. Intuitively, each answer tuple corresponds to a group, and these attributes must have a single value per group.
Conceptual Evaluation
The cross-product of relation-list is computed, tuples that fail qualification are discarded, unnecessary fields are deleted, and the remaining tuples are partitioned into groups by the value of attributes in grouping-list. The group-qualification is then applied to eliminate some groups. (note: Expressions in groupqualification must have a single value per group) In effect, an attribute in group-qualification that is not an argument of an aggregate op also appears in grouping-list. (SQL does not exploit primary key semantics here!) One answer tuple is generated per qualifying group. eg: For each red boat, find the number of reservations SELECT B.bid, COUNT (*) AS no_reservations FROM Sailors S, Boats B, Reserves R WHERE S.sid=R.sid AND R.bid=B.bid AND B.color=red GROUP BY B.bid eg: Find those ratings for which the average age is the minimum over all ratings SELECT Temp.rating, Temp.avg_age FROM (SELECT S.rating, AVG (S.age) AS avg_age FROM Sailors S GROUP BY S.rating) AS Temp WHERE Temp.avg_age = (SELECT MIN (Temp.avg_age) FROM Temp)
Null Values
Field values in a tuple are sometimes unknown (eg: a rating has not been assigned) or inapplicable (eg: no spouses name). SQL provides a special value IS NULL for such situations. The presence of null complicates many issues special operators needed to check if value is null. note: Is rating>8 true or false if rating = null? A 3-valued logic (true, false and unknown) is needed. AND, OR and NOT connectives can be used. note: Meaning of constructs must be defined carefully (eg: WHERE clause eliminates rows true). New operators (in particular, outer joins) possible/needed.
Embedded SQL
SQL commands can be called from within a host language (eg: C or COBOL) program. SQL statements can refer to host variables (including special variables used to return status). Must include a statement to connect to the right database. SQL relations are (multi-) sets of records, with no a priori bound on the number of records. No such data structure in C. SQL supports a mechanism called a cursor to handle this.
16
Cursors
Can declare a cursor on a relation or query statement (which generates a relation). Can open a cursor, and repeatedly fetch a tuple then move the cursor, until all tuples have been retrieved. Can use a special clause, called ORDER BY, in queries that are accessed through a cursor, to control tuple order. (note: fields in ORDER BY clause must appear in SELECT clause) The ORDER BY clause, which orders answer tuples, is only allowed in the context of a cursor. Can also modify/delete tuple pointed to by a cursor. eg: Cursor that gets names of sailors whove reserved a red boat, in alphabetical order EXEC SQL DECLARE sinfo CURSOR FOR SELECT S.sname FROM Sailors S, Boats B, Reserves R WHERE S.sid=R.sid AND R.bid=B.bid AND B.color=red ORDER BY S.sname DESC
General Constraints
Useful when more general ICs than keys are involved. Can use queries to express constraint. note: Constraints can be named. eg: CREATE TABLE Reserves eg: CREATE TABLE Sailors ( sname CHAR(10), ( sid INTEGER, bid INTEGER, sname CHAR(10), day DATE, rating INTEGER, PRIMARY KEY (bid,day), age REAL, CONSTRAINT noInterlakeRes PRIMARY KEY (sid), CHECK (`Interlake <> CONSTRAINT ratingValue ( SELECT B.bname CHECK ( rating >= 1 FROM Boats B AND rating <= 10 ) WHERE B.bid=bid)))
17
Triggers
Trigger: procedure that starts automatically if specified changes occur to the DBMS. Three parts: Event (activates the trigger) Condition (tests whether the triggers should run) Action (what happens if the trigger runs) eg: CREATE TRIGGER youngSailorUpdate AFTER INSERT ON SAILORS REFERENCING NEW TABLE NewSailors FOR EACH STATEMENT INSERT INTO YoungSailors(sid, name, age, rating) SELECT sid, name, age, rating FROM NewSailors N WHERE N.age <= 18
Summary
SQL was an important factor in the early acceptance of the relational model; more natural than earlier, procedural query languages. Relationally complete; in fact, significantly more expressive power than relational algebra. Even queries that can be expressed in RA can often be expressed more naturally in SQL. Many alternative ways to write a query; optimizer should look for most efficient evaluation plan. In practice, users need to be aware of how queries are optimized and evaluated for best results. NULL for unknown field values brings many complications Embedded SQL allows execution within a host language; cursor mechanism allows retrieval of one record at a time APIs such as ODBC and ODBC introduce a layer of abstraction between application and DBMS SQL allows specification of rich integrity constraints Triggers respond to changes in the database
18
A functional dependency X Y holds over relation R if, for every allowable instance r of R: t1 r, t2 r, X (t1) = X (t2) implies Y (t1) =Y (t2) ie: given two tuples in r, if the X values agree, then the Y values must also agree. (X and Y are sets of attributes.) An FD is a statement about all allowable relations. Must be identified based on semantics of application. Given some allowable instance r1 of R, we can check if it violates some FD f, but we cannot tell if f holds over R! K is a candidate key for R means that K R However, K R does not require K to be minimal!
19
CP1500 Revision Notes Insertion anomaly: What if we want to insert an employee and dont know the hourly wage for his rating? Deletion anomaly: If we delete all employees with rating 5, we lose the information about the wage for rating 5! Before:
Refining an ER Diagram
1st diagram translated: Workers(S,N,L,D,S) Departments(D,M,B) Lots associated with workers. Suppose all workers in a dept are assigned the same lot: D L Redundancy; fixed by: Workers2(S,N,D,S) Dept_Lots(D,L) Can fine-tune this: Workers2(S,N,D,S) Departments(D,M,B,L)
After:
name ssn Employees Works_In since did budget dname lot Departments
20
Normal Forms
Returning to the issue of schema refinement, the first question to ask is whether any refinement is needed! If a relation is in a certain normal form (BCNF, 3NF etc.), it is known that certain kinds of problems are avoided/minimized. This can be used to help us decide whether decomposing the relation will help. Role of FDs in detecting redundancy: Consider a relation R with 3 attributes, ABC. No FDs hold: There is no redundancy here. Given A B: Several tuples could have the same A value, and if so, theyll all have the same B value!
X Y
Reln R with FDs F is in BCNF if, for all X A in F x y1 a A X (called a trivial FD), or x y2 ? X contains a key for R. In other words, R is in BCNF if the only non-trivial FDs that hold over R are key constraints. No dependency in R that can be predicted using FDs alone. If we are shown two tuples that agree upon the X value, we cannot infer the A value in one tuple from the A value in the other. If example relation is in BCNF, the 2 tuples must be identical (since X is a key).
21
Example Decomposition
Decompositions should be used only when needed. SNLRWH has FDs S SNLRWH and R W Second FD causes violation of 3NF; W values repeatedly associated with R values. Easiest way to fix this is to create a relation RW to store these associations, and remove W from the main schema: ie: we decompose SNLRWH into SNLRH and RW The information to be stored consists of SNLRWH tuples. If we just store the projections of these tuples onto SNLRH and RW, are there any potential problems that we should be aware of?
22
23
24