Chapter 4 Data And Database Management Systems

What do you mean by data processing?

Data processing is the conversion of data into usable and desired form. This conversion
or “processing” is carried out using a predefined sequence of operations either manually
or automatically. Most of the data processing is done by using computers and thus done
automatically. The output or “processed” data can be obtained in different forms like
image, graph, table, vector file, audio, charts or any other desired format depending on
the software or method of data processing used.

Fundamentals of data processing & how data is

processed
Data processing is undertaken by any activity which require collection of data. This data
collected needs to be stored, sorted, processed and analyzed. This complete process
can be divided into 6 basic simple stages which are:

1. Data collection
2. Storage of data
3. Sorting of data
4. processing of data
5. Data analysis
6. Data presentation and conclusions

Once the data is collected the need for data entry emerges for storage of data. Storage
can be done in physical form by use of papers, in notebooks or in any other physical form.
But now since the data collection is large and number of operations needs to be
performed for meaningful analysis, the data is stored in digital form. Having the data into
digital form enables the user to perform large number of operations in small time and
allows conversion into different forms. User can thus select the output which best suits
the requirement.

This continuous use and processing of data follows a cycle called as data processing
cycle which might provide instantaneous results or take time depending upon the need of
processing data. The complexity in the field of data processing is increasing which is
creating a need for advanced techniques.

Storage of data is followed by sorting and filtering. This stage is highly effected by the
format in which data is stored and further depends on the software used. General daily
day and non complex data can be stored as text files, tables or a combination of both in
Microsoft Excel or similar software. As the task becomes complex which requires
performing specific and specialized operations they require different softwares which are
meant to cater the peculiar needs.

Storing, sorting, filtering and processing of data can be done by single software or a
combination of software whichever feasible and required. Data processing thus carried
out by software is done as per the predefined set of operations. Most of the modern-day
softwares allows users to perform different operations based on the analysis or study to
be carried out. Data processing provides the output file in various formats.

Different types of output files obtained as “processed”

data
Plain text file – These constitute the simplest form or processed data. Most of these files
are user readable and easy to comprehend. Very negligible or no further processing is
these type of files.

Table/ spreadsheet – This file format is most suitable for numeric data. Having digits in
rows and columns allows user to perform various operations like filtering & sorting in
ascending/descending order to make it easy to understand and use. Various
mathematical operations can be applied when using this file output.

Charts & Graphs – Option to get the output in form of charts and graphs is very useful
and now forms a standard features in most of the softwares. This option is very useful
when dealing with numerical values reflecting trends and growth/decline. Though there
are ample of charts and graphs are available to match diverse requirements there exists
situation when there is need to have used defined option. In case no inbuilt chart or graph
is available then the option to create own charts i.e. custom charts/graphs comes handy.

Maps/Vector or image file – When dealing with spatial data the option to export the
processed data into maps, vector and image files is of great use. Having the information
on maps is of particular use for urban planners who work on different types of maps.
Image files are obtained when dealing with graphics and does not constitute any human
readable input.

You might be interested in Data Mining

Other formats/ raw files – These are the software specific file formats which can be used
and processed by specialized softwares. These output files may not be a complete
product and require further processing. Thus there will be need to perform multiple data
processing.

Types of data processing

 Manual data processing: In this method data is processed manually without use of
machine or electronic device. This methods might be accompanied with automatic
method for completion of the data processing.

Mechanical data processing – Data processing is done by use of mechanical device or

very simple electronic devices like calculator and type writers. When the need for
processing is simple this method can be adopted.

Electronic data processing – This is the fastest and best available method with highest
reliability and accuracy. Technology used is latest as this method uses computers and
employed in most of the agencies. The use of softwares forms the part of this type of data
processing

Types of data processing on basis of process/steps performed

1. Batch Processing
2. Real time processing
3. Online Processing
4. Multiprocessing
5. Time sharing

Related: Types of data processing, Data Visualization, Data Mapping

Data processing methods

Manual Data Processing – data is processed manually without using any machine or
tool to get required results. In manual data processing, all the calculations and logical
operations are performed manually on the data.

Mechanical Data Processing – data is processed by using different devices like

typewriters, mechanical printers or other mechanical devices.

Electronic Data Processing is the modern technique to process data. The data is
processed through computer; Data and set of instructions are given to the computer as
input and the computer automatically processes the data according to the given set of
instructions. The computer is also known as electronic data processing machine.

Related: Data processing and data processing methods

What makes processing of data important

Nowadays more and more data is collected for academic, scientific research, private &
personal use, institutional use, commercial use. This collected data needs to be stored,
sorted, filtered, analysed and presented for it to be of any use. This process can be simple
or complex depending on the scale at which data collection is done and the complexity of
the results which are required to be obtained. The time consumed in obtaining the desired
result depends on the operations which needs to be performed on the collected data and
on the nature of output file required to be obtained. This problem becomes more stark
when dealing with very large volume of data such as those collected by multinational
companies about their users, sales, manufacturing etc.

The need of data processing becomes more and more important in such cases. In such
cases data mining and data management comes into play without which optimal results
cannot be obtained. Each stage starting from data collection to presentation has direct
effect on the output and usefulness of the processed data.

Data Base Mangement System

Database is a collection of related data and data is a collection of facts and

figures that can be processed to produce information.
Mostly data represents recordable facts. Data aids in producing information,
which is based on facts. For example, if we have data about marks obtained by
all students, we can then conclude about toppers and average marks.
A database management system stores data in such a way that it becomes
easier to retrieve, manipulate, and produce information.

Characteristics
Traditionally, data was organized in file formats. DBMS was a new concept then,
and all the research was done to make it overcome the deficiencies in traditional
style of data management. A modern DBMS has the following characteristics:
•Real-world entity: A modern DBMS is more realistic and uses real-world
entities to design its architecture. It uses the behavior and attributes too.
For example, a school database may use students as an entity and their
age as an attribute.
•Relation-based tables: DBMS allows entities and relations among them
to form tables. A user can understand the architecture of a database just
by looking at the table names.
•Isolation of data and application: A database system is entirely
different than its data. A database is an active entity, whereas data is said
to be passive, on which the database works and organizes. DBMS also
stores metadata, which is data about data, to ease its own process.
•Less redundancy: DBMS follows the rules of normalization, which splits
a relation when any of its attributes is having redundancy in values.
Normalization is a mathematically rich and scientific process that reduces
data redundancy.
•Consistency: Consistency is a state where every relation in a database
remains consistent. There exist methods and techniques, which can detect
attempt of leaving database in inconsistent state. A DBMS can provide
greater consistency as compared to earlier forms of data storing
applications like file-processing systems.
•Query Language: DBMS is equipped with query language, which makes
it more efficient to retrieve and manipulate data. A user can apply as
many and as different filtering options as required to retrieve a set ofdata.
Traditionally it was not possible where file-processing system was
used.

1. OVERVIEW
ACID Properties: DBMS follows the concepts of Atomicity, Consistency,
Isolation, and Durability (normally shortened as ACID). These concepts
are applied on transactions, which manipulate data in a database. ACID
properties help the database stay healthy in multi-transactional
environments and in case of failure.
•Multiuser and Concurrent Access: DBMS supports multi-user
environment and allows them to access and manipulate data in parallel.
Though there are restrictions on transactions when users attempt to
handle the same data item, but users are always unaware of them.
•Multiple views: DBMS offers multiple views for different users. A user
who is in the Sales department will have a different view of database than
a person working in the Production department. This feature enables the
users to have a concentrate view of the database according to their
requirements.
•Security: Features like multiple views offer security to some extent
where users are unable to access data of other users and departments.
DBMS offers methods to impose constraints while entering data into the
database and retrieving the same at a later stage. DBMS offers many
different levels of security features, which enables multiple users to have
different views with different features. For example, a user in the Sales
department cannot see the data that belongs to the Purchase department.
Additionally, it can also be managed how much data of the Sales
department should be displayed to the user. Since a DBMS is not saved on
the disk as traditional file systems, it is very hard for miscreants to break
the code.
A typical DBMS has users with different rights and permissions who use it for
different purposes. Some users retrieve data and some back it up. The users of
•Administrators: Administrators maintain the DBMS and are responsible
for administrating the database. They are responsible to look after its
usage and by whom it should be used. They create access profiles for
users and apply limitations to maintain isolation and force security.
Administrators also look after DBMS resources like system license,
required tools, and other software and hardware related maintenance.
•Designers: Designers are the group of people who actually work on the
designing part of the database. They keep a close watch on what data
should be kept and in what format. They identify and design the whole set
of entities, relations, constraints, and views.
•End Users: End users are those who actually reap the benefits of having
a DBMS. End users can range from simple viewers who pay attention to
the logs or market rates to sophisticated users such as business analysts.