Introduction to Python

Data Analytics
Course Outline

• Session 1: Basic Concepts

• Session 2: Demonstration of Python Data Analytics
• Session 3: Hands-On Practice
Goal & Scope of This Course

We’re going to cover only the key

concepts in Python data analytics

• Python basics for data analytics

• Python data analytics libraries
• Jupyter Notebook
Quick Survey on Prior Experience

• Python
• I have experience with Python
• I have experience with programming, but not with Python
• I have no experience with programming

• Data analytics
• I have experience with data analytics
• I have no experience with data analytics
What Is Data Analytics?

Data analytics is the process and

methodology of analyzing data
to draw meaningful insight
from the data
Why Is It So Popular?

We now see the limitless potential

for gaining critical insight
by applying data analytics
 Typical Process of Data Analytics

Decision Making
Problem

Insight Decision
Development Making
Requirement Data Data Data
Understanding Understanding Preparation Exploration
Modeling &
Deployment
Evaluation

The most time- The most

consuming part exciting part Modeling
Problem
Types of Data Analytics

Data Analytics

Descriptive Predictive Prescriptive

Analytics Analytics Analytics
What has happened or is What could happen in the What should we do to make
happening? future? that happen or not happen?

“How will the population “What actions should be

“How has the population
change over the next ten taken in order to avoid the
been changing?”
years?” demographic cliff?”
Confusion – Machine Learning vs. Data Analytics

AI

Machine Learning Vs. Data Analytics

Data analytics depends

Deep Learning heavily on machine learning
Confusion –AI vs. Data Analytics

AI Vs. Data Analytics

Machine Learning
The goals are different!
• AI: intelligence
Deep Learning • Data analytics: insight
Python as a Programming Language

Python is a general-purposed
high-level programming language
• Web development
• Networking
• Scientific computing
• Data analytics
• …
Python as a Data Analytics Tool

The nature of Python makes it

a perfect-fit for data analytics
• Easy to learn
• Readable
• Scalable
• Extensive set of libraries
• Easy integration with other apps
• Active community & ecosystem
18
Popular Python Data Analytics Libraries

Library Usage
numpy, scipy Scientific & technical computing
pandas Data manipulation & aggregation
mlpy, scikit-learn Machine learning
theano, tensorflow, keras Deep learning

statsmodels Statistical analysis

nltk, gensim Text processing
networkx Network analysis & visualization
bokeh, matplotlib, seaborn, plotly Visualization
beautifulsoup, scrapy Web scraping
19
iPython & Jupyter Notebook

iPython is a Python command shell

for interactive computing

Jupyter Notebook (the former iPython

Notebook) is a web-based interactive
data analysis environment that
supports iPython
20
Comparison – R vs. Python
• Comparison between R and Python has been absolutely one of the hottest
topics in data science communities

R Vs. Python
R came from the statisticians community,
whereas Python came from the computer scientists community

Python is said to be a challenger against R, but in general it’s a tie

It’s up to you to choose the one that best fits your needs
For detailed comparison, refer to https://www.datacamp.com/community/tutorials/r-or-python-for-data-analysis
21
Start Jupyter notebook

jupyter notebook

25
Loading Python Libraries

#Import Python Libraries

import numpy as np
import scipy as sp
import pandas as pd
import matplotlib as mpl
import seaborn as sns

Press Shift+Enter to execute the jupyter cell

25
Reading data using pandas

In [ ]: #Read csv file

df = pd.read_csv("http://rcs.bu.edu/examples/python/data_analysis/Salaries.csv")

Note: The above command has many optional arguments to fine-tune the data import process.

There is a number of pandas commands to read other data formats:

pd.read_excel('myfile.xlsx',sheet_name='Sheet1', index_col=None, na_values=['NA'])

pd.read_stata('myfile.dta')
pd.read_sas('myfile.sas7bdat')
pd.read_hdf('myfile.h5','df')

25
Exploring data frames

In [3]: #List first 5 records

df.head()

Out[3]:

25
Data Frames methods

Unlike attributes, python methods have parenthesis.

All attributes and methods can be listed with a dir() function: dir(df)

df.method() description
head( [n] ), tail( [n] ) first/last n rows

describe() generate descriptive statistics (for numeric columns only)

max(), min() return max/min values for all numeric columns

mean(), median() return mean/median values for all numeric columns

std() standard deviation

sample([n]) returns a random sample of the data frame

dropna() drop all the records with missing values

25
Summary

• Typical Python data analytics process for beginners

1. Identify the dataset of interest from a file/database/web
2. Load the dataset into a Pandas dataframe
3. Check the column names and see the first few rows
4. Derive additional columns if needed and handle missing data
5. Do analysis with visualization or apply advanced data analytics techniques

25
Any Doubts ?

THANK YOU !!

25