Pandas என்பது Python-ல் data analysis, data manipulation, data cleaning, tabular data processing போன்ற வேலைகள……
Pandas
Pandas என்பது Python-ல் data analysis, data manipulation, data cleaning, tabular data processing போன்ற வேலைகளை எளிதாக செய்ய பயன்படும் open-source library. Pandas முக்கியமாக labeled/tabular data உடன் வேலை செய்ய designed செய்யப்பட்டிருக்கிறத…
ஒரு Excel sheet நினைத்துக் கொ……
இது: Rows + Columns + Data Pandas இ……
Raw Data ↓ Pandas மூலம் Read ↓ Series / DataFrame ↓ View Data ↓ Select Data ↓ Clean Data ↓ Filter Data ↓ Anal……
pandas → Library name pd → Co……
Why Pandas?
Pandas mainly useful for: Data analysis Data cleaning CSV processing Spreadsheet-like operations Missing data……
Installing Pandas
Terminal / Command Prompt: pi……
Pandas-க்கு commonly used alias: ……
Pandas → pd NumPy → np Pandas……
Main Pandas Data Structures
Pandas-ல் beginner level-க்கு……
A Series என்பது one-dimensional labeled data struct……
Exact integer dtype can depend on platform/configurat……
marks = pd.Series([80, 90, 70……
Pandas default indexing gener……
Series with Custom Index
Now labels: Arun Bala Kumar a……
Series: Index + Value 0 → 80 ……
DataFrame என்பது two-dimensional labeled tabular data structure. Row……
Series: ஒரு column மட்டும். D……
Name Mark Arun 90 Bala 80 இது……
DataFrame Components
ஒரு DataFrame-க்கு முக்கியமாக……
Name Mark 0 Arun 90 1 Bala 85 2 Kumar 95 ……
Creating DataFrame from Dictionary
head()
head() DataFrame-ன் starting rows பார்……
If DataFrame has many rows, f……
First 3 rows.…
Head = Top head() → மேலே உள்ள……
tail()
tail() DataFrame-ன் last rows பார்க்க பயன்படு……
Tail = End tail() → Bottom / ……
View Full DataFrame
முழு table-ஐ display செய்யும்.…
Very large DataFrame இருந்தால் Pandas ……
shape
shape tells: (number of rows,……
If: 3 rows 3 columns…
shape = Rows × Columns struct……
size
size total number of values/e……
3 rows × 3 columns:…
ndim
Because DataFrame is two-dime……
columns
The exact representation may ……
index
For default indexing it repre……
dtypes
Each column data type பார்க்க:…
Possible concept: Name string/object-like Age integer Ma……
info()
info() DataFrame பற்றி concise technical summary கொடுக்கிறது. d……
df.info() இது large dataset u……
info() = DataFrame health card…
describe()
describe() numerical columns-க்கு descriptive statistics ……
Suppose Marks: 80 90 70 100 describe() அவற்றின்: Cou……
describe() → Statistical summ……
Selecting a Column
Suppose: df contains: Name Ag……
Single column selection norma……
df["Name"] → Series But: df[[……
Selecting Multiple Columns
loc
.loc[] is primarily label-based selection. It can select ……
df.loc[row_label] or: df.loc[……
loc = Label…
iloc
.iloc[] is primarily integer-position based……
df.iloc[row_position] or: df.……
First row. Specific cell:…
Row position: 0 Column positi……
Pandas documentation explicitly distinguishes .……
Don't memorize: loc = row iloc =……
Row Slicing with iloc
Positions: 0 1 are returned. ……
Selecting Rows and Columns
Rows: 0, 1 Columns: 0, 1…
Filtering Data
Filtering is one of Pandas' most powerful fe……
Output concept: Name Mark Aru……
df["Mark"] > 80 produces Boolean condit……
Comparison operators: < =…
Multiple Conditions
Use & for AND-like element-wi……
Use | for OR-like combination:…
Wrong: df["Mark"] > 80 and df["Age"] < 21 For Series boole……
Pandas conditions: & → AND | ……
Add New Column
df["Result"] = ["Pass", "Pass……
df["Bonus"] = 5…
Every row gets 5.…
Create Column from Existing Column
df["NewMark"] = df["Mark"] + 5 If: Mark 90……
Update a Value
Using loc: df.loc[0, "Mark"] ……
Rename Columns
Mark becomes: Score…
Drop Column
Drop Row
Reset Index
Pandas documentation says reset_index() res……
Sorting Data
Use: sort_values()…
Ascending order. Descending:…
Pandas sort_values() sorts by specified values a……
ascending=True → Small to Lar……
Missing Data
Real datasets-ல் சில values m……
Name Mark Arun 90 Bala NaN Kumar 80 Missing data handling is an important Pandas featu……
NaN
NaN often indicates: Not a Number / missing numerical data rep……
Detect Missing Values - isna()
Output concept: False True Fa……
isnull()
df.isnull() also commonly use……
Count Missing Values
Name 0 Mark 2 Age 1…
Mark → 2 missing Age → 1 miss……
fillna()
fillna() missing values-ஐ specified replacement value கொண்டு fill செய்ய பயன்ப……
df["Mark"] = df["Mark"].filln……
Missing values replaced with ……
Marks: 80 NaN 100 Mean of ava……
Forward Fill
Modern pandas provides: df.ffill……
Before: 10 NaN 20 After forwa……
dropna()
dropna() removes rows/columns according to missing-……
Rows with missing values remo……
Don't blindly use: df.dropna() on every dataset. Why? Im……
Duplicate Data
Check duplicates: df.duplicated……
value_counts()
value_counts() counts how man……
Suppose: Chennai Madurai Chen……
value_counts = Frequency…
Unique Values
df["City"].unique() Returns unique……
Basic Statistical Functions
Mean: marks.mean() Median: marks.median() Minimum: marks.min……
GroupBy
groupby() same category-க்கு சேர்ந்த rows-ஐ groups ஆக ……
df.groupby("Department") CS rows one group. Maths rows anothe……
CS: 90 + 80…
2 = 85 Maths: 70 + 100 2 = 85…
GroupBy = Split → Apply → Com……
Aggregation
Reading CSV
CSV: Comma-Separated Values Example file: Name,Mark,City Arun,90,Che……
CSV File ↓ pd.read_csv() ↓ Da……
Common error on Windows: Wrong: pd.read_csv("C:\Users\Admin\Downloads\students.csv") Backslashes ……
Saving DataFrame to CSV
means DataFrame index is not ……
Reading Excel
When the required Excel engin……
String Operations
Suppose: df["Name"] contains names. Convert to ……
Contains: df["Name"].str.cont……
Before: Arun Bala After: ARUN……
Replace Values
Mapping Values
df["Code"] = df["Result"].map……
Apply a Function
df["NewMark"] = df["Mark"].apply(add_bonus) For si……
Concatenating DataFrames
Pandas provides facilities for combining Series……
df1: Arun Bala df2: Kumar Rav……
Merge
Suppose: Student table: ID Name 1 Arun 2 Bala Mark……
Set Index
Before: 0 Arun 1 Bala After: ……
Reset Index
Returns index back into ordinar……
Complete Student Example
df["Mark"] selects Mark column. df["Mark"] > 80……
Create Result Column df["Resu……
Calculation: 90 + 75 + 95 + 80…
4 340 / 4 = 85…
Pandas + NumPy Relationship
NumPy: Main focus: Numerical A……
NumPy = Numbers Pandas = Tabl……
Series vs DataFrame…
df["Mark"] → Series df[["Mark……
loc vs iloc loc → LABEL iloc → INTEGER ……
Pandas Master Workflow…
READ ↓ VIEW ↓ CHECK ↓ CLEAN ↓ SELECT ↓ FILTER ↓ ANALYZE ↓ GROUP ↓ SAV……
Pandas alias mistake Correct: import pandas as ……
loc and iloc confuse செய்வது ……
Column name case If column is: Mark Wrong……
Single vs Double Brackets df[……
Filtering without parentheses Wrong: df[ df["Mark……
head without brackets Wrong if ……
Missing file pd.read_csv("student.csv") File not f……
Missing values ignored Don't immediately perform calculations without checking data quality. First: d……
Pandas Master Memory S D H T L I F G S → Serie……
Cleaning Memory I F D D I → isn……
Dataset Inspection…
HEAD SHAPE INFO DESCRIBE First data……
Pandas is a Python library fo……
Common Pandas alias: pd…
Two major structures: Series ……
Series is one-dimensional lab……
DataFrame is two-dimensional tab……
Create DataFrame: pd.DataFram……
Read CSV: pd.read_csv()…
First rows: head()…
Last rows: tail()…
shape returns: (rows, columns)…
loc is primarily label based.…
iloc is primarily integer-pos……
Missing value detection: isna……
Missing values can be filled ……
Missing-data rows can be remo……
Duplicate rows: duplicated()…
Remove duplicates: drop_dupli……
Sort: sort_values()…
Group data: groupby()…
Frequency: value_counts()…
Statistical summary: describe……
Data structure summary: info()…
Save CSV: to_csv()…
df["column"] normally returns……
df[["column"]] returns DataFr……
What is Pandas? Answer Pandas is an open-source Python librar……
What is a Series? Answer A Series is a one-dime……
What is a DataFrame? Answer A DataFrame is a two-dimensional la……
What is the difference between loc and iloc? Answe……
How do you detect missing values? Answer Common methods include: ……
How can missing values be fil……
df["Mark"] = df["Mark"].filln……
What is groupby()? Answer groupby() groups rows according to one or mo……
What is the difference between Pandas and NumPy? Answer NumPy focuses mainly on efficient multidimensio……
Pandas is mainly used for:…
Common alias for Pandas:…
Which creates a DataFrame?…
A Pandas Series is mainly:…
A DataFrame is mainly:…
Which reads CSV?…
Which shows first rows?…
Which shows last rows?…
What does shape represent?…
Which is label-based?…
Which is integer-position bas……
Which detects missing values?…
Which fills missing values?…
Which removes missing-data ro……
What does this generally retu……
What does this return? df[["M……
Which sorts rows by column va……
Which groups rows according t……
Which counts frequency of eac……
Which gives numerical statist……
What is the result conceptual……
Which writes DataFrame to CSV?…
ascending=False means:…
Which can combine DataFrames ……
Which is suitable for databas……
Create a Series: 10 20 30 40 Answer: ……
Create DataFrame: Name Mark Arun 90 Bala 80 Kumar 95 Answer: import pan……
Print first two rows: print(d……
Print last two rows: print(df……
Find DataFrame shape: print(d……
Select only Name: print(df["N……
Select Name and Mark: print(d……
Find first row using iloc: pr……
Find first student's Mark: pr……
Filter Mark > 80: print( df[d……
Add Bonus column: df["BonusMa……
Find average mark: print(df["……
Find highest mark: print(df["……
Sort highest to lowest: print……
Check missing values: print(d……
Fill missing Marks with zero:……
Read CSV: df = pd.read_csv("s……
Save result: df.to_csv( "resu……
Count students from each city……
Find department average: prin……
Pandas is used for data analysis and manipulation. Common Pandas alias is pd. Series is a one-dimensional lab……
Pandas → Data Analysis Alias → pd 1D → Series 2D → DataFrame Create Series → pd.Series() Create DataFrame → p……