Lesson 4.5: Identifying Patterns and Trends in Data
What are Patterns and Trends?
-
Pattern → A repeated or predictable structure in data.
-
Trend → A general direction in which data is moving over time.
1. Types of Patterns
-
Seasonal Pattern → Data repeats in cycles.
-
Example: Ice-cream sales increase in summer.
-
-
Cyclical Pattern → Long-term rises and falls.
-
Example: Business cycles in the economy.
-
-
Cluster Pattern → Groups of similar data points.
-
Example: Customers grouped by buying habits.
-
2. Types of Trends
-
Upward Trend → Values generally increase.
-
Example: Stock market growth over years.
-
-
Downward Trend → Values generally decrease.
-
Example: Landline phone usage over time.
-
-
Flat/No Trend → Data stays stable.
3. How to Identify Patterns & Trends
-
Visualization tools:
-
Line chart → Shows trends over time.
-
Scatter plot → Reveals clusters/patterns.
-
Moving averages → Smooths fluctuations to see clear trends.
-
Box plots → Identify distribution and outliers.
-
4. Why Important in EDA?
-
Helps in understanding behavior of data.
-
Useful for forecasting future values.
-
Guides in feature engineering and model selection.
