Skip to content
Contact →

02-DBSCAN-Project-Exercise

Updated
17 Sept 2026
2 min read
6 sections
Page 108 of 117
Python & Machine Learning

DBSCAN Project

The Data

Source: https://archive.ics.uci.edu/ml/datasets/Wholesale+customers

Margarida G. M. S. Cardoso, margarida.cardoso '@' iscte.pt, ISCTE-IUL, Lisbon, Portugal

Data Set Information:

Provide all relevant information about your data set.

Attribute Information:

  1. FRESH: annual spending (m.u.) on fresh products (Continuous);
  2. MILK: annual spending (m.u.) on milk products (Continuous);
  3. GROCERY: annual spending (m.u.)on grocery products (Continuous);
  4. FROZEN: annual spending (m.u.)on frozen products (Continuous)
  5. DETERGENTS_PAPER: annual spending (m.u.) on detergents and paper products (Continuous)
  6. DELICATESSEN: annual spending (m.u.)on and delicatessen products (Continuous);
  7. CHANNEL: customers Channel - Horeca (Hotel/Restaurant/Café) or Retail channel (Nominal)
  8. REGION: customers Region Lisnon, Oporto or Other (Nominal)

Relevant Papers:

Cardoso, Margarida G.M.S. (2013). Logical discriminant models – Chapter 8 in Quantitative Modeling in Marketing and Management Edited by Luiz Moutinho and Kun-Huang Huarng. World Scientific. p. 223-253. ISBN 978-9814407717

Jean-Patrick Baudry, Margarida Cardoso, Gilles Celeux, Maria José Amorim, Ana Sousa Ferreira (2012). Enhancing the selection of a model-based clustering with external qualitative variables. RESEARCH REPORT N° 8124, October 2012, Project-Team SELECT. INRIA Saclay - Île-de-France, Projet select, Université Paris-Sud 11

DBSCAN and Clustering Examples

COMPLETE THE TASKS IN BOLD BELOW:

TASK: Run the following cells to import the data and view the DataFrame.

python
df = pd.read_csv('../DATA/wholesome_customers_data.csv')
python
df.head()
Out · table
Channel
Region
Fresh
Milk
Grocery
48 more lines
Frozen
Detergents_Paper
Delicassen
0
2
3
12669
9656
7561
214
2674
1338
1
2
3
7057
9810
9568
1762
3293
1776
2
2
3
6353
8808
7684
2405
3516
7844
3
1
3
13265
1196
4221
6404
507
1788
4
2
3
22615
5410
7198
3915
1777
5185
python
df.info()
Out · stdout
<class 'pandas.core.frame.DataFrame'>
RangeIndex: 440 entries, 0 to 439
Data columns (total 8 columns):
 #   Column            Non-Null Count  Dtype
---  ------            --------------  -----
10 more lines
 0   Channel           440 non-null    int64
 1   Region            440 non-null    int64
 2   Fresh             440 non-null    int64
 3   Milk              440 non-null    int64
 4   Grocery           440 non-null    int64
 5   Frozen            440 non-null    int64
 6   Detergents_Paper  440 non-null    int64
 7   Delicassen        440 non-null    int64
dtypes: int64(8)
memory usage: 27.6 KB

EDA

TASK: Create a scatterplot showing the relation between MILK and GROCERY spending, colored by Channel column.

python
#CODE HERE

TASK: Use seaborn to create a histogram of MILK spending, colored by Channel. Can you figure out how to use seaborn to "stack" the channels, instead of have them overlap?

python
#CODE HERE

TASK: Create an annotated clustermap of the correlations between spending on different cateogires.

python
# CODE HERE

TASK: Create a PairPlot of the dataframe, colored by Region.

python
#CODE HERE

DBSCAN

TASK: Since the values of the features are in different orders of magnitude, let's scale the data. Use StandardScaler to scale the data.

python
#CODE HERE

TASK: Use DBSCAN and a for loop to create a variety of models testing different epsilon values. Set min_samples equal to 2 times the number of features. During the loop, keep track of and log the percentage of points that are outliers. For reference the solutions notebooks uses the following range of epsilon values for testing:

np.linspace(0.001,3,50)

python
#CODE HERE

TASK: Create a line plot of the percentage of outlier points versus the epsilon value choice.

python
#CODE HERE

DBSCAN with Chosen Epsilon

TASK: Based on the plot created in the previous task, retrain a DBSCAN model with a reasonable epsilon value. Note: For reference, the solutions use eps=2.

TASK: Create a scatterplot of Milk vs Grocery, colored by the discovered labels of the DBSCAN model.

python
#CODE HERE

TASK: Create a scatterplot of Milk vs. Detergents Paper colored by the labels.

python
#CODE HERE

TASK: Create a new column on the original dataframe called "Labels" consisting of the DBSCAN labels.

python
#CODE HERE

TASK: Compare the statistical mean of the clusters and outliers for the spending amounts on the categories.

python
# CODE HERE

TASK: Normalize the dataframe from the previous task using MinMaxScaler so the spending means go from 0-1 and create a heatmap of the values.

python
#CODE HERE

TASK: Create another heatmap similar to the one above, but with the outliers removed

TASK: What spending category were the two clusters mode different in?

python
#CODE HERE