04-Linear-Regression-Project-DataSet

NOTE: BEFORE WE CAN CONTINUE WITH THIS PROJECT WE NEED TO PERFORM FEATURE ENGINEERING. THE NEXT SECTION OF THE COURSE WILL FOCUS ON TEACHING YOU FEATURE ENGINEERING ON THIS DATASET.

JUMP FORWARD TO THE FEATURE ENGINEERING SECTION

The dataset we will be working with later on in the next section:

Ames Iowa Data Set: http://jse.amstat.org/v19n3/decock.pdf

python

df = pd.read_csv("..\DATA\Ames_Housing_Data.csv")

python

df.head()

Out · table

PID
MS SubClass
MS Zoning
Lot Frontage
Lot Area

127 more lines

Street
Alley
Lot Shape
Land Contour
Utilities
...
Pool Area
Pool QC
Fence
Misc Feature
Misc Val
Mo Sold
Yr Sold
Sale Type
Sale Condition
SalePrice
0
526301100
20
RL
141.0
31770
Pave
NaN
IR1
Lvl
AllPub
...
0
NaN
NaN
NaN
0
5
2010
WD
Normal
215000
1
526350040
20
RH
80.0
11622
Pave
NaN
Reg
Lvl
AllPub
...
0
NaN
MnPrv
NaN
0
6
2010
WD
Normal
105000
2
526351010
20
RL
81.0
14267
Pave
NaN
IR1
Lvl
AllPub
...
0
NaN
NaN
Gar2
12500
6
2010
WD
Normal
172000
3
526353030
20
RL
93.0
11160
Pave
NaN
Reg
Lvl
AllPub
...
0
NaN
NaN
NaN
0
4
2010
WD
Normal
244000
4
527105010
60
RL
74.0
13830
Pave
NaN
IR1
Lvl
AllPub
...
0
NaN
MnPrv
NaN
0
3
2010
WD
Normal
189900
5 rows × 81 columns

python

df.info()

Out · stdout

<class 'pandas.core.frame.DataFrame'>
RangeIndex: 2930 entries, 0 to 2929
Data columns (total 81 columns):
 #   Column           Non-Null Count  Dtype  
---  ------           --------------  -----

83 more lines

 0   PID              2930 non-null   int64  
 1   MS SubClass      2930 non-null   int64  
 2   MS Zoning        2930 non-null   object 
 3   Lot Frontage     2440 non-null   float64
 4   Lot Area         2930 non-null   int64  
 5   Street           2930 non-null   object 
 6   Alley            198 non-null    object 
 7   Lot Shape        2930 non-null   object 
 8   Land Contour     2930 non-null   object 
 9   Utilities        2930 non-null   object 
 10  Lot Config       2930 non-null   object 
 11  Land Slope       2930 non-null   object 
 12  Neighborhood     2930 non-null   object 
 13  Condition 1      2930 non-null   object 
 14  Condition 2      2930 non-null   object 
 15  Bldg Type        2930 non-null   object 
 16  House Style      2930 non-null   object 
 17  Overall Qual     2930 non-null   int64  
 18  Overall Cond     2930 non-null   int64  
 19  Year Built       2930 non-null   int64  
 20  Year Remod/Add   2930 non-null   int64  
 21  Roof Style       2930 non-null   object 
 22  Roof Matl        2930 non-null   object 
 23  Exterior 1st     2930 non-null   object 
 24  Exterior 2nd     2930 non-null   object 
 25  Mas Vnr Type     2907 non-null   object 
 26  Mas Vnr Area     2907 non-null   float64
 27  Exter Qual       2930 non-null   object 
 28  Exter Cond       2930 non-null   object 
 29  Foundation       2930 non-null   object 
 30  Bsmt Qual        2850 non-null   object 
 31  Bsmt Cond        2850 non-null   object 
 32  Bsmt Exposure    2847 non-null   object 
 33  BsmtFin Type 1   2850 non-null   object 
 34  BsmtFin SF 1     2929 non-null   float64
 35  BsmtFin Type 2   2849 non-null   object 
 36  BsmtFin SF 2     2929 non-null   float64
 37  Bsmt Unf SF      2929 non-null   float64
 38  Total Bsmt SF    2929 non-null   float64
 39  Heating          2930 non-null   object 
 40  Heating QC       2930 non-null   object 
 41  Central Air      2930 non-null   object 
 42  Electrical       2929 non-null   object 
 43  1st Flr SF       2930 non-null   int64  
 44  2nd Flr SF       2930 non-null   int64  
 45  Low Qual Fin SF  2930 non-null   int64  
 46  Gr Liv Area      2930 non-null   int64  
 47  Bsmt Full Bath   2928 non-null   float64
 48  Bsmt Half Bath   2928 non-null   float64
 49  Full Bath        2930 non-null   int64  
 50  Half Bath        2930 non-null   int64  
 51  Bedroom AbvGr    2930 non-null   int64  
 52  Kitchen AbvGr    2930 non-null   int64  
 53  Kitchen Qual     2930 non-null   object 
 54  TotRms AbvGrd    2930 non-null   int64  
 55  Functional       2930 non-null   object 
 56  Fireplaces       2930 non-null   int64  
 57  Fireplace Qu     1508 non-null   object 
 58  Garage Type      2773 non-null   object 
 59  Garage Yr Blt    2771 non-null   float64
 60  Garage Finish    2771 non-null   object 
 61  Garage Cars      2929 non-null   float64
 62  Garage Area      2929 non-null   float64
 63  Garage Qual      2771 non-null   object 
 64  Garage Cond      2771 non-null   object 
 65  Paved Drive      2930 non-null   object 
 66  Wood Deck SF     2930 non-null   int64  
 67  Open Porch SF    2930 non-null   int64  
 68  Enclosed Porch   2930 non-null   int64  
 69  3Ssn Porch       2930 non-null   int64  
 70  Screen Porch     2930 non-null   int64  
 71  Pool Area        2930 non-null   int64  
 72  Pool QC          13 non-null     object 
 73  Fence            572 non-null    object 
 74  Misc Feature     106 non-null    object 
 75  Misc Val         2930 non-null   int64  
 76  Mo Sold          2930 non-null   int64  
 77  Yr Sold          2930 non-null   int64  
 78  Sale Type        2930 non-null   object 
 79  Sale Condition   2930 non-null   object 
 80  SalePrice        2930 non-null   int64  
dtypes: float64(11), int64(27), object(43)
memory usage: 1.8+ MB