Converting Data Types in Python pandas

Once you have the data types, you can follow these general rules to decide on the correct data type for each column and how to fix them:

• Numeric Data: Should typically be int for whole numbers or float for numbers with decimals. Use pd.to_numeric() to convert columns to a numeric data type.

• Dates: Should be in datetime format for easier manipulation of date-related operations. Use pd.to_datetime() to convert date columns, specifying the date format if necessary.

• Categorical Data: If a column has a limited set of values that repeat (like LoanAmountCategory or LoanStatus), you can convert it to category type using .astype('category') to save memory.

• Boolean Data: Should be bool if it contains only two values representing True/False conditions.

• String Data: If the data is textual, ensure it is of object type, which is the default for strings in pandas. Use .astype(str) to convert a column to strings. The CustomerName column should contain strings, so it should be of object type.

In our data, we will perform the following data type transformations:

1. Convert LoanStatus to category type

2. Convert LoanAmountCategory to category type

3. Convert CustomerLoyalty to category type

4. Convert LoanDurationDays from float to int

5. Convert Total Loans by customers from float to int

You can convert the data types of columns in a pandas DataFrame using the astype method. For the numeric columns that you want to convert from float to int, you'll need to ensure there are no missing values because NaN (not a number) is a float value and cannot exist in an integer column. Since we’ve already handled all NaNs in our data, we can convert the data types for the specified columns:

1# Convert 'LoanStatus', 'LoanAmountCategory', and 'CustomerLoyalty' to category type
2loan_data_cleaned['LoanStatus'] = loan_data_cleaned['LoanStatus'].astype('category')
3loan_data_cleaned['LoanAmountCategory'] = loan_data_cleaned['LoanAmountCategory'].astype('category')
4loan_data_cleaned['CustomerLoyalty'] = loan_data_cleaned['CustomerLoyalty'].astype('category')
5
6# Convert 'LoanDurationDays' from float to int (assuming no NaN values are present)
7loan_data_cleaned['LoanDurationDays'] = loan_data_cleaned['LoanDurationDays'].astype(int)
8
9# Convert 'TotalLoansByCustomer' from float to int (assuming no NaN values are present)
10loan_data_cleaned['TotalLoansByCustomer'] = loan_data_cleaned['TotalLoansByCustomer'].astype(int)
11
12# Verify the changes
13loan_data_cleaned.dtypes
14
15

We now have a pretty good and clean dataset.