Customer churn data analysis using data mining

Research Article
Open access

Customer churn data analysis using data mining

Xingyuan Jiang 1*
  • 1 Wuhan Britain-China School    
  • *corresponding author 2706150644@qq.com
ACE Vol.77
ISSN (Print): 2755-273X
ISSN (Online): 2755-2721
ISBN (Print): 978-1-83558-513-9
ISBN (Online): 978-1-83558-514-6

Abstract

Churn is the phenomenon of a customer terminating their relationship or subscription with a company or service provider[1]. It represents the rate at which customers stop using a company's product or service during a specific period of time. Attrition rate is an important metric for businesses as it directly impacts revenue, growth and customer retention. In the context of the churn data set, the churn label indicates whether a customer has been churn. Lost customers are those who decide to stop buying the company's products. On the other hand, non-churn customers are those who continue to buy the company's products. Understanding customer churn is critical for businesses to identify the patterns, factors, and metrics that lead to customer churn. By analyzing churn behavior and its associated characteristics, companies can develop strategies to retain existing customers, improve customer satisfaction, and reduce customer churn. Predictive modeling techniques can also be applied to anticipate and proactively address potential customer churn, enabling companies to take proactive steps to retain at-risk customers[2].

Keywords:

Data mining, Neural network, Classification, Contrastive analysis, Consumer churn

Jiang,X. (2024). Customer churn data analysis using data mining. Applied and Computational Engineering,77,17-24.
Export citation

1. Introduction

Customer churn is one of the challenges faced by enterprises for a long time, so the prediction and management of customer churn has been widely concerned. Data mining technology, as an effective tool, provides enterprises with the ability to analyze large-scale data and find signs of potential customer churn. This paper aims to use data mining technology to explore and analyze the data of customer churn in order to provide powerful decision support.

In this study, we first define the concept of customer churn, and comb the related research and theory. We then collected a real data set on customer churn and pre-processed and cleaned it to ensure accuracy and consistency.

Next, we use data mining techniques, including comparative analysis and factor analysis, to analyze the customer churn data. Through feature selection and model training, we successfully construct a customer churn prediction model, which can accurately predict whether customers will churn.

Finally, based on the analysis results of customer churn data, we put forward a series of business strategies and suggestions to help enterprises effectively manage customer churn. These strategies involve improving customer relationship management, providing personalized services and customized marketing activities, so as to reduce customer turnover and increase the profitability of enterprises.

Revised sentence: The primary challenge lies in distinguishing between temporarily idle customers and those who are defecting to competitors. “Historical data can be analyzed to identify distinct purchasing patterns among customers, such as frequency of shopping or seasonal buying habits” [3]. However, extended periods of inactivity may indicate potential churn and accurately predicting which customers are at risk is crucial for marketing teams seeking to boost business profits. “This study presents a practical survival framework that utilizes recurrent neural network parameters to generate individual-level survival models based solely on the behavior of each consumer, eliminating the need for time-consuming feature engineering during machine learning model training” [4].

In conclusion, this study demonstrates the potential of data mining in customer churn prediction and management, and provides a powerful decision-making basis for enterprises. Future research can further explore more data mining techniques and methods to improve the accuracy and practicability of customer churn prediction models.

2. Data mining

Data mining is a process of learning and extracting useful information from large data sets. Data mining focuses on discovering interesting structures or patterns hidden in large amounts of raw data, which may be used for activities such as user research, market analysis, and technology trend analysis.

The significance of data mining lies in exploring the hidden knowledge of data. The use of big data technology can automatically discover the patterns, trends, associations, and structures stored in the data, helping people develop effective data support applications. Data mining can help make more effective decisions, provide information and guidance, and thus improve decision-making and problem solving. The development of data mining technology will further strengthen the internal and external activities of enterprises, can better manage the enterprise process, and help managers better organize and run the enterprise and manage the performance of the team.

We will use the method of data mining to analyze the data set of customer churn. Data mining has some advantages and disadvantages. First, data mining can better manage customer relationships, which is one of the main advantages of data mining, and it can also help enterprises understand how to use different types of products to disengage different types of customers. This guarantees the sale of goods. Second, data mining can predict market trends, it can predict the products that customers are interested in, and help companies decide which types of products to bring to market. Then, data mining can help a company stay ahead of the competition, because they have the most information, which helps them win over their competitors in the information gap, and data mining has great advantages in product personalization. Finally, data mining can ensure the security of critical data, such as data anonymization, access control, and so on.

However, data mining also has many disadvantages. Data mining may violate the privacy of users, which is an unethical behavior. However, data mining will also lack accuracy and accuracy, and wrong processing will produce wrong data, which is harmful to the development of the company.

In the era of big data, it is not easy to find the data needed. Therefore, data mining is an excellent way to optimize and use relevant information. Of course, data mining also has certain limitations, but it is clear that the advantages of data mining outweigh the disadvantages. This is also the reason why this paper chooses to use data mining to analyze the data.

3. Contrastive analysis

The purpose of contrastive analysis is to study the difference between two groups of a certain variable. If the variable is a discrete variable, we only need to use cross tab and chi-square tests. If the variable is continuous, we should first determine whether the variable follows a normal distribution, if it is normally distributed, then use the T test; if it is not normally distributed, then use the non-parametric test.

Next, we will explore the relationship between subscription type and churn and the relationship between usage frequency and churn. Among them, the subscription type is a discrete variable, while the frequency of use is a continuous variable. So, for subscription types, we should use cross tabs and chi-square checks; For the frequency of use, we need to determine whether it is normally distributed and use T test or non-parametric test.

Table 1. Case Processing Summary

Valid

Missing

Total

N

Percent

N

Percent

N

Percent

Churn*SubscriptionType

64374

100%

0

0.0%

64374

100%

Table 2. Churn*SubscriptionType Crosstabulation

SubscriptionType

1

2

3

Total

Churn 0

Count

11095

11325

11461

33881

%within Churn

32.7%

33.4%

33.8%

100%

%within SubscriptionTyp

51.7%

52.7%

53.5%

52.6%

%of Total

17.2%

17.6%

17.8%

52.6%

1

Count

10356

10177

9960

30493

%within Churn

34.0%

33.4%

32.7%

100.0%

%within SubscriptionTyp

48.3%

47.3%

46.5%

47.4%

%of Total

16.1%

15.8%

15.5%

47.4%

Total

Count

21451

21502

21421

64374

%within Churn

33.3%

33.4%

33.3%

100.0%

%within SubscriptionTyp

100.0%

100.0%

100.0%

100.0%

%of Total

33.3%

33.4%

33.3%

100.0%

Table 3: Chi-square Tests

Value

df

Asymptotic

Significance

(2-sided)

Pearson Chi-Square

13.6563

2

.001

Likelihood Ratio

13.656

2

.001

Linear-by-Linear

Association

13.637

1

<.001

N ofValid Cases

64374

a.0 cells (0.0%) have expected countless than 5.

The minimum expected countis 10146.81.

As we can see from the first table, this dataset contains a total of 64,374 sets of data, and the missing data is 0. In Table 2, there is a Churn*Subscription Type Cross tabulation, 0 and 1 in Churn represent customers who lost and customers who did not lose respectively. In the Subscription Type, 1, 2, and 3 represent the basic, standard, and premium subscription categories respectively. So we know that of the customers who didn't lose, 11,095 customers subscribed to basic, 11,325 customers subscribed to standard, and 11,461 customers subscribed to premium. Of the lost customers, 10,356 subscribed to basic, 10,177 to standard, and 9,960 to premium. In total, 21,451 customers subscribed to basic, 21,502 to standard, and 21,421 to premium. In Table 3, we can take 0.05 as the boundary, if it is less than 0.05, there is a significant difference in the subscription categories of the customers who lost and the customers who did not lose. Returning to the Cross tabulation, we can see that when churn is zero, 32.7% of non-churn users subscribe to basic, 33.4% subscribe to standard, and 33.8% subscribe to premium. When churn is 1, 34.0 percent of churn subscribers subscribe to basic, 33.4 percent subscribe to standard and 32.7 percent subscribe to premium. Then we can see that among the customers who do not lose, more people choose to subscribe to the premium; And among the lost customers, more people are willing to subscribe to basic.

Table 4. Data Summary of users

Chun

Slatistic

Std. Error

UsageFrequency

0

Mean

16.04

.046

95% Confidence Interval for

Mean

Lower Bound

15.95

Upper Bound

16.13

5% Trimmed Mean

16.09

Medlan

16.00

Varilance

70.642

Std. Devlation

8.405

Minmum

1

Maximun

30

Range

29

Interquartile Range

14

Skewness

-.038

.013

Kurtosis

-1.157

.027

1

Mean

14.01

.052

95% Confidence Interval for

Mean

Lower Bound

13.91

Upper Bound

14.11

5% Trimmed Mean

13.87

Medlan

14.00

Varilance

83.435

Std. Devlation

9.134

Minmum

1

Maximun

30

Range

29

Interquartile Range

17

Skewness

.159

.014

Kurtosis

-1.290

.028

This table tells us that the average usage frequency of non-churn customers was 16.04, while the average usage frequency of churn customers was 14.01. The mean difference is about 2, that is, users who do not churn have significantly higher frequency of use than those who churn, because their difference is greater than 0.05. The difference is mainly due to the fact that active customers subscribe more premium, while churn customers subscribe more basic.

There are certainly some extremes. For example, among non-churn customers, the lowest usage frequency of the customer is 1, while the highest usage frequency is 30. The minimum value of 1 May be because these customers like the product but do not have much time to use it. Among the lost customers, the lowest frequency of use of customers is also 1, and the highest frequency of use is 30. The maximum frequency of use is 30. What are the necessary reasons that may cause these customers to stop using the product.

Table 5. Tests of Normality

Kolmogorov-Smirnova

Churn

Statistic

df

Sig

UsageFrequency

0

.074

33881

<.001

1

.105

30493

<.001

a.Lilliefors Significance Correction

This table can determine whether it is a normal distribution by testing the significance of the loss group and the non-loss group. If it is greater than 0.05, the hypothesis of normal distribution is not rejected. If it is less than 0.05, the normal distribution hypothesis is rejected. So we can see that both of these significance reject the normal distribution hypothesis. Therefore, we need to do a non-parametric test.

Table 6. Hypothesis Test Summary

Nonparametric Tests

Hypothesis Test Summary

Null Hypothesis

Test

Sig.a.b

Decision

1

The distribution of

UsageFrequency is the same across categories of Churn.

Independent-Samples Mann-Whitney U Test

<.001

Reject the null hypothesis.

a.The significance level is .050.

b.Asymptotic significance is displayed

In this table, the null hypothesis states that the distribution of user frequency is the same in the churn category. But its significance is small, that is, the decision rejects the null hypothesis. This means that churn customers and non-churn customers do not use the same frequency, and active users have higher usage rates.

Table 7. KMO and Bartlett's Test

Kaiser-Meyer-Olkin Measure ofSampling Adequacy.

.515

Bartlett's Test of Sphericity

Approx. Chi-Square

549.224

df

6

Sig.

<.001

Table 8. Communalities

Initial

Extraction

CustomerlD

1.000

.481

Age

1.000

.419

UsageFrequency

1.000

.401

TotalSpend

1.000

.811

Extraction Method: Principal ComponentAnalysis.

Table 9. Total Variance Explained

Initial Eigenvalues

Extraction Sums of Squared Loadings

Component

Total

% of Variance

Cumulative %

Total

% of Variance

Cumulative %

1

1.101

27.536

27.536

1.101

27.536

27.536

2

1.011

25.278

52.814

1.011

25.278

52.814

3

.962

24.040

76.854

4

.926

23.146

100.000

Extraction Method: Principal ComponentAnalysis.

Both of the methods in the Table 7 can be used to test whether the data is suitable for factor analysis. The KMO in is a kind of test named by Kaiser, Mayer and Olkin, which is used to determine whether there is a significant correlation between variables. Normally, it will give a feedback between 0 and 1, if the value is bigger than 0.5, the variables are correlated. When the value in Bartlett’s Test of Sphericity is less than 0.05, there is a relationship between variables. Therefore, the data is suitable for factor analysis. In the Table 8, it gives out the name of variable, they are respectively Customer ID, Age, Usage Frequency and Total spend. And the value in Extraction means the amount of retained information in each variables after they are compressed into two variables. In the Table 9, these four variables are rearranged according to the amount of information, and the variable which contains the most amount of data will ranked first. Additionally, the variables after rearranging is independent, which can retain as much information as possible. Besides, the % of Variance can be understood as the amount of information to describe a variable, and the Cumulative % accumulates the information of first two variables.

For total variance explained, in four different components, the total initial eigenvalues which in descending arrangement lead to different percentage of several factors.

/word/media/image1.png

Figure 1. Independent-Samples Mann-Whitney U test

The usage frequency of lost and non-lost customers is visually displayed in the Independent Samples Mann-Whitney U Test. Among them, the blue bar graph represents the frequency of use of people who did not lose, while the red bar graph represents the frequency of use of people who lost. We can obviously see that the blue bar graph is much higher than the red bar graph, which means that the frequency of use for lost customers is generally higher than the frequency of use for lost customers. However, in the 0 to 10 usage frequency, there are more red than blue, meaning that there are more lost customers using the product during the 0 to 10 phase. Their loss may be due to the novelty of the product, and when the novelty has passed, they will no longer use the product.

Table 10. Component Matrix

Component Matrixa

Component

1

2

CustomerlD

.665

-.197

Age

.497

.414

UsageFrequency

-.602

-.195

TotalSpend

-.220

.873

Extraction Method:Principal componentAnalysis.

a.2 components extracted

For the component matrix, this table illustrate several components of different factors. Firstly, the first two line show the factor which contain consumer id and ages. The consumer id and ages in components1 is 665 and 497, while in component 2 is 197 and 414. Moreover, the last two line give the information of usage frequency and total spend. They are also inequal in two components, 602 and 195 for usage frequency when 220 and 873 for total spend. For the whole table, it uses principle component analysis as the extraction method. The value for the whole chart is higher than zero.

4. Discussion

From the analysis in the above sections, it shows that using data mining on customer churn datasets is good for both the customer and the company. First of all, it can help the company better understand the preferences of customers, so that the company can produce more products that consumers like and get more profits. Secondly, these data can help companies improve marketing efficiency, because they can clearly know what consumers want and don't want through these data. For customers, data mining tells the company what they like, and the company is able to produce more of that type of product, so consumers have more choice in what to buy. At the same time, the mining of data allows companies to price goods at a more reasonable price, so that customers can buy the goods they need at a price they can accept.

5. Conclusion

In this paper, we study the methods and techniques of customer churn data mining. We first introduce the concept and importance of customer churn, and point out the negative impact of customer churn on enterprises. Then, we analyze the existing methods of customer churn data mining.

In this study, we chose to use SPSS (Statistical Package for the Social Sciences) as our research tool. In this process, we use contrastive analysis, factor analysis and other methods to analyze the loss of customers. Through empirical research on real enterprise data, we demonstrate the validity and accuracy of our proposed model in predicting and identifying customer churn.

In addition, we used data visualization tools to show the characteristics and patterns of losing customers. By analyzing these visualizations, we are able to gain insight into the root causes and influencing factors that lead to customer churn, also, interesting trends and insights can be aimed at helping businesses make better decisions to improve their operations and services[5]. This provides guidance for enterprises to develop effective customer retention strategies.

In conclusion, this paper provides an effective method for enterprises to identify and predict customer churn through the research of customer churn data mining. Our results show that using algorithms, it is possible to accurately predict customer churn and gain insight into its root causes. This provides an important reference and decision-making basis for enterprises to retain customers and improve customer loyalty.


References

[1]. Tang, Longhui. Customer Churn Warning Model Based on Data Mining Technology. 2013, https://doi.org/[1]10.3969%20/%20j.i%20SSN.%202095-6835.2011.05.070.

[2]. Muhammad shahid, azeem. “Customer Churn Dataset.” Www.kaggle.com, 2023, www.kaggle.com/datasets/muhammadshahidazeem/customer-churn-dataset.

[3]. Renjith, Shini. “An Integrated Framework to Recommend Personalized Retention Actions to Control B2C E-Commerce Customer Churn.” International Journal of Engineering Trends and Technology, vol. 27, no. 3, 25 Sept. 2015, pp. 152–157, https://doi.org/10.14445/22315381/ijett-v27p227.

[4]. Equihua, Juan Pablo, et al. “Modelling Customer Churn for the Retail Industry in a Deep Learning Based Sequential Framework.” ArXiv.org, 2 Apr. 2023, arxiv.org/abs/2304.00575. Accessed 8 Mar. 2024.

[5]. Yang, Poh Yee, et al. “EXPLORING CONSUMER BEHAVIOUR PATTERNS and MODELLING CHURN PREDICTION in the FOOD DELIVERY SERVICE INDUSTRY: A CASESTUDY.” MyBib,Sept.2023,www.researchgate.net/publication/374614083_EXPLORING_CONSUMER_BEHAVIOUR_PATTERNS_AND_MODELLING_CHURN_PREDICTION_IN_THE_FOOD_DELIVERY_SERVICE_INDUSTRY_A_CASE_STUDY.a b


Cite this article

Jiang,X. (2024). Customer churn data analysis using data mining. Applied and Computational Engineering,77,17-24.

Data availability

The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.

Disclaimer/Publisher's Note

The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

About volume

Volume title: Proceedings of the 2nd International Conference on Software Engineering and Machine Learning

ISBN:978-1-83558-513-9(Print) / 978-1-83558-514-6(Online)
Editor:Stavros Shiaeles
Conference website: https://www.confseml.org/
Conference date: 15 May 2024
Series: Applied and Computational Engineering
Volume number: Vol.77
ISSN:2755-2721(Print) / 2755-273X(Online)

© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license. Authors who publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See Open access policy for details).

References

[1]. Tang, Longhui. Customer Churn Warning Model Based on Data Mining Technology. 2013, https://doi.org/[1]10.3969%20/%20j.i%20SSN.%202095-6835.2011.05.070.

[2]. Muhammad shahid, azeem. “Customer Churn Dataset.” Www.kaggle.com, 2023, www.kaggle.com/datasets/muhammadshahidazeem/customer-churn-dataset.

[3]. Renjith, Shini. “An Integrated Framework to Recommend Personalized Retention Actions to Control B2C E-Commerce Customer Churn.” International Journal of Engineering Trends and Technology, vol. 27, no. 3, 25 Sept. 2015, pp. 152–157, https://doi.org/10.14445/22315381/ijett-v27p227.

[4]. Equihua, Juan Pablo, et al. “Modelling Customer Churn for the Retail Industry in a Deep Learning Based Sequential Framework.” ArXiv.org, 2 Apr. 2023, arxiv.org/abs/2304.00575. Accessed 8 Mar. 2024.

[5]. Yang, Poh Yee, et al. “EXPLORING CONSUMER BEHAVIOUR PATTERNS and MODELLING CHURN PREDICTION in the FOOD DELIVERY SERVICE INDUSTRY: A CASESTUDY.” MyBib,Sept.2023,www.researchgate.net/publication/374614083_EXPLORING_CONSUMER_BEHAVIOUR_PATTERNS_AND_MODELLING_CHURN_PREDICTION_IN_THE_FOOD_DELIVERY_SERVICE_INDUSTRY_A_CASE_STUDY.a b