1. Introduction
With finance and economics constantly evolving, making accurate predictions about complex systems is a must for those analyzing stock market behavior, forecasting economic indicators such as exchange rates and inflation, as well as evaluating the impact of policies. Two commonly used methods in these fields are regression analysis and autoregressive integrated moving average (ARIMA) models. Under these approaches, the accuracy of conclusions drawn from a model heavily relies on the validity of the model assumptions. Many models of stock returns assume that these returns are random, which is essential for deriving useful information from the data. In addition to studying the distribution of returns, model validation often involves looking at residuals, which are simply differences between observed values and values predicted by the model. The key is that these residuals should be random. The White Noise Hypothesis Test is an excellent tool for analyzing residuals and determining whether they are random or contain patterns and correlations. By testing these patterns, analysts can check whether their models are valid, based on the two key assumptions of regression analysis, and determine whether they have captured all the useful information about the system under study. In this paper, we discuss the use of the White Noise Hypothesis Test in stock market analysis, risk management, economic forecasting, policy analysis, and other applications where prediction of future events or outcomes is important [1]. We illustrate the use of the test by solving a number of simulated examples.
2. Regression Analysis
2.1. Residual Independence
This assumption of independence of residuals extends to the mathematical basis upon which the regression models themselves are defined, and a regression model will reliably give valid parameter estimates and hence valid model prediction and model-based hypothesis tests only if this assumption is satisfied. Violation of the independence assumption implies serial correlation, by which is meant that the error in one observation is related to the error in another, and this serial correlation can severely distort estimates. The dependence of valid model-based inference on the assumption that the residuals are independently distributed is such an important issue that statistical packages include the White Noise Hypothesis Test to assess whether they are or not. The Durbin-Watson statistic and similar techniques measure the amount of correlation between the residuals and detect any pattern in the residuals that is not commensurate with randomness. When such a pattern is detected, this implies that the model does not capture all the information in the data, hence the results of modelling it are unreliable, and further work on specifying the model is required to reduce or eliminate the serial correlation, through adding lagged variables, for example, or reconsidering the model structure [2].
Regression analysis uses the Durbin-Watson (or DW) statistic to test for residual independence when it is time-ordered data by calculating serial correlation in the residuals
\( DW=\frac{\sum _{i=2}^{n}{({ε_{i}}-{ε_{i-1}})^{2}}}{\sum _{i=1}^{n}ε_{i}^{2}}\ \ \ (1) \)
This statistic provides a measure of the correlation between residuals, with values close to 2 indicating independence and deviations suggesting potential serial correlation that may require model refinement.
2.2. Homoscedasticity
Homoscedasticity is the assumption that the variance of the residuals remains constant across all values of the independent variables. It is important in the regression context because it means that the model makes equally accurate predictions across the range of the data, and unrestricted heteroscedasticity allows for inefficiencies and/or biases in parameter estimation. When heteroscedasticity is present, the predictive precision of the least squares estimators is compromised, leading to biased standard errors for the estimates, and (sometimes) misleading results in hypothesis testing. Heteroscedasticity can be assessed using a White Noise Hypothesis Test, with either the Breusch-Pagan test or White’s test being commonly used to determine whether the variance of the residuals tends to vary across the range of values of the independent variable [3]. When heteroscedasticity is present, it is possible to handle such instances when estimating the parameters with variables that may be transformed to address the issue (such as the logarithmic transformation), using weighted least squares, or when none of the other approaches are viable, one can use robust standard errors.
2.3. Model Fit and Adequacy
Furthermore, in addition to evaluating residual independence and homoscedasticity of the regression model, the White Noise Hypothes in evaluating whether the model fits the data ade call its ‘goodness, the fit of the model is assessed using the standard metrics such as R-squared and adjusted R-squared, which assess what proportion of the variance in the dependent variable the model accounts for. However, these metrics ignore serial correlation (or heteroscedasticity) in the model residuals, and so do not detect systematic patterns (or lack thereof) in the residuals that might reflect model mis-specifications. Often, however, as one investigates the residuals more closely, they detect patterns or lack thereof that could be interpreted as model mis-specifications, which leads to running the model again, this time with additional terms, such as interactions, squared terms (ie, polynomials), or transformations of the data [4]. In other words, analysts can use insights gleaned from residual analysis to improve the accuracy and robustness of their models.
3. ARIMA Models
3.1. Residual White Noise Testing
The White Noise Hypothesis Test of the residuals is a critical step to making the ARIMA model, since it confirms that the residuals from a fitted model do in fact display white-noise properties. The ARIMA model, which contains both an autoregressive (AR) and a moving-average (MA) component, has the assumption that, after you fit the model, the residuals will be uncorrelated and homoscedastic - that is, close to a white-noise process. This is one indicator that all the available patterning in the time series is explained by the fitted ARIMA model. The White Noise Hypothesis Test of the residuals, such as the Ljung-Box test, checks to make sure that the residuals do not display autocorrelation or other non-random patterns. If the residuals do not produce white noise, this is a sign that the data’s temporal dependencies are not well-captured, and that you need to further tweak your model. You might want to re-fit the AR, MA, and/or seasonal order of your model. You might also want to difference the data (ie, the unit root test) if it is still non-stationary. In any case, you want to make sure that the residuals are white noise, or else you cannot be fully confident in the adequacy of your model -and thus of your forecasts [5].
The Ljung-Box test is used to check if the residuals of an ARIMA model are autocorrelated or show other non-random patterns, to test whether the residuals are white noise, represented by this statistic:
\( Q=n(n+2)\sum _{k=1}^{h}\frac{\hat{ρ}_{k}^{2}}{n-k}\ \ \ (2) \)
This statistic assesses the independence of residuals, with larger values indicating that the residuals are not white noise, which may require further model refinement [6].
3.2. Model Selection and Diagnostics
Coupling the appropriate ARIMA model with the data is a key step in time series analysis, which determines whether the chosen model captures the underlying dynamics of the data with sufficient accuracy. Model selection is a process that typically involves the comparison of different ARIMA specifications using criteria such as the Akaike Information Criterion (AIC) or Bayesian Information Criterion (BIC), which are both criteria balance fit and complexity. In this process, the WNHT plays a vital role by examining the adequacy of different models. The examination of the properties of the residuals will shed light on whether they were produced by a model that successfully nails the dynamics of the data. The WNHT serves as a diagnostic check that enhances the model selection criteria procedure by ensuring that the model produces residuals that are independent and free from any systematic patterns. This iterative process of model selection, estimation and validation produces a parsimonious and accurate ARIMA model with sufficient predictive ability and provides insights into the future of the time series of interest.
3.3. Improving Model Performance
So we need to continuously monitor the residuals from a fitted ARIMA model via the White Noise Hypothesis Test, so that we can revisit our model and see whether no systematic changes or drifts have occurred since the last fit, potentially tweaking the model (and the forecasters themselves) to improve performance. It can be a hard lesson for new time series analysts to learn, but if the residuals stop looking like white noise, it can help to reconsider the adequacy of the model or the structure of the underlying time series dynamical process. For example, if the residuals begin to exhibit a different autocorrelation structure than expected, it could be a cue to come up with a different model structure. Re-estimation of the model parameters or the inclusion of additional explanatory variables might be necessary. It could also be that the original time series itself underwent a structural change, drift or shift relative to the model, necessitating maintenance to sustain the model’s performance over time. Like any mathematical or statistical model that aims to capture the essence of noisy process data that can be unpredictable because they evolve over time, it’s important to provide for allowing the model some degree of ‘breathing room’, rather than insisting that the actual data have to obey a model’s strict assumptions and expectations [7].
4. Applications in Finance
4.1. Stock Market Analysis
In finance, regression analysis and ARIMA models are used to analyse stock market behaviour to predict future prices. The White Noise Hypothesis Test helps in the validation of these models to see if residuals have patterns that could lead to incorrect conclusions about predictive accuracy. The stock market is by definition factors, including economic indicators, geopolitical events and investor sentiments. By using the White Noise Hypothesis Test, analysts can make sure their models, such as the ones to analyse stock prices or returns, are not missing any information. This is an indication prices fully reflect all available information. Models that have residuals that appear to be similar to white noise would indicate that price changes are random and cannot be predicted – market efficiency and the Efficient Market Hypothesis (EMH) would then be confirmed. The use of white noise tests for the validation finance models would help analysts have confidence in their ability to detect trends, assess risks and make the right investment decisions that are guided by market dynamics and investors’ objectives [8]. Table 1 is a simulated analysis of stock market behaviour using regression analysis and ARIMA models. The table helps us assess whether models capture the dynamics of the stock market.
Table 1. Stock Market Analysis Using White Noise Hypothesis Test
Date | Stock_Price | Predicted_ Price | Residuals | Autocorre-lation | Ljung-Box_Stat | White_Noise_ Conclu-sion |
2024/1/31 | 108.8202617 | 100.7202179 | -2.552989816 | 0.088749616 | 1.64559892 | Fail |
2024/2/29 | 102.000786 | 107.2713675 | 0.653618595 | 0.03636406 | 1.882182778 | Pass |
2024/3/31 | 104.8936899 | 103.8051886 | 0.864436199 | -0.02809842 | 2.893964175 | Pass |
2024/4/30 | 111.204466 | 100.6083751 | -0.74216502 | -0.012593609 | 2.249147416 | Pass |
2024/5/31 | 109.33779 | 102.2193162 | 2.269754624 | 0.039526239 | 4.943031806 | Pass |
2024/6/30 | 95.1136106 | 101.6683716 | -1.454365675 | -0.087954906 | 0.600019573 | Fail |
2024/7/31 | 104.7504421 | 107.4703954 | 0.045758517 | 0.033353343 | 1.123496105 | Pass |
2024/8/31 | 99.24321396 | 98.97420868 | -0.18718385 | 0.034127574 | 0.890416638 | Pass |
2024/9/30 | 99.48390574 | 101.5653385 | 1.532779214 | -0.057923488 | 3.300230795 | Fail |
2024/10/31 | 102.0529925 | 95.7295213 | 1.46935877 | -0.07421474 | 1.341128852 | Fail |
4.2. Risk Management
The accurate modelling of such a financial time series is critical for effective and precise risk management. Models are used by financial institutions to assess market risks as well as interest rate fluctuations, volatility and credit risk. The White Noise Hypothesis Test is used to assess if the residuals have the characteristics of white noise, which indicates that the model captures most of the relevant risk factors. If a model passes the white noise test, then it is appropriate to use the model to evaluate its ability in identifying potential risk exposures and form the strategic risk management decisions. This part illustrates how to prevent the risk models from missing some crucial information that could affect the predictive accuracy of the model. The white noise tests used to validate the models could help the risk managers to form a better prediction in the markets, seek for and hence enhance the stability in financial systems over the whole economic cycle. Figure 1 shows the percentage of models passing the white noise test and those failing it [9]. It suggests that those models passing the white noise test are appropriate to be used for risk management.
Figure 1. Risk Management Model Validation Using White Noise Test
5. Applications in Economics
5.1. Economic Forecasting
Several of the most common models used by economists to forecast key indicators such as GDP growth, inflation or unemployment rates are traditional ARIMA models. Policymakers, business and investors depend on their predictions to make decisions about the future course of the economy. For this reason, it is essential that these models’ predictions are accurate. This is where the White Noise Hypothesis Test comes into play: by establishing whether a model’s residuals exhibit autocorrelation or any other pattern that would compromise its forecasting reliability. A model that passes the white noise test is one in which its predictions are less likely to be skewed by any non-random pattern in the residuals; it is the outcome of a model that has been able to capture the underlying dynamics of the economic series under consideration. As we have seen, the white noise test is used to evaluate the fit of a model to an economic series. A validated model is one that entails more credible predictions for future economic conditions [10]. By ensuring that models meet the criteria of white noise, forecasters are providing more accurate predictions that help followers of the economic process make better policy and business decisions based on expected future economic conditions.
5.2. Policy Analysis
One important application is in policy analysis, where regression models are used to estimate the effects of different interventions and reforms on various economic and social outcomes. Policymakers and researchers rely on estimated models to evaluate interventions, such as tax reforms, subsidy programmes or regulatory reforms, to determine their effectiveness. If the core assumptions of the models – that the residuals are independent across individuals and homoscedastic across the sample – are falsified, then the results of these models cannot be trusted, and they become potentially useless for policy inferences. Models that pass the White Noise Hypothesis Test suggest that the policy instruments observed in the data have been sufficiently modelled in the regression equation, and that the residuals ‘look like white noise’, which therefore confirms the absence of bias in the model estimates.
6. Conclusion
The White Noise Hypothesis Test is therefore a crucial tool in validating statistical models in the context of financial and economic analysis, thereby leading to more credible and robust predictions. Confirming the independence and homoscedasticity of regression analysis residuals, and ensuring that the residuals of an ARIMA model are truly white noise, analysts can boost the integrity of models used for various financial and economic applications including stock analysis, economic forecasting and policy evaluation. Through the systematic application of white noise tests, analysts have the opportunity to detect model inadequacies and provide more reliable predictions that will impact future investment decisions. In an era where financial and economic systems are becoming increasingly more integrated, the adoption of white noise tests in processes of model validation represents an important step forward in strengthening the epistemic foundations of modelling, thereby allowing for better detection of destabilizing processes in uncertain environments.
References
[1]. Kim, Mihyun, Piotr Kokoszka, and Gregory Rice. "Projection-based white noise and goodness-of-fit tests for functional time series." Statistical Inference for Stochastic Processes (2024): 1-32.
[2]. Awan, Jordan, and Salil Vadhan. "Canonical noise distributions and private hypothesis tests." The Annals of Statistics 51.2 (2023): 547-572.
[3]. Kretschmann, Remo, Daniel Wachsmuth, and Frank Werner. "Optimal regularized hypothesis testing in statistical inverse problems." Inverse Problems 40.1 (2023): 015013.
[4]. Leonardo, Dominikus, Muhammad Maulana, and Justin Hartanto. "Impact of economic growth and FDI on Indonesia environmental degradation: EKC and pollution hypothesis testing." Jurnal Ekonomi Pembangunan 21.01 (2023): 15-30.
[5]. Gerber, Patrik Róbert. Likelihood-Free Hypothesis Testing and Applications of the Energy Distance. Diss. Massachusetts Institute of Technology, 2024.
[6]. Cavorsi, Matthew, et al. "Exploiting trust for resilient hypothesis testing with malicious robots." 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2023.
[7]. Sherman, Sage O., et al. "Effects of additive sensory noise on cognition." Frontiers in Human Neuroscience 17 (2023): 1092154.
[8]. Dey, Bishal, et al. "Forecasting ethanol demand in India to meet future blending targets: A comparison of ARIMA and various regression models." Energy Reports 9 (2023): 411-418.
[9]. Alsuwaylimi, Amjad A. "Comparison of ARIMA, ANN and Hybrid ARIMA-ANN models for time series forecasting." Inf. Sci. Lett 12.2 (2023): 1003-1016.
[10]. Kuryłek, Wojciech. "The modeling of earnings per share of Polish companies for the post-financial crisis periodusing random walk and ARIMA models." Journal of Banking and Financial Economics 19.1 (2023): 26-43.
Cite this article
Luo,L. (2024). Statistical model validation through white noise hypothesis testing in regression analysis and ARIMA models. Theoretical and Natural Science,42,227-232.
Data availability
The datasets used and/or analyzed during the current study will be available from the authors upon reasonable request.
Disclaimer/Publisher's Note
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of EWA Publishing and/or the editor(s). EWA Publishing and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.
About volume
Volume title: Proceedings of the 2nd International Conference on Mathematical Physics and Computational Simulation
© 2024 by the author(s). Licensee EWA Publishing, Oxford, UK. This article is an open access article distributed under the terms and
conditions of the Creative Commons Attribution (CC BY) license. Authors who
publish this series agree to the following terms:
1. Authors retain copyright and grant the series right of first publication with the work simultaneously licensed under a Creative Commons
Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this
series.
2. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the series's published
version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial
publication in this series.
3. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and
during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See
Open access policy for details).
References
[1]. Kim, Mihyun, Piotr Kokoszka, and Gregory Rice. "Projection-based white noise and goodness-of-fit tests for functional time series." Statistical Inference for Stochastic Processes (2024): 1-32.
[2]. Awan, Jordan, and Salil Vadhan. "Canonical noise distributions and private hypothesis tests." The Annals of Statistics 51.2 (2023): 547-572.
[3]. Kretschmann, Remo, Daniel Wachsmuth, and Frank Werner. "Optimal regularized hypothesis testing in statistical inverse problems." Inverse Problems 40.1 (2023): 015013.
[4]. Leonardo, Dominikus, Muhammad Maulana, and Justin Hartanto. "Impact of economic growth and FDI on Indonesia environmental degradation: EKC and pollution hypothesis testing." Jurnal Ekonomi Pembangunan 21.01 (2023): 15-30.
[5]. Gerber, Patrik Róbert. Likelihood-Free Hypothesis Testing and Applications of the Energy Distance. Diss. Massachusetts Institute of Technology, 2024.
[6]. Cavorsi, Matthew, et al. "Exploiting trust for resilient hypothesis testing with malicious robots." 2023 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2023.
[7]. Sherman, Sage O., et al. "Effects of additive sensory noise on cognition." Frontiers in Human Neuroscience 17 (2023): 1092154.
[8]. Dey, Bishal, et al. "Forecasting ethanol demand in India to meet future blending targets: A comparison of ARIMA and various regression models." Energy Reports 9 (2023): 411-418.
[9]. Alsuwaylimi, Amjad A. "Comparison of ARIMA, ANN and Hybrid ARIMA-ANN models for time series forecasting." Inf. Sci. Lett 12.2 (2023): 1003-1016.
[10]. Kuryłek, Wojciech. "The modeling of earnings per share of Polish companies for the post-financial crisis periodusing random walk and ARIMA models." Journal of Banking and Financial Economics 19.1 (2023): 26-43.