Does Yield Spread Selection Predict Recession Probability? A Machine Learning Approach!
Artificial Intelligence & Machine Learning
Review of the Research Paper: Yield Spread Selection in Predicting Recession Probabilities: A Machine Learning Approach
Authored by Jaehyuk Choi, Desheng Ge, Kyu H. Kang, and Sungbin Sohn, this research paper delves into the longstanding economic question of using yield curves to predict recessions, with a novel approach leveraging machine learning (ML) for optimal pair selection and coefficient estimation. The study is a comprehensive and rigorous examination of the predictive power of the yield spread, offering valuable insights for policymakers, economists, and market analysts.
- Novel Use of Machine Learning:
- The authors utilize logistic regression with L1 regularization, a robust ML technique, to identify the best maturity pair of Treasury yields for recession forecasting.
- This approach systematically accounts for high-dimensional data and penalizes irrelevant features, enhancing the reliability of the model’s outputs.
- Comprehensive Dataset:
- The study uses data spanning nearly 60 years (1961–2020), providing a robust sample for analysis.
- The inclusion of Treasury yields of varying maturities (three months to 20 years) ensures broad representation of market conditions over time.
- Validation of the Conventional Spread:
- Despite the novel methodology, the authors conclude that the 10-year–three-month yield spread, a standard in economic forecasting, remains a reliable predictor of recessions.
- This finding bolsters the credibility of existing practices while highlighting the challenges of improving them with advanced techniques.
- Rigorous Analysis:
- The paper examines multiple forecasting horizons, alternative training/test splits, and handles issues like imbalanced data and missing variables.
- These robustness checks ensure the results are consistent and generalizable.
- Practical Implications:
- The findings reinforce the use of term spreads as simple yet effective indicators of recession probabilities.
- Policymakers and financial professionals can continue relying on the 10-year–three-month spread without concerns about missed opportunities from alternative pairings.
Results?
- Optimal Maturity Pairing:
- The ML model often selected pairs other than the traditional 10-year–three-month spread, such as 10-year and six-month yields for short-term horizons and 20-year and three-month yields for longer horizons.
- These results align with the idea that longer-term yields reflect expectations about distant economic conditions.
- Role of Short-Term Yields:
- The coefficients of short-term yields often carried greater magnitude, suggesting that short-term interest rates have a more pronounced role in predicting recessions than previously acknowledged.
- Estimation Error and Generalization:
- Despite the initial promise of the ML approach, out-of-sample prediction accuracy did not significantly improve due to estimation risk (errors arising from model complexity and finite data).
- Robustness:
- The conclusions held across varying forecasting horizons, control variables, sample periods, and techniques for addressing imbalanced datasets.
More good stuff!
- Estimation Risk:
- The study underscores the difficulty of improving upon established models due to the trade-off between flexibility and prediction accuracy. While ML introduces theoretical improvements, practical applications remain constrained by data limitations and overfitting risks.
- Complexity vs. Simplicity:
- The paper highlights the elegance and effectiveness of the traditional spread over more complex ML approaches, emphasizing the principle of parsimony in economic modeling.
- Limited Exploration of Nonlinear Models:
- While the study uses logistic regression, exploring nonlinear machine learning techniques (e.g., neural networks or decision trees) could further test whether prediction accuracy might improve with advanced methodologies.
Contributions to our Field?
- Reinforces Existing Practices:
- By justifying the continued use of the 10-year–three-month spread, the study provides clarity and confidence for practitioners relying on this metric.
- Advances Methodological Understanding:
- The paper demonstrates how ML can be applied to economic questions, even if the results show the limitations of such methods.
- Framework for Future Research:
- The authors establish a methodological framework for examining other economic indicators or refining the use of term spreads in predicting macroeconomic phenomena.
Practical Implications:
- Policy Making:
- Policymakers can confidently use the traditional term spread for recession forecasting without fearing significant loss of accuracy compared to ML-driven alternatives.
- Financial Markets:
- The findings reaffirm the utility of yield curves as straightforward and reliable tools for assessing economic risk, benefiting investors and analysts.
The research by Choi et al. is an excellent contribution to the intersection of economic modeling and machine learning. While it does not propose a breakthrough improvement over traditional practices, its comprehensive analysis validates the robustness of the 10-year–three-month spread while illuminating the limitations of modern ML techniques in this context. The paper serves as a reminder of the balance between simplicity and complexity in economic forecasting, encouraging further exploration of how ML can complement traditional models without undermining their practicality and reliability.
Read the full paper:



