IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2608.04839.html

Exact Inference in Fixed-Effect Regressions with Concentrated Identifying Variation

Author

Listed:
  • Stanis{l}aw M. S. Halkiewicz

Abstract

In fixed-effect regressions with many groups, fixed effects can absorb most identifying variation, leaving a handful of observations to carry what remains. When variation is this concentrated, conventional $t$-tests can reject a true null more than half the time, and any fixed critical value is either invalid or so conservative it has essentially no power. This paper builds an exact test from the design alone. A \textit{nuisance-annihilating contrast} is a linear combination of the treatment and fixed-effect dummies that eliminates the fixed effects without touching the outcome; sign-flipping these contrasts is then an exact symmetry of the null distribution at every sample size, under arbitrary heteroskedasticity. In two-way designs --- worker-firm, firm-time --- these contrasts are exactly the cycles of the bipartite mobility graph, so the movement that identifies the treatment effect is what makes exact inference possible. Exactness costs power: relative to an oracle test, a chosen set of cycles has an observable \textit{capture ratio} $\kap\in[0,1]$ and standard-error premium $\kap^{-1/2}$, and a packing algorithm resolves the capture-granularity trade-off. In the Grunfeld investment regression (single-observation score concentration $73.9\%$), 32 cycle contrasts capture $\kap=0.627$ of the identifying variation, giving an exact $95\%$ confidence interval of $[0.150,\,0.450]$.

Suggested Citation

  • Stanis{l}aw M. S. Halkiewicz, 2026. "Exact Inference in Fixed-Effect Regressions with Concentrated Identifying Variation," Papers 2608.04839, arXiv.org, revised Aug 2026.
  • Handle: RePEc:arx:papers:2608.04839
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2608.04839
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Deniz Dutz & Xinyi Zhang, 2025. "Limitations of Randomization Tests in Finite Samples," Papers 2512.07099, arXiv.org, revised Aug 2026.
    2. Lihua Lei & Peter J Bickel, 2021. "An assumption-free exact test for fixed-design linear models with exchangeable errors [Rank tests of sub-hypotheses in the general linear regression]," Biometrika, Biometrika Trust, vol. 108(2), pages 397-412.
    3. Piotroski, JD, 2000. "Value investing: The use of historical financial statement information to separate winners from losers," Journal of Accounting Research, John Wiley & Sons, Ltd., vol. 38, pages 1-41.
    4. Matias D. Cattaneo & Michael Jansson & Whitney K. Newey, 2018. "Inference in Linear Regression Models with Many Covariates and Heteroscedasticity," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(523), pages 1350-1361, July.
    5. Kleiber Christian & Zeileis Achim, 2010. "The Grunfeld Data at 50," German Economic Review, De Gruyter, vol. 11(4), pages 404-417, December.
    6. Koen Jochmans & Martin Weidner, 2019. "Fixed‐Effect Regressions on Network Data," Econometrica, Econometric Society, vol. 87(5), pages 1543-1560, September.
    7. N W Koning & J Hemerik, 2024. "More efficient exact group invariance testing: using a representative subgroup," Biometrika, Biometrika Trust, vol. 111(2), pages 441-458.
    8. Andrews, Donald W.K. & Guggenberger, Patrik, 2017. "Asymptotic Size Of Kleibergen’S Lm And Conditional Lr Tests For Moment Condition Models," Econometric Theory, Cambridge University Press, vol. 33(5), pages 1046-1080, October.
    9. Cyrus J. DiCiccio & Joseph P. Romano, 2017. "Robust Permutation Tests For Correlation And Regression Coefficients," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1211-1220, July.
    10. MacKinnon, James G. & White, Halbert, 1985. "Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties," Journal of Econometrics, Elsevier, vol. 29(3), pages 305-325, September.
    11. Patrick Kline & Raffaele Saggio & Mikkel Sølvsten, 2020. "Leave‐Out Estimation of Variance Components," Econometrica, Econometric Society, vol. 88(5), pages 1859-1898, September.
    12. Riccardo De Santis & Jelle J. Goeman & Jesse Hemerik & Samuel Davenport & Livio Finos, 2025. "Inference in Generalized Linear Models with Robustness to Misspecified Variances," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 120(552), pages 2762-2771, October.
    13. Purevdorj Tuvaandorj, 2025. "Robust Permutation Tests in Linear Instrumental Variables Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 120(550), pages 1294-1304, April.
    14. Koen Jochmans, 2022. "Heteroscedasticity-Robust Inference in Linear Regression Models With Many Covariates," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(538), pages 887-896, April.
    15. Ivan A. Canay & Joseph P. Romano & Azeem M. Shaikh, 2017. "Randomization Tests Under an Approximate Symmetry Assumption," Econometrica, Econometric Society, vol. 85, pages 1013-1030, May.
    16. Anna Mikusheva & Mikkel Sølvsten, 2025. "Linear regression with weak exogeneity," Quantitative Economics, Econometric Society, vol. 16(2), pages 367-403, May.
    17. Jesse Hemerik & Jelle Goeman, 2018. "Exact testing with random permutations," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 27(4), pages 811-825, December.
    18. Jesse Hemerik & Jelle J. Goeman & Livio Finos, 2020. "Robust testing in generalized linear models by sign flipping score contributions," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(3), pages 841-864, July.
    19. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    20. Aaditya Ramdas & Rina Foygel Barber & Emmanuel J. Candès & Ryan J. Tibshirani, 2023. "Permutation Tests Using Arbitrary Permutation Distributions," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 85(2), pages 1156-1177, August.
    21. Ibragimov, Rustam & Müller, Ulrich K., 2010. "t-Statistic Based Correlation and Heterogeneity Robust Inference," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(4), pages 453-468.
    22. Ivan A. Canay & Andres Santos & Azeem M. Shaikh, 2021. "The Wild Bootstrap with a “Small” Number of “Large” Clusters," The Review of Economics and Statistics, MIT Press, vol. 103(2), pages 346-363, May.
    23. Wen, Kaiyue & Wang, Tengyao & Wang, Yuhao, 2025. "Residual permutation test for regression coefficient testing," LSE Research Online Documents on Economics 126275, London School of Economics and Political Science, LSE Library.
    24. Cattaneo, Matias D. & Jansson, Michael & Newey, Whitney K., 2018. "Alternative Asymptotics And The Partially Linear Model With Many Regressors," Econometric Theory, Cambridge University Press, vol. 34(2), pages 277-301, April.
    25. repec:bla:germec:v:11:y:2010:i::p:404-417 is not listed on IDEAS
    26. Andrews, Donald W.K. & Cheng, Xu, 2014. "Gmm Estimation And Uniform Subvector Inference With Possible Identification Failure," Econometric Theory, Cambridge University Press, vol. 30(2), pages 287-333, April.
    27. Xavier D'Haultfœuille & Purevdorj Tuvaandorj, 2024. "A robust permutation test for subvector inference in linear regressions," Quantitative Economics, Econometric Society, vol. 15(1), pages 27-87, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. David M. Ritzwoller & Joseph P. Romano & Azeem M. Shaikh, 2024. "Randomization Inference: Theory and Applications," Papers 2406.09521, arXiv.org, revised Feb 2025.
    2. Stanis{l}aw M. S. Halkiewicz, 2026. "Variance Estimation for Saturated Fixed-Effect Specifications," Papers 2607.05215, arXiv.org.
    3. Valentin Verdier, 2020. "Estimation and Inference for Linear Models with Two-Way Fixed Effects and Sparsely Matched Data," The Review of Economics and Statistics, MIT Press, vol. 102(1), pages 1-16, March.
    4. Stanis{l}aw M. S. Halkiewicz, 2026. "Breakdown Reliability for Saturated Fixed-Effect Inference," Papers 2608.06053, arXiv.org, revised Sep 2026.
    5. Wang, Tianyi & Wang, Guanghui & Wang, Zhaojun & Zou, Changliang, 2026. "Power enhancement of permutation-augmented partial-correlation tests via fixed-row permutations," Statistics & Probability Letters, Elsevier, vol. 230(C).
    6. Anatolyev, Stanislav, 2026. "AIC for many-regressor heteroskedastic regressions," Journal of Econometrics, Elsevier, vol. 256(PA).
    7. Jiang, Liang & Li, Liyao & Miao, Ke & Zhang, Yichong, 2025. "Adjustments with many regressors under covariate-adaptive randomizations," Journal of Econometrics, Elsevier, vol. 249(PB).
    8. Kline, Patrick, 2024. "Firm wage effects," Handbook of Labor Economics,, Elsevier.
    9. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Cluster-robust inference: A guide to empirical practice," Journal of Econometrics, Elsevier, vol. 232(2), pages 272-299.
    10. Patrick Kline & Raffaele Saggio & Mikkel Sølvsten, 2020. "Leave‐Out Estimation of Variance Components," Econometrica, Econometric Society, vol. 88(5), pages 1859-1898, September.
    11. Anatolyev, Stanislav & Sølvsten, Mikkel, 2023. "Testing many restrictions under heteroskedasticity," Journal of Econometrics, Elsevier, vol. 236(1).
    12. Pötscher, Benedikt M. & Preinerstorfer, David, 2025. "Valid Heteroskedasticity Robust Testing," Econometric Theory, Cambridge University Press, vol. 41(2), pages 249-301, April.
    13. Purevdorj Tuvaandorj, 2021. "Robust Permutation Tests in Linear Instrumental Variables Regression," Papers 2111.13774, arXiv.org, revised Jul 2024.
    14. Cai, Yong & Rafi, Ahnaf, 2024. "On the performance of the Neyman Allocation with small pilots," Journal of Econometrics, Elsevier, vol. 242(1).
    15. St'ephane Bonhomme & Koen Jochmans & Whitney K. Newey & Martin Weidner, 2026. "Higher-Order Neyman Orthogonality in Moment-Condition Models," Papers 2605.10842, arXiv.org, revised Oct 2026.
    16. Jochmans, K., 2019. "Heteroskedasticity-Robust Inference in Linear Regression Models," Cambridge Working Papers in Economics 1957, Faculty of Economics, University of Cambridge.
    17. Anatolyev, Stanislav, 2021. "Mallows criterion for heteroskedastic linear regressions with many regressors," Economics Letters, Elsevier, vol. 203(C).
    18. Stefano DellaVigna & Guido Imbens & Woojin Kim & David M. Ritzwoller, 2025. "Using Multiple Outcomes to Adjust Standard Errors for Spatial Correlation," NBER Working Papers 33716, National Bureau of Economic Research, Inc.
    19. Kaspar Wuthrich & Ying Zhu, 2019. "Omitted variable bias of Lasso-based inference methods: A finite sample analysis," Papers 1903.08704, arXiv.org, revised Sep 2021.
    20. Deniz Dutz & Xinyi Zhang, 2025. "Limitations of Randomization Tests in Finite Samples," Papers 2512.07099, arXiv.org, revised Aug 2026.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2608.04839. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.