Author
Listed:
- Lei Kang
(Computer Vision Center, Universitat Autònoma de Barcelona, 08193 Barcelona, Spain
These authors contributed equally to this work.)
- Xuanshuo Fu
(Computer Vision Center, Universitat Autònoma de Barcelona, 08193 Barcelona, Spain
These authors contributed equally to this work.)
- Mohamed Ali Souibgui
(Computer Vision Center, Universitat Autònoma de Barcelona, 08193 Barcelona, Spain)
- Andrey Barsky
(Computer Vision Center, Universitat Autònoma de Barcelona, 08193 Barcelona, Spain)
- Lluis Gomez
(Computer Vision Center, Universitat Autònoma de Barcelona, 08193 Barcelona, Spain)
- Javier Vazquez-Corral
(Computer Vision Center, Universitat Autònoma de Barcelona, 08193 Barcelona, Spain)
- Alicia Fornés
(Computer Vision Center, Universitat Autònoma de Barcelona, 08193 Barcelona, Spain)
- Ernest Valveny
(Computer Vision Center, Universitat Autònoma de Barcelona, 08193 Barcelona, Spain)
- Dimosthenis Karatzas
(Computer Vision Center, Universitat Autònoma de Barcelona, 08193 Barcelona, Spain)
Abstract
Grid structured visual data such as forms, tables, and game boards require models that pair pixel level perception with symbolic consistency under global constraints. Recent Pixel Language Models (PLMs) map images to token sequences with promising flexibility, yet we find they generalize poorly when observable evidence becomes sparse or corrupted. We present GridMNIST-Sudoku, a benchmark that renders large numbers of Sudoku instances with style diverse handwritten digits and provides parameterized stress tracks for two tasks: Completion (predict missing cells) and Correction (detect and repair incorrect cells) across difficulty levels ranging from 1 to 90 altered positions in a 9 × 9 grid. Attention diagnostics on PLMs trained with conventional one dimensional positional encodings reveal weak structure awareness outside the natural Sudoku sparsity band. Motivated by these findings, we propose a lightweight Row-Column-Box (RCB) positional prior that injects grid aligned coordinates and combine it with simple sparsity and corruption augmentations. Trained only on the natural distribution, the resulting model substantially improves out of distribution accuracy across wide sparsity and corruption ranges while maintaining strong in distribution performance.
Suggested Citation
Lei Kang & Xuanshuo Fu & Mohamed Ali Souibgui & Andrey Barsky & Lluis Gomez & Javier Vazquez-Corral & Alicia Fornés & Ernest Valveny & Dimosthenis Karatzas, 2025.
"A Benchmark for Symbolic Reasoning from Pixel Sequences: Grid-Level Visual Completion and Correction,"
Mathematics, MDPI, vol. 13(17), pages 1-14, September.
Handle:
RePEc:gam:jmathe:v:13:y:2025:i:17:p:2851-:d:1741786
Download full text from publisher
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:13:y:2025:i:17:p:2851-:d:1741786. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
We have no bibliographic references for this item. You can help adding them by using this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .
Please note that corrections may take a couple of weeks to filter through
the various RePEc services.