Author
Listed:
- Qinying Zhu
(College of Information and Intelligence, Hunan Agricultural University, Changsha 410128, China)
- Yilin Zhang
(College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, China)
- Peng Xiao
(School of Computer, Hunan University of Technology, Zhuzhou 412007, China)
- Mengxi Ying
(School of Computer, Hunan University of Technology, Zhuzhou 412007, China)
- Lei Zhu
(College of Information and Intelligence, Hunan Agricultural University, Changsha 410128, China)
- Chengyuan Zhang
(College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, China)
Abstract
Few-shot instance segmentation (FSIS) is devised to address the intricate challenge of instance segmentation when labeled data for novel classes is scant. Nevertheless, existing methodologies encounter notable constraints in the agile expansion of novel classes and the management of memory overhead. The integration workflow for novel classes is inflexible, and given the necessity of retaining class exemplars during both training and inference stages, considerable memory consumption ensues. To surmount these challenges, this study introduces an innovative framework encompassing a two-stage “base training-novel class fine-tuning” paradigm. It acquires discriminative instance-level embedding representations. Concretely, instance embeddings are aggregated into class prototypes, and the storage of embedding vectors as opposed to images inherently mitigates the issue of memory overload. Via a Region of Interest (RoI)-level cosine similarity matching mechanism, the flexible augmentation of novel classes is realized, devoid of the requirement for supplementary training and independent of historical data. Experimental validations attest that this approach significantly outperforms state-of-the-art techniques in mainstream benchmark evaluations. More crucially, its memory-optimized attributes facilitate, for the first time, the conjoint assessment of FSIS performance across all classes within the COCO dataset. Visualized instances (incorporating colored masks and class annotations of objects across diverse scenarios) further substantiate the efficacy of the method in real-world complex contexts.
Suggested Citation
Qinying Zhu & Yilin Zhang & Peng Xiao & Mengxi Ying & Lei Zhu & Chengyuan Zhang, 2025.
"Prototype-Based Two-Stage Few-Shot Instance Segmentation with Flexible Novel Class Adaptation,"
Mathematics, MDPI, vol. 13(17), pages 1-17, September.
Handle:
RePEc:gam:jmathe:v:13:y:2025:i:17:p:2889-:d:1744264
Download full text from publisher
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:13:y:2025:i:17:p:2889-:d:1744264. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
We have no bibliographic references for this item. You can help adding them by using this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .
Please note that corrections may take a couple of weeks to filter through
the various RePEc services.