Revisiting Superpixels for Active Learning in Semantic Segmentation with Realistic Annotation Costs

Page view(s)
59
Checked on Sep 23, 2023
Revisiting Superpixels for Active Learning in Semantic Segmentation with Realistic Annotation Costs
Title:
Revisiting Superpixels for Active Learning in Semantic Segmentation with Realistic Annotation Costs
Journal Title:
2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Keywords:
Publication Date:
13 November 2021
Citation:
Cai, L., Xu, X., Liew, J. H., & Sheng Foo, C. (2021). Revisiting Superpixels for Active Learning in Semantic Segmentation with Realistic Annotation Costs. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). doi:10.1109/cvpr46437.2021.01084
Abstract:
State-of-the-art methods for semantic segmentation are based on deep neural networks that are known to be data-hungry. Region-based active learning has shown to be a promising method for reducing data annotation costs. A key design choice for region-based AL is whether to use regularly-shaped regions (e.g., rectangles) or irregularly-shaped region (e.g., superpixels). In this work, we address this question under realistic, click-based measurement of annotation costs. In particular, we revisit the use of superpixels and demonstrate that the inappropriate choice of cost measure (e.g., the percentage of labeled pixels), may cause the effectiveness of the superpixel-based approach to be under-estimated. We benchmark the superpixel-based approach against the traditional "rectangle+polygon"-based approach with annotation cost measured in clicks, and show that the former outperforms on both Cityscapes and PASCAL VOC. We further propose a class-balanced acquisition function to boost the performance of the superpixel-based approach and demonstrate its effectiveness on the evaluation datasets. Our results strongly argue for the use of superpixel-based AL for semantic segmentation and highlight the importance of using realistic annotation costs in evaluating such methods.
License type:
Publisher Copyright
Funding Info:
This research is supported by core funding from: Institute for Infocomm Research
Grant Reference no. :
Description:
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
ISSN:
2575-7075
1063-6919
ISBN:
978-1-6654-4509-2
978-1-6654-4510-8
Files uploaded:

File Size Format Action
cai-revisiting-superpixels-for-active-learning-in-semantic-segmentation-with-realistic-cvpr-2021-paper.pdf 757.99 KB PDF Request a copy