[深度学习论文笔记][Instance Segmentation] Instance-aware Semantic Segmentation via Multi-task Network Cascad

Dai, Jifeng, Kaiming He, and Jian Sun. “Instance-aware semantic segmentation via multitask network cascades.” arXiv preprint arXiv:1512.04412 (2015). (Citations: 40).

1 Motivation

All previous works require externel segmentation proposals, which are slow at test time.

2 Architecture

See Fig. We divide the task into three sub-tasks.
1. RPN. The instances can be represented by bounding boxes that are class-agnostic.
2. Estimating masks. A pixel-level mask is predicted by logistic regression for each bounding box instance. They are still class-agnostic.
3. Categorizing objects. The category-wise label is predicted for each mask-level instance.
We expect that each sub-task is simpler than the original instance segmentation task, and is more easily addressed by CNNs.

3 Cascades with More Stages
In Fast R-CNN, the classification head is trained jointly with class-wise bounding box regression head. Inspired by this practice, on stage 3, we add a regression head, , which is
a sibling layer with the classifier head. For the testing step, we first run the entire 3-stage network and obtain the regressed boxes on stage 3. These boxes are then considered as new proposals 1. Stages 2 and 3 are performed for the second time on these proposals. This is in fact 5-stage inference.

4 Training Details
Each stage involves a loss term, but a later stage’s loss relies on the output of an earlier stage. We train the entire network cascade end-to-end with a unified loss function.

5 References
[1]. https://www.youtube.com/watch?v=bUjyXASy_Jo.

[深度学习论文笔记][Instance Segmentation] Instance-aware Semantic Segmentation via Multi-task Network Cascad相关推荐

[深度学习论文笔记]Pairwise Learning for Medical Image Segmentation
[深度学习论文笔记]Pairwise Learning for Medical Image Segmentation 医学图像分割的成对学习 Published: October 2020 Publi ...
深度学习论文: Rethink Dilated Convolution for Real-time Semantic Segmentation及其PyTorch实现
深度学习论文: Rethink Dilated Convolution for Real-time Semantic Segmentation及其PyTorch实现 Rethink Dilated C ...
深度学习论文: Lightweight and Progressively-Scalable Networks for Semantic Segmentation及其PyTorch实现
深度学习论文: Lightweight and Progressively-Scalable Networks for Semantic Segmentation及其PyTorch实现 Lightwe ...
[深度学习论文笔记]A Tri-attention Fusion Guided Multi-modal Segmentation Network
A Tri-attention Fusion Guided Multi-modal Segmentation Network 一种三注意力融合引导的多模态分割网络 Published: 2 Nov 2 ...
[深度学习论文笔记]Multi-phase Liver Tumor Segmentation with Spatial Aggregation
Multi-phase Liver Tumor Segmentation with Spatial Aggregation and Uncertain Region Inpainting [深度学习论 ...
[深度学习论文笔记]医学图像分割U型网络大合集
[深度学习论文笔记]医学图像分割U型网络大合集 2015 U-Net: Convolutional Networks for Biomedical Image Segmentation (MICCAI ...
[深度学习论文笔记]Knowledge distillation from multi-modal to mono-modal segmentation networks从多模态到单模态分割的知识提取
Knowledge distillation from multi-modal to mono-modal segmentation networks 从多模态分割网络到单模态分割网络的知识提取 MI ...
[深度学习论文笔记]UNETR: Transformers for 3D Medical Image Segmentation
UNETR: Transformers for 3D Medical Image Segmentation UNETR:用于三维医学图像分割的Transformer Published: Oct 20 ...
[深度学习论文笔记]Modality-aware Mutual Learning for Multi-modal Medical Image Segmentation
Modality-aware Mutual Learning for Multi-modal Medical Image Segmentation 多模态医学图像分割中的模态感知互学习 Publish ...

[深度学习论文笔记][Instance Segmentation] Instance-aware Semantic Segmentation via Multi-task Network Cascad

[深度学习论文笔记][Instance Segmentation] Instance-aware Semantic Segmentation via Multi-task Network Cascad相关推荐

最新文章

热门文章