Publication · 2021
Recognition of Overlapped Objects via Weakly-Supervised Methods with Bag of Alphabets
Abstract
Weakly supervised learning can adjust model parameters by exploring image-level annotations, thus significantly reducing the cost of labeling samples. Although many efforts have been made to reduce the performance gap compared to supervised learning with expensive annotations, this article focuses on overlapped objects' adverse effects in recognizing overlapped objects via weakly supervised methods. In order to identify overlapped objects by weak supervision method, the current Bag-of-Words (BOW) framework for non-overlapped objects is modified to Bag-of-Alphabets (BOA), the words of objects corresponding to the alphabets of its parts. As a result, the un-covered factors of objects can significantly contribute to object recognition even when others may cover them. So, compared to BOW, a novel method, BOA is created to combine alphabets of parts into words of objects.
Keywords: Weakly Supervised Learning; Image-Level; Recognizing Overlapped Objects; Bag-of-Words; Bag-of-Alphabets
| Object | BOW | BOA |
|---|---|---|
| human | 0.970 | 0.945 |
| face | 0.911 | 0.946 |
| body | 0.913 | 0.919 |
| horse | 0.928 | 0.896 |
| panda | 0.867 | 0.903 |
| bike | 0.882 | 0.836 |
| car | 0.865 | 0.914 |
| food | 0.986 | 0.922 |
| drink | 0.884 | 0.792 |
| table | 0.840 | 0.931 |
| computer | 0.859 | 0.896 |
| mountain | 0.895 | 0.866 |
| tree | 0.856 | 0.842 |
| forest | 0.930 | 0.910 |
| watch | 0.937 | 0.790 |
| necklace | 0.951 | 0.804 |
| ring | 0.903 | 0.831 |
| earrings | 0.899 | 0.846 |
| Object | BOW | BOA |
|---|---|---|
| human | 0.350 | 0.984 |
| face | 0.167 | 0.886 |
| body | 0.188 | 0.812 |
| horse | 0.196 | 0.965 |
| panda | 0.226 | 0.928 |
| bike | 0.211 | 0.828 |
| car | 0.274 | 0.933 |
| food | 0.173 | 0.807 |
| drink | 0.183 | 0.933 |
| table | 0.132 | 0.927 |
| computer | 0.345 | 0.881 |
| mountain | 0.208 | 0.980 |
| tree | 0.133 | 0.838 |
| forest | 0.229 | 0.843 |
| watch | 0.336 | 0.922 |
| necklace | 0.147 | 0.877 |
| ring | 0.126 | 0.850 |
| earrings | 0.140 | 0.811 |