Institutional Repository, Institute of Psychology, Chinese Academy of Sciences
A global energy optimization framework for 2.1D sketch extraction from monocular images | |
Yu, Cheng-Chi1; Liu, Yong-Jin1; Wu, Matt Tianfu2; Li, Kai-Yun3![]() ![]() | |
Abstract | The 2.1D sketch is a layered image representation, which assigns a partial depth ordering of over-segmented regions in a monocular image. This paper presents a global optimization framework for inferring the 2.10 sketch from a monocular image. Our method only uses over-segmented image regions (i.e., superpixels) as input, without any information of objects in the image, since (1) segmenting objects in images is a difficult problem on its own and (2) the objective of our proposed method is to be generic as an initial module useful for downstream high-level vision tasks. This paper formulates the inference of the 2.1D sketch using a global energy optimization framework. The proposed energy function consists of two components: (1) one is defined based on the local partial ordering relations (i.e., figure-ground) between two adjacent over-segmented regions, which captures the marginal information of the global partial depth ordering and (2) the other is defined based on the same depth layer relations among all the over-segmented regions, which groups regions of the same object to account for the over-segmentation issues. A hybrid evolution algorithm is utilized to minimize the global energy function efficiently. In experiments, we evaluated our method on a test data set containing 100 diverse real images from Berkeley segmentation data set (BSDS500) with the annotated ground truth. Experimental results show that our method can infer the 2.10 sketch with high accuracy. (C) 2014 Elsevier Inc. All rights reserved. |
Keyword | 2.1D sketch Global optimization Local features Hybrid differential evolution |
2014 | |
Language | 英语 |
Source Publication | GRAPHICAL MODELS
![]() |
ISSN | 1524-0703 |
Volume | 76Pages:507-521 |
Subtype | Article |
Indexed By | SCI |
WOS ID | WOS:000347018500042 |
Citation statistics | |
Document Type | 期刊论文 |
Identifier | http://ir.psych.ac.cn/handle/311026/14181 |
Collection | 脑与认知科学国家重点实验室 |
Affiliation | 1.Tsinghua Univ, Dept Comp Sci & Technol, TNList, Beijing 100084, Peoples R China 2.Univ Calif Los Angeles, Dept Stat, Ctr Vis Cognit Learning & Art, Los Angeles, CA 90024 USA 3.Chinese Acad Sci, Inst Psychol, State Key Lab Brain & Cognit Sci, Beijing 100101, Peoples R China |
Recommended Citation GB/T 7714 | Yu, Cheng-Chi,Liu, Yong-Jin,Wu, Matt Tianfu,et al. A global energy optimization framework for 2.1D sketch extraction from monocular images[J]. GRAPHICAL MODELS,2014,76:507-521. |
APA | Yu, Cheng-Chi,Liu, Yong-Jin,Wu, Matt Tianfu,Li, Kai-Yun,&Fu, Xiaolan.(2014).A global energy optimization framework for 2.1D sketch extraction from monocular images.GRAPHICAL MODELS,76,507-521. |
MLA | Yu, Cheng-Chi,et al."A global energy optimization framework for 2.1D sketch extraction from monocular images".GRAPHICAL MODELS 76(2014):507-521. |
Files in This Item: | ||||||
File Name/Size | DocType | Version | Access | License | ||
2014 A global energy(3948KB) | 暂不开放 | -- | Application Full Text |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment