Stanford Advisors

  • Lei Xing, Postdoctoral Faculty Sponsor

Contact

  • Academic
    lmj695@stanford.edu
    University - Scholar Department: Radiation Oncology Position: Postdoctoral Scholar

Additional Info

  • Mail Code: 5847

All Publications

  • Progressive Frame-Proposal Mining for Weakly Supervised Video Object Detection. IEEE transactions on image processing : a publication of the IEEE Signal Processing Society Han, M., Wang, Y., Li, M., Chang, X., Yang, Y., Qiao, Y. 2024; 33: 1560-1573

    Abstract

    In this paper, we focus on the weakly supervised video object detection problem, where each training video is only tagged with object labels, without any bounding box annotations of objects. To effectively train object detectors from such weakly-annotated videos, we propose a Progressive Frame-Proposal Mining (PFPM) framework by exploiting discriminative proposals in a coarse-to-fine manner. First, we design a flexible Multi-Level Selection (MLS) scheme, with explicit guidance of video tags. By selecting object-relevant frames and mining important proposals from these frames, the proposed MLS can effectively reduce frame redundancy as well as improve proposal effectiveness to boost weakly-supervised detectors. Moreover, we develop a novel Holistic-View Refinement (HVR) scheme, which can globally evaluate importance of proposals among frames, and thus correctly refine pseudo ground truth boxes for training video detectors in a self-supervised manner. Finally, we evaluate the proposed PFPM on a large-scale benchmark for video object detection, on ImageNet VID, under the setting of weak annotations. The experimental results demonstrate that our PFPM significantly outperforms the state-of-the-art weakly-supervised detectors.

    View details for DOI 10.1109/TIP.2024.3364536

    View details for PubMedID 38358874