Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detection
Subhajit Maity, Ayan Kumar Bhunia, Subhadeep Koley, Pinaki Nath Chowdhury, Aneeshan Sain, Yi-Zhe Song
2025-07-14
Summary
This paper talks about a new method called Doodle Your Keypoints that helps AI detect important points on objects in photos by learning from sketches, even with very few examples.
What's the problem?
Detecting keypoints in images is hard when there are only a few examples to learn from and the data style is different, making it difficult for AI to find the right spots accurately.
What's the solution?
The researchers designed a framework that uses sketches as a way to teach the AI by connecting different types of data through shared features and adapting the AI to handle different drawing styles. This helps the AI better understand where keypoints are, even with limited information.
Why it matters?
This matters because it helps AI recognize key details in images more easily when there isn't much training data, which can improve applications like object recognition, robotics, and medical imaging.
Abstract
A framework using sketches and prototypical setup addresses few-shot keypoint detection challenges by leveraging cross-modal embeddings and domain adaptation.