Dec 7, 2012

The basics of Image Mining

In online stores, listings of products normally come with pictures. For people who purchase dresses, the difference in images would make a lot difference. A good product search engine would be able to match search keywords with listing text and images combined.

How do we process images in search engine? Here are the steps:
First, we segment the image into the foreground and background. Below are examples of segmentation done by a computer algorithm, with the top row as original picture and bottom row the segmented images with the background whitened out.
The segmentation algorithm is based on GrabCut, which is essentially creating a rectangular bounding box around the foreground object, and then removing all the pixels outside the bounding box.

After the segmentation is done, we extract the photographic and object feature from an image.
Photographic features include:
  • Aspect Ratio (image height divided by its width)
  • Brightness 
  • Contrast 
  • Colorfulness
Object features include:
  • Color histogram
  • Texture histogram
  • Shape features
An image will be represented as a vector of these features.
In product search engine, the image vector of a listing is combined with text vector to represent the listing.


  1. This article has covered the topic quite well. Very informational and interesting. Thanks for sharing this knowledge with us.

    new year, new year images, new year wallpapers, new year quotes, new year wishes, new year sms, new year greetings, whatsapp status

  2. It has only been a few days since the launch of Apple's brand new iPhone 7 and iPhone 7 Plus, but it appears that the new iPhone has already been jailbroken. To get iPhone 7 Jailbreak go to CydiaNerd.

  3. The blog or and best that is extremely useful to keep I can share the ideas
    of the future as this is really what I was looking for, I am very comfortable and pleased to come here. Thank you very much.
    tanki online | 2048 game|

  4. Bộ sưu tập vòng tay đá núi lửa Hot nhất 2018
    Bộ sưu tập vòng tay đá mã não Hot nhất 2018
    Bộ sưu tập Vòng tay đá tourmaline Hot nhất 2018
    Bộ sưu tập vòng tay đá granat Hot nhất 2018

  5. I believe there are many more pleasurable opportunities ahead for individuals that looked at your site. Kar Har Maidaan Fateh Lyrics

  6. Showbox APK 2018
    Wow I can say this is another extraordinary article obviously of this blog. Bookmarked this webpage..