How do we process images in search engine? Here are the steps:
First, we segment the image into the foreground and background. Below are examples of segmentation done by a computer algorithm, with the top row as original picture and bottom row the segmented images with the background whitened out.
After the segmentation is done, we extract the photographic and object feature from an image.
Photographic features include:
- Aspect Ratio (image height divided by its width)
- Color histogram
- Texture histogram
- Shape features
In product search engine, the image vector of a listing is combined with text vector to represent the listing.