Apr 22, 2014

Product attribute extraction

One of the most popular application for named entity detection is product attribute extraction. Automatically extracting product attributes from text helps E-commerce company correctly process user query and match it the right products. Marketers want to know what people are talking about related to their products. Corporate strategists wants to find out what products are trendy based on user discussions. 

Product attributes are specific properties related to a product. For example, Apple iPhone 5 with black color has 4 major attributes: Company name as “Apple”, brand name as “iPhone”, generation as “5”, color as “black”. A complete set of attributes define a product.  

What challenge do we face in extracting product attributes? We can create a dictionary of products and their corresponding attributes, but simply relying on a dictionary has its limitations:

  • A dictionary is not complete as new products are created. 
  • There is ambiguity in matching the attributes. 
  • Misspelling, abbreviations, and acronyms are used often , particularly in social media such as Twitter. 

Let’s look a case study of eBay (results were published), and see how they solve this problem. eBay is an online marketplace for sellers and buyers. Small sellers create their listings to be sold on eBay. With more than 100 million listings  on the site, sellers are selling everything from digital cameras, clothes, cars to collectibles. In order to help users quickly find an item they are interested in, eBay’s (product) search engine has to quickly match user query to existing listings. It is crucial that eBay group existing listing into products so that the search can be done quickly. This requires automatically extracting product attributes from each listing. However, they face the following challenges:

  • Each listing is less than 55 character long, which contains little context. 
  • Text is ungrammatical, with many nouns piled together.
  • Misspelling, abbreviations and acronyms occur frequently

As we can see, a dictionary-based approach does not work here due to the large volume of new listings and products on the site, and high variation in stating the same product attributes. For example, the brand “River island” has the following appearance in listings: 
river islands, river islanfd, river islan, ?river island, riverislandtop. 

How do we apply machine learning to this problem?  In a supervised learning approach, a small set of listings are labeled by humans. In each listing, each word is tagged either with an attribute name or “Other”. Different product categories have different attributes. For example, in clothing category, there are 4 major product attributes: Brand, garment type, color and size. The following is an example of a labeled listing:

                    Ann Taylor Asymmetrical  Knit Dress     NWT Red   Petite Size S
                    Brand                               Garment type          Color  Size        size

But supervised learning is very expensive as it requires a lot of labeled data. Our goal is using a small amount of labeled data and derive the rest based on bootstrapping. This is called semi-supervised learning. For detail of our semi-supervised learning approach, please see the paper in the reference. 

Duangmanee Putthividhya and Junling Hu, "Bootstrapped Named Entity Recognition for Product Attribute Extraction". EMNLP 2011: 1557-1567


  1. My partner and I stumbled over here from a different web address and thought I should check things out.
    I like what I see so i am just following you. Look forward to looking at your web page for a
    second time.

    Feel free to surf to my blog ...

  2. I actually prefer the website this one, because I like the news content that is very amazing and very useful for myself and family :)

  3. This comment has been removed by the author.

  4. This post is very information. The application which author describe in the post has many product attribute features. I think this is a useful app for users. Event planning app for ipad

  5. very informative. Big data analysis can be also applied into our SEO job. By analyzing the key words that users used to search the site, we can know what they are interested in and how to keep them interesting. BOC Sciences achieved a great progress with this method.

    1. Happy New Years Eve Washington DC 2017 :- The clock is ticking rapidly, and the countdown has been kicked off with people counting every single day.
      New Yea Whatsapp status 2017
      Happy New Year pictures 2017
      new year eve sydney fireworks 2017
      new year eve new york city fireworks 2017

  6. Replies

    1. we provide Baltimore basement waterproofing Services, install sump pumps, repair basement cracks and structural damange

      basement waterproofing contractors maryland

  7. wah artikelnya menggugah selera nih obat sakit tenggorokan saat menelan , obat kolesterol , obat batuk tbc bagus banget, sangat memotivasi dan menginspirasi

  8. thanks for sharing this with us, this is very informative article about the big data analysis.

  9. Thanks-a-mundo for the blog article.Much thanks again. Awesome.
    diwali sms images 2015

  10. Very neat article.Really looking forward to read more. Really Great.
    Prem ratan dhan payo movie torrent download

  11. Great article....
    Thanx a lot for sharing it with us...
    For tech related topics please visit my site...


  12. A big thank you for your blog.Really looking forward to read more. Fantastic.
    New year wishes 2016
    New year wishes

  13. Major thankies for the article.Really looking forward to read more. Keep writing.
    Happy new year 2016 photos, pictures
    New year greeting card images

  14. Looking forward to reading more. Great blog article.Really thank you! Cool.
    New year wishes 2016

    Happy new year wishes 2016

  15. Thanks for sharing, this is a fantastic article.Much thanks again. Really Cool.
    Happy new year quotes wishes

    new year quotes sms

    New year quotes for girlfriend

  16. This is one awesome blog article.Really looking forward to read more. Really Great.
    ride along 2 torrent download
    ride along 2 movie download

  17. Im obliged for the blog post.Really looking forward to read more. Awesome
    CBSE 12th Result

  18. I appreciate you sharing this article.Thanks Again. Much obliged.
    Holi Pictures For Facebook

  19. I really liked your blog article. Great.
    Happy Holi SMS

  20. Thanks-a-mundo for the blog post. Awesome.
    CBSE 10th Result Nic

  21. Everything is fine, am happy about your blog. Thanks admin for sharing the unique content, you have done a great job I appreciate your effort and I hope you will get more positive comments from the web users.


    SEO Training in Chennai

  22. Thanks for the great article. Click Euro Cup news to watch euro cup live

  23. About product attribute extraction given information really great,easily observe all provided information,thanks for sharing that valuable information.
    digital marketing training in chennai

    1. We made these yummy lollipops at my daughter's recent Tie-Dye Birthday party. They were a fun little treat for the girls, but they were so easy, they'd be a fun little treat to make anytime.

      one line quotes
      visit here

  24. Great information on product data. There is a lot of great work being done with product data and extraction and linking. I've come across ProductMatch by Data Ladder (, which is an excellent product attribute extraction tool used across business. They offer a complimentary trial for new users.

  25. Check out fugomo for all the latest news and gossips about bollywood


  26. this is great atikel ,, i like it,, thank for u sharing info for all people
    Situs Agen Judi Piala Eropa 2016 Terpercaya

  27. Want to know regular updates of Euro Cup 2016????
    Get Euro Cup live Streaming,Euro Cup 2016 Schedule,Euro Cup 2016 Fixture,Euro Cup 2016 Live Streaming,Euro Cup 2016 Live Stream,Euro Cup 2016 Live Score.
    Venue-France,From 10th june-10july. 24 teams,10 stadiums. Stay updated. Watch

    Wales vs Russia Live Streaming.

  28. Such simple and elegant
    Extra exquisite =) Minimal shot :-

  29. Check here to download Prisma for Android free.

  30. This application provides you all the best features for messaging which you are looking for.
    Allo app for PC

  31. Now share files from pc to smart mobile using shareit for pc for free. Shareit for PC

  32. snapdeal is now offering Various snapdeal coupons and also you can get latest deals andsnapdeal coupon codes. checkout once

  33. want to know valentines day quotes for your lover,valentines day messages,valentines day images, just checkout my site Valentines Day 2017


  35. Best New Year 2017 Wishes images for wish someone special. View our blog to see new and unique images.

  36. I would once again praise to god about this amazing post. Thank you so much for the detailed information. I love to read tips from people who are really successful with what they do. It inspires me an I learn a lot witch helps me to grow my business faster.

    Bigg Boss 10 Colors
    Big boss 10 Contestants
    Maru gujarat
    Get Venus Factor Reviews

    Thank you once again !!


  37. If Your Are Looking For Blogger Theme WordPress Themes, Plugins And Many More Just Visit Here.Free Premium Wordpress Themes And Plugins

  38. If you want to know National Cat Day 2016 and why is it celebrated by pet lovers all across the globe,
    just have a look at my blog.
    You too can celebrate this day with your loving pet cat.

  39. Want to know about Veterans Day,which is a day to celebrate the great officers of the US army,just checkout my blog Happy Veterans Day and stay updated.

  40. I would once again praise to god about this amazing post.
    Thank you so much for the detailed information.
    I love to read tips from people who are really successful with what they do.
    It inspires me an I learn a lot which helps me to grow my business faster.
    Happy Diwali Messages in Hindi
    Happy Diwali SMS in Hindi
    Happy Diwali Messages
    Happy Diwali Pictures
    Happy Diwali Whatsapp Status In Hindi
    Happy Diwali SMS 2016
    Happy Diwali Images 2016

  41. Great information..!! Product attribute extraction given information really great,and easy to understand. Thanks for sharing this great post.

  42. Want to know about Veterans Day,which is a day to celebrate the great officers of the US army,just checkout my blog Veterans Day SMS and stay updated.

  43. its really great information Thank you sir And keep it up More Post
    CBSE Result

    Awesome stuff is being shared by you
    CBSE 10th Class Result

    I must say indeed an awesome post and just loved the whole read.
    CBSE 12th Class Result

  44. plastic surgery before and after for most of the celebrities of the world and their before and after effects happen to them

  45. Amazon is one of the biggest world wide eCommerce Site so here you will get amazon Blackfriday These are

  46. Your blog is really nice and informative. Thanks for sharing this post. Keep posting...
    SAS training in chennai

  47. Merry Christmas Images or Christmas Day is an annual festival commemorating the birth of Jesus Christ, observed most commonly on December 25 as a religious and cultural celebration among billions of people around the world. A feast central to the Christian liturgical year, it is prepared for by the season of Advent or the Nativity Fast and initiates the season of Christmastide, which historically in the West lasts twelve days and culminates on Twelfth Night; in some traditions, Christmastide includes an Octave. Christmas Day is a public holiday in many of the world's nations, is celebrated culturally by a large number of non-Christian people, and is an integral part of the holiday season, while some Christian groups reject the celebration. In several countries, celebrating Christmas Eve on December 24 has the main focus rather than December 25, with gift-giving and sharing a traditional meal with the family.
    Merry Christmas Quotes

  48. thanks for sharing the post with us. good work indeed. You can download whatsapp for pc from ifrone


  49. Christmas quotes from books have deep thoughts. These quotes can also convey a valuable message as well. Keep sharing. One

    who wants to check more such quotes can visit here>>
    merry christmas quotes
    Happy new year images
    also see .Dermafixa

  50. exceptionally good post and i loved it .how to play mini militia these two are the things that i think you must see download mini militia

  51. Valentines Week

    Valentine Week Days List 2017

    Valentine Week 2017

    Happy Promise day Wishes

    Happy Promise day Wishes for boyfriend

    Happy Promise day Wishes for husband

    Happy Hug day Wishes

    Happy Hug day Wishes for boyfriend

    Happy Hug day Wishes for husband


    Happy Valentine day Wishes

    Happy Valentine day Wishes for boyfriend

    Happy Valentine day Wishes for husband

  52. The NFL Flag for Tennessee Titans is viewable from both sides with the opposite side being a reverse image.Fly this flag with any of our tailgate poles or 6' aluminum flagpoles and adjustable flag flags wholesale
    nfl house divided flagsCincinnati Bengals house flags
    Packers stars and stripes flags, House Divided Flags,Sports Flags 3x5, Sports flags and banners,nfl House Divided Flags

  53. Tutto sommato, mentre la vera Barcellona 2017-2018 casa Jersey potrebbe finire in cerca più di un po ‘simile a questo, ci aspettiamo che vantano un design più intricato che questo falso generale. Riteniamo inoltre che la distribuzione delle strisce asimmetriche è stato abbandonato alla fine, e che una striscia rossa sarà il fulcro del kit.maglie calcio poco prezzo,
    maglie da calcio a poco prezzo, nuove Maglia Atletico Madrid prezzo
    Maglia Barcelona prezzo

  54. awesome. Good article.... Thanks a lot for sharing....
    Jio TV

  55. Always follow your blog or artical it is very helpfull

    Kaya Beauty Tips

  56. find best job in india and make best india


  57. thanks so many time for that share.. nice

  58. WEB INFOTECH is a Recruiter and IT organization offering a wide range of services including Recruitment Agency and IT firm. We have emerged as a consultancy in the market rendering unmatched quality Placement Consultants Agencies. Since the inception, our company has only treaded forward with accelerated progression and continuous technological improvements. Through our dedicated efforts and peerless dedication, we have been able to cover various mile stones. We are aiming high and looking forward to set up the benchmark for our competitors.

  59. We are here to operate 24*7 and all days with the cities of North India, Delhi NCR, Chandigarh, Luckhnow, Dehradun, J&K, Himachal Pradesh and Punjab and So on. The clients can contact us directly from the Airport , Bus-stands and Raliway Stations to hire a Taxi anytime with affordable price. There is full trancperancy between our clients and us about all fare prices. Our taxi sevices approaches to the appropriate location where the client demandings to go.

  60. GSM Player is the Largest Mobile Firmware/Flash File Provider in the World.

    Qmobile, Rivo, Samsung, OPPO, Huawei, Sony, HTC, BlackBerry, iPhone, Motorola, Nokia, Lenovo and many Other Brands.

  61. Replies
    1. Visit us now to view & share beautiful collection of Best Images of
      rose day images

  62. Get all Festival Notice with
    All Festival Image

  63. taxi service in chandigarh

  64. Visit us now to view & share beautiful collection of Best Images of
    rose day images

  65. Visit us now to view & share beautiful collection of Best Images of
    happy birthday images

  66. Visit us now to view & share beautiful collection of Best Images of Happy Pancake Day 2017 <a href="</a>

  67. The NFL Flag for Washington Redskins is viewable from both sides with the opposite side being a reverse image.Fly this flag with any of our tailgate poles or 6' aluminum flagpoles and adjustable flag brackets.
    college football flags,
    house divided college flags
    Sports flags and banners,
    nfl house flags

  68. exceptionally good post and i loved it .how to hack mini militia game these two

    are the things that i think you must see download hacked mini militia apk also see

    2017 holi images

  69. norton setup
    Having problem installing Norton Anti-virus?
    Is your computers seems to be unprotected?
    Get help of our experties for all kind of Norton Anti-virus installation issues24*7 @ 1-888-418-3769

  70. All right this YouTube video is much improved than last one, this one has fastidious picture feature as well as audio.our service
    hire taxi in chandigarh

  71. Is your computers seems to be unprotected?
    Get help of our experties for all kind of
    Norton Anti-virus installation issues
    24*7 @ 1-888-629-0717