Pages

Apr 22, 2014

Product attribute extraction

One of the most popular application for named entity detection is product attribute extraction. Automatically extracting product attributes from text helps E-commerce company correctly process user query and match it the right products. Marketers want to know what people are talking about related to their products. Corporate strategists wants to find out what products are trendy based on user discussions. 

Product attributes are specific properties related to a product. For example, Apple iPhone 5 with black color has 4 major attributes: Company name as “Apple”, brand name as “iPhone”, generation as “5”, color as “black”. A complete set of attributes define a product.  

What challenge do we face in extracting product attributes? We can create a dictionary of products and their corresponding attributes, but simply relying on a dictionary has its limitations:

  • A dictionary is not complete as new products are created. 
  • There is ambiguity in matching the attributes. 
  • Misspelling, abbreviations, and acronyms are used often , particularly in social media such as Twitter. 

Let’s look a case study of eBay (results were published), and see how they solve this problem. eBay is an online marketplace for sellers and buyers. Small sellers create their listings to be sold on eBay. With more than 100 million listings  on the site, sellers are selling everything from digital cameras, clothes, cars to collectibles. In order to help users quickly find an item they are interested in, eBay’s (product) search engine has to quickly match user query to existing listings. It is crucial that eBay group existing listing into products so that the search can be done quickly. This requires automatically extracting product attributes from each listing. However, they face the following challenges:

  • Each listing is less than 55 character long, which contains little context. 
  • Text is ungrammatical, with many nouns piled together.
  • Misspelling, abbreviations and acronyms occur frequently

As we can see, a dictionary-based approach does not work here due to the large volume of new listings and products on the site, and high variation in stating the same product attributes. For example, the brand “River island” has the following appearance in listings: 
river islands, river islanfd, river islan, ?river island, riverislandtop. 

How do we apply machine learning to this problem?  In a supervised learning approach, a small set of listings are labeled by humans. In each listing, each word is tagged either with an attribute name or “Other”. Different product categories have different attributes. For example, in clothing category, there are 4 major product attributes: Brand, garment type, color and size. The following is an example of a labeled listing:

                    Ann Taylor Asymmetrical  Knit Dress     NWT Red   Petite Size S
                    Brand                               Garment type          Color  Size        size

But supervised learning is very expensive as it requires a lot of labeled data. Our goal is using a small amount of labeled data and derive the rest based on bootstrapping. This is called semi-supervised learning. For detail of our semi-supervised learning approach, please see the paper in the reference. 

Reference:
Duangmanee Putthividhya and Junling Hu, "Bootstrapped Named Entity Recognition for Product Attribute Extraction". EMNLP 2011: 1557-1567

122 comments:

  1. My partner and I stumbled over here from a different web address and thought I should check things out.
    I like what I see so i am just following you. Look forward to looking at your web page for a
    second time.

    Feel free to surf to my blog ... dach-pol.pl

    ReplyDelete
  2. I actually prefer the website this one, because I like the news content that is very amazing and very useful for myself and family :)

    ReplyDelete
  3. This comment has been removed by the author.

    ReplyDelete
  4. This post is very information. The application which author describe in the post has many product attribute features. I think this is a useful app for users. Event planning app for ipad

    ReplyDelete
  5. very informative. Big data analysis can be also applied into our SEO job. By analyzing the key words that users used to search the site, we can know what they are interested in and how to keep them interesting. BOC Sciences achieved a great progress with this method.

    ReplyDelete
  6. Replies

    1. we provide Baltimore basement waterproofing Services, install sump pumps, repair basement cracks and structural damange

      basement waterproofing contractors maryland

      Delete
  7. wah artikelnya menggugah selera nih obat sakit tenggorokan saat menelan , obat kolesterol , obat batuk tbc bagus banget, sangat memotivasi dan menginspirasi

    ReplyDelete
  8. thanks for sharing this with us, this is very informative article about the big data analysis.

    ReplyDelete
  9. Thanks-a-mundo for the blog article.Much thanks again. Awesome.
    diwali sms images 2015

    ReplyDelete
  10. Very neat article.Really looking forward to read more. Really Great.
    Prem ratan dhan payo movie torrent download

    ReplyDelete
  11. Great article....
    Thanx a lot for sharing it with us...
    For tech related topics please visit my site...

    Storify

    ReplyDelete
  12. A big thank you for your blog.Really looking forward to read more. Fantastic.
    New year wishes 2016
    New year wishes

    ReplyDelete
  13. Major thankies for the article.Really looking forward to read more. Keep writing.
    Happy new year 2016 photos, pictures
    New year greeting card images

    ReplyDelete
  14. Looking forward to reading more. Great blog article.Really thank you! Cool.
    New year wishes 2016

    Happy new year wishes 2016

    ReplyDelete
  15. Thanks for sharing, this is a fantastic article.Much thanks again. Really Cool.
    Happy new year quotes wishes

    new year quotes sms

    New year quotes for girlfriend

    ReplyDelete
  16. This is one awesome blog article.Really looking forward to read more. Really Great.
    ride along 2 torrent download
    ride along 2 movie download

    ReplyDelete
  17. Im obliged for the blog post.Really looking forward to read more. Awesome
    CBSE 12th Result Nic.in

    ReplyDelete
  18. I appreciate you sharing this article.Thanks Again. Much obliged.
    Holi Pictures For Facebook

    ReplyDelete
  19. I really liked your blog article. Great.
    Happy Holi SMS

    ReplyDelete
  20. Thanks-a-mundo for the blog post. Awesome.
    CBSE 10th Result Nic

    ReplyDelete
  21. Everything is fine, am happy about your blog. Thanks admin for sharing the unique content, you have done a great job I appreciate your effort and I hope you will get more positive comments from the web users.

    Regards,
    Aamala

    SEO Training in Chennai

    ReplyDelete
  22. Thanks for the great article. Click Euro Cup news to watch euro cup live

    ReplyDelete
  23. About product attribute extraction given information really great,easily observe all provided information,thanks for sharing that valuable information.
    digital marketing training in chennai

    ReplyDelete
    Replies
    1. We made these yummy lollipops at my daughter's recent Tie-Dye Birthday party. They were a fun little treat for the girls, but they were so easy, they'd be a fun little treat to make anytime.

      wishmediwali
      one line quotes
      whatsapp
      visit here

      Delete
  24. Great information on product data. There is a lot of great work being done with product data and extraction and linking. I've come across ProductMatch by Data Ladder (http://DataLadder.com), which is an excellent product attribute extraction tool used across business. They offer a complimentary trial for new users.

    ReplyDelete
  25. Check out fugomo for all the latest news and gossips about bollywood

    ReplyDelete

  26. this is great atikel ,, i like it,, thank for u sharing info for all people
    Situs Agen Judi Piala Eropa 2016 Terpercaya

    ReplyDelete
  27. Want to know regular updates of Euro Cup 2016????
    Get Euro Cup live Streaming,Euro Cup 2016 Schedule,Euro Cup 2016 Fixture,Euro Cup 2016 Live Streaming,Euro Cup 2016 Live Stream,Euro Cup 2016 Live Score.
    Venue-France,From 10th june-10july. 24 teams,10 stadiums. Stay updated. Watch

    Wales vs Russia Live Streaming.

    ReplyDelete
  28. Such simple and elegant
    Extra exquisite =) Minimal shot :-

    ReplyDelete
  29. Check here to download Prisma for Android free.

    ReplyDelete
  30. This application provides you all the best features for messaging which you are looking for.
    Allo app for PC

    ReplyDelete
  31. Now share files from pc to smart mobile using shareit for pc for free. Shareit for PC

    ReplyDelete
  32. snapdeal is now offering Various snapdeal coupons and also you can get latest deals andsnapdeal coupon codes. checkout once

    ReplyDelete
  33. want to know valentines day quotes for your lover,valentines day messages,valentines day images, just checkout my site Valentines Day 2017

    ReplyDelete
  34. http://www.aboutdm.com/2014/04/product-attribute-extraction.html

    ReplyDelete
  35. Best New Year 2017 Wishes images for wish someone special. View our blog to see new and unique images.

    ReplyDelete
  36. I would once again praise to god about this amazing post. Thank you so much for the detailed information. I love to read tips from people who are really successful with what they do. It inspires me an I learn a lot witch helps me to grow my business faster.

    Bigg Boss 10 Colors
    Big boss 10 Contestants
    Maru gujarat
    Get Venus Factor Reviews

    Thank you once again !!

    ReplyDelete

  37. If Your Are Looking For Blogger Theme WordPress Themes, Plugins And Many More Just Visit Here.Free Premium Wordpress Themes And Plugins

    ReplyDelete
  38. If you want to know National Cat Day 2016 and why is it celebrated by pet lovers all across the globe,
    just have a look at my blog.
    You too can celebrate this day with your loving pet cat.

    ReplyDelete
  39. Want to know about Veterans Day,which is a day to celebrate the great officers of the US army,just checkout my blog Happy Veterans Day and stay updated.

    ReplyDelete
  40. I would once again praise to god about this amazing post.
    Thank you so much for the detailed information.
    I love to read tips from people who are really successful with what they do.
    It inspires me an I learn a lot which helps me to grow my business faster.
    Happy Diwali Messages in Hindi
    Happy Diwali SMS in Hindi
    Happy Diwali Messages
    Happy Diwali Pictures
    Happy Diwali Whatsapp Status In Hindi
    Happy Diwali SMS 2016
    Happy Diwali Images 2016

    ReplyDelete
  41. Great information..!! Product attribute extraction given information really great,and easy to understand. Thanks for sharing this great post.

    ReplyDelete
  42. Want to know about Veterans Day,which is a day to celebrate the great officers of the US army,just checkout my blog Veterans Day SMS and stay updated.

    ReplyDelete
  43. its really great information Thank you sir And keep it up More Post
    CBSE Result

    Awesome stuff is being shared by you
    CBSE 10th Class Result

    I must say indeed an awesome post and just loved the whole read.
    CBSE 12th Class Result

    ReplyDelete
  44. plastic surgery before and after for most of the celebrities of the world and their before and after effects happen to them

    ReplyDelete
  45. Amazon is one of the biggest world wide eCommerce Site so here you will get amazon Blackfriday These are

    ReplyDelete
  46. Your blog is really nice and informative. Thanks for sharing this post. Keep posting...
    SAS training in chennai

    ReplyDelete
  47. Merry Christmas Images or Christmas Day is an annual festival commemorating the birth of Jesus Christ, observed most commonly on December 25 as a religious and cultural celebration among billions of people around the world. A feast central to the Christian liturgical year, it is prepared for by the season of Advent or the Nativity Fast and initiates the season of Christmastide, which historically in the West lasts twelve days and culminates on Twelfth Night; in some traditions, Christmastide includes an Octave. Christmas Day is a public holiday in many of the world's nations, is celebrated culturally by a large number of non-Christian people, and is an integral part of the holiday season, while some Christian groups reject the celebration. In several countries, celebrating Christmas Eve on December 24 has the main focus rather than December 25, with gift-giving and sharing a traditional meal with the family.
    Merry Christmas Quotes




    ReplyDelete