Pages

Jan 20, 2014

Statistics and Data Mining

Probability theory is the core of data mining. In the early day of data mining, people count the frequent pattern of those who buy diaper also buy beer. This is essentially deriving a conditional probability buying beer given buying diaper. In mathematical term, it is P(buy beer | buy diaper).

Here is example: Suppose 5% of the shoppers buy diaper, and only 2% of shoppers buy both diaper and beer, what the likelihood of some buys diaper after buying beer?  The answer is a conditional probability.
The so-called “association rule” in data mining can be much clearly understood through these statistics terms. 

In machine learning, the core concept is predicting whether a data sample belong to a certain population (class). For example, we want to predict whether a person is a potential buyer, or a credit card transaction is fraudulent. Such prediction is always associated with a confidence score between 0 and 1. When the confidence score is 1, we are 100% sure about the prediction. Generating such confidence score requires statistical inference.

Statistics is essential when evaluating a data mining model. We use control group or conduct A/B test. For example, if we test with 1000 people in treatment group (Group A) vs. 1000 people in control group (Group B) and find Group A has better performance, is this result conclusive? In other words, is it statistically significant? That has to be answered by statistic knowledge.

In data collection phrase, statistics helps us to decide the size of training data (sample), and whether it is representative. Not to mention, some current popular machine learning methods such as logistic regression were originally developed in statistics community.

As mathematics provides foundation for physics, statistics has now become a foundation for machine learning. Its importance will become more prominent overtime in data mining.

89 comments:

  1. very informative. Big data analysis can be also applied into our SEO job. By analyzing the key words that users used to search the site, we can know what they are interested in and how to keep them interesting. BOC Sciences achieved a great progress with this method.

    ReplyDelete
  2. very informative. Big data analysis can be also applied into our SEO job. By analyzing the key words that users used to search the site, we can know what they are interested in and how to keep them interesting. BOC Sciences achieved a great progress with this method.

    ReplyDelete
  3. Do not worry jamu agar tahan lama di ranjang if your penis an erection or not. cara mengatasi ejakulasi dini pada pria The more you are anxious and cara membuat penis kuat dan tahan lama think about it would make more cara pemesanan spirulina difficult the erection occurs or even erection cara pemesanan cordyceps plus capsule that had been hard even suddenly flaccid again. obat kuat tradisional Do not be nervous and remained relaxed and confident with your erection. All you have to understand that, a ptia not always get an erection in any occasion.

    ReplyDelete
  4. Thanks for sharing this interesting and useful things with all of us. this is what I am looking for.
    CP

    ReplyDelete
  5. I found a lot of entertaining products in your weblog, especially the discussion. free itune codes

    ReplyDelete

  6. this is great atikel ,, i like it,, thank for u sharing info for all people Situs Agen Judi Piala Eropa 2016 Terpercaya

    ReplyDelete
  7. Want to watch the most important match of Euro Cup 2016, the big final live from your home,just check out Euro Cup Final Live Streaming

    ReplyDelete
  8. If you love cats, you must check out my blog National Cat Day
    which is solely dedicated to cats. Learn everything you want to know about cats and stay updated. Enjoy with your pets on Cat Day and make her feel special.

    ReplyDelete
  9. Want to know about Veterans Day,which is a day to celebrate the great officers of the US army,just checkout my blog Veterans Day 2016 and stay updated.

    ReplyDelete
  10. Backlinks Affordable link building service and high pr backlinks service with express delivery!
    dofollow Backlinks Affordable link building service and high pr backlinks service with express delivery!
    High PR Backlinks Affordable link building service and high pr backlinks service with express delivery!

    ReplyDelete
  11. London Escorts For those of you seeking a VIP escort who can provide something a little bit out of the ordinary, you have come to the right place. 000 London Escorts is an Elite Central London Escorts Agency providing high class escort courtesans in Central London.

    ReplyDelete
  12. German Sex Videos The best daily updated Amateurs Porn Videos,sexiest girls on the net.

    ReplyDelete
  13. tight pussy Tight Pussy Video's, Tight Pussy Porn, Tight Pussy Hentai Cartoon Porn, Free Tight Pussy Cam Shows, Latino Tight Pussy, Tight Pussy Cartoon Video's, And Everything Porn Where There Is A Cute Tight Pussy Involved :)

    ReplyDelete
  14. Valentines Week

    Valentine Week Days List 2017

    Valentine Week 2017
    ---------------------------------------------------------------------------------------------


    Happy Promise day Wishes

    Happy Promise day Wishes for boyfriend

    Happy Promise day Wishes for husband

    --------------------------------------------------------------------------------------------
    Happy Hug day Wishes

    Happy Hug day Wishes for boyfriend


    Happy Hug day Wishes for husband

    ---------------------------------------------------------------------------------------------

    Happy Valentine day Wishes



    Happy Valentine day Wishes for boyfriend



    Happy Valentine day Wishes for husband

    ReplyDelete
  15. gusto Free Porn Movies at Gusto Porn. A huge amount of porn industry content just a click away. Hi-def video quality, images and pictures from sex lovers around the globe. All types of adult categories, there is something for everyone that likes xxx or loves porno. Enjoy!

    ReplyDelete
  16. indmms.com Watch free Desi Xxx leaked porn full videos online on your desktop or mobile phone. Free full length XXX movies. Share your own xxx and leaked porn video on www.txxx.xxx ...

    ReplyDelete
  17. SnapFuck Women you know are sharing their naked pictures at www.snapfuck.co . And even more hot girls are looking for casual sex and discreet affairs. Registration is 100% Free.

    ReplyDelete
  18. free cams Free sex Chat. Watch Best Porn Cams and enjoy free live sex shows with sexy adult cams girls. ​Ffree sex webcams, live adult cams, free sex webcams, adult webcams, free live porn.

    ReplyDelete
  19. how to cure acne fast What exactly helps for acne & pimples? Discover how to get rid of acne and pimples quickly and permanently. For the time “after” acne, pimples certain observations made suggest to stay away from certain remedies or cosmetic recommendation, to avoid collateral harm such as scars etc. ​Everyone’s skin varies in structure and composition so everyone’s reaction to any treatment methods are likely to be completely different. It depends on the hardness of the outbreak as well as other mitigating circumstances. ​Therefore, how to treat acne and pimples? ​Our information and facts will assist you to fight them!

    ReplyDelete
  20. VR Porn Galaxy See the hottest pornstars like they were in the same room as you in Virtual Reality.

    ReplyDelete
  21. NYC Escorts New York Escorts - The Best NYC Escorts and Independent New York City Escort available in Manhattan. Indulge with the best Independent VIP Ebony Escort in NYC. The ultimate Elite New York Escort Service.

    ReplyDelete
  22. HQ Japanese blowjobs Tsunamiblowjob.club offers you unlimited Japanese blowjobs. Uncencored and only in HQ 1080p for highest pleasures. You find also great Japanese lesbian inside. We have now MAXI PROMO for only 1 USD / month. Come and check it out.

    ReplyDelete
  23. big black cock Watch free Big Black Cock porn videos on supportyourking. Select from the best full length Big Black Cock XXX movies to play. supportyourking.com updates hourly!

    ReplyDelete
  24. serviporno Buenas, bienvenidos a Mira Chicas Porno, en nuestra página web encontrarás una colección del mejor porno en español, ya sea castellano o latino, todo totalmente gratis. Mira videos porno XXX con la mejor calidad HD, preparados para el móvil, ordenador o tablet, tanto para descargar como para ver online.

    ReplyDelete
  25. Escorts in Nottingham Book the best escorts in Nottingham now with our independent agency, we have the best escorts in the area available at all times...

    ReplyDelete
  26. voyance gratuit Voyance-amour-eternel.com is an autority website of clairvoyance and esoterism. Well know in France, it permits to learn astrology, divinatory arts, tarots cards or to use the kabbale to understand our dreams. It also proposes a voyance gratuit, by a call phone to the 0892 22 20 22. This service permit to ask importants questions to a pro, able to see the futur and to transmit clear informations about our destiny. Remember that the voyance gratuite immediate is very usefull in many cases.

    ReplyDelete
  27. Gianna Nicole Gianna Nicole - Free Full Porn Videos. The largest collection of free porn videos starring pornstar Gianna Nicole.

    ReplyDelete
  28. Los Angeles Looking for a hot Los Angeles Stripper? Los Angeles Party Strippers features the sexiest Strippers to provide you with the wildest entertainment experience in Los Angeles. http://SoCalStrippers.com ...

    ReplyDelete


  29. In your blog I was happy to see your article, better than last time, and have made great progress, I am very pleased. I am looking forward to your article will become better and better.
    hotmail login | red ball | 192.168.1.1

    ReplyDelete
  30. bi porn THREE PILLOWS is the original and premiere bisexual adult entertainment site today! Founded in 2001 and now with the largest collection of bisexual videos and bi MMF photos worldwide. Affordable bisexual quality adult entertainment along with bi community features as: bi chat, bi messaging and bisexual personals. One of a kind bisexual adult entertainment and affordable too. Do not miss out on Three Pillows!

    ReplyDelete
  31. CALL GIRLS THESSALONIKI VIP Escorts Thessaloniki! Κλείστε τώρα ραντεβού για σεξ σήμερα με τις πιο όμορφες escorts, call girls, escorts tours και pornstar στης Θεσσαλονίκη!

    ReplyDelete
  32. adult dating site Find sex partner online on the biggest adult dating platform. Join and start make sex right now with hot girls.

    ReplyDelete
  33. BISEXUAL WORLDWIDE COMMUNITY SITE Bisexual Worldwide Community Site is the global home for all adult bisexual men, bisexual women, bi couples, bi-curious folks as well as all our gay, lesbian, transgender friends. FREE! We offer a wide range of bisexual resources for our core bi audience including but not limited to: bi chat, bi personals, bi forums, bisexual discussions, bisexual advice, coming out support, conflict resolution, bi message boards, social networking & more. Serving our bi global community for over a decade! Come visit us now at: www.bisexual.com

    ReplyDelete
  34. asian sex PornAero is an Adult tube site covering a variety of niches and fetishes, everything from hot horny amateurs, Feet, Pantyjobs, Fisting, Teens, HD pornstars and everything in between. The asian porn category is the most popular category on this site, followed by fisting and teen porn. PornAero has thousands of adult video content with more added constantly being added...

    ReplyDelete
  35. Adult PornKing DVDS Over 100,000 4KHD Buy Them Now Sent To Your Mailbox By Ups we carry sex toys of allkinds,sex pills new ones,merchandise,enhancers,even have free backlinks portals-offers,we even sell condoms fight stds now get alot you could sell them to friends to stop diseases.we got tons look now get your order in now!

    ReplyDelete
  36. Butt Plugs Ball Gags adult sex toys rabbit vibrators bullet vibrators This is an adult sex toys store. You can find vibrators, butt plugs, ball gags etc. online at cheap and affordable prices.

    ReplyDelete
  37. webcams Best live webcam girls. Cam2Fun is ready to satisfy all your needs. Join free and receive free credits to enjoy our models.

    ReplyDelete
  38. nice blog thanks for sharing with us. Swastik Financial Services provides loan services in Hyderabad.
    personal loans in hyderabad

    ReplyDelete
  39. COUPLES SEXTOYSFORCOUPLES – UNIVERSE OF PASSION Exceptional love toys for her and him; in fresh colors, exciting shapes and with lots of erotic energy.

    ReplyDelete
  40. Brazzers online free Xvideos720p.com is a free porn online, ​ We offer streaming porn videos, downloadable , and the number 1 free sex community on the net. We’re always working towards adding more features that will keep your love for porno alive and well.

    ReplyDelete
  41. your blog is very informative for me! thanks for all these methods!

    ReplyDelete
  42. Thanks for sharing this interesting and useful things with all of us

    ReplyDelete
  43. Web Cam Sex Chat with live cams girls largest Adult Sex Cams community and chat, Uncensored Adult Chat. Start chatting with amateurs, exhibitionists, pornstars, Cam girls are ready for live sex via cam. webcam chat for adults with flirty chicks. Join us and get much more in private live camsex!

    ReplyDelete
  44. Your work is very good and I appreciate you and hopping for some more informative posts.gạch bông cũ giá rẻ

    ReplyDelete
  45. Escort Service in St. Petersburg St. Petersburg is one of the most famous city in Russia, some people think that our city is more beautiful than Moscow and call it as "Northern Venice" and "City of White Nights". Our city has a lot to offer for tourists and for business. This also applies to erotic life, because here you can find cheap Russian call girls and escorts. Sex should be exciting and lively, but we are sure you already hear many about Russian passion and girls. Our escort agency helps you to reach this requirement quickly and safety in St. Petersburg. Even if you do not know enough about the city, you can still experience of call girls from Russia.

    ReplyDelete
  46. I love the way you write and share your niche! Very interesting and different! Keep it coming!
    -------------------------------------------------------
    am thanh hinh anh o to
    he thong am thanh tren o to

    ReplyDelete
  47. https://www.videosporn.eu Videos Porn - Free porn videos, free download porn movies, Stream XXX tubes and Adult Videos 720p HD, high definition quality. Enjoy it

    ReplyDelete
  48. hdpornfree Shemale PORN HD - Tranny tubes for free - XXX Videos - Transsexual - Travestis & Transexuales

    ReplyDelete
  49. silicone sex doll SexDollie.com supply the best American sex dolls on the market, our super soft love dolls are manufactured to the highest standards. Factory Wholesale Price.

    ReplyDelete
  50. Sextoyorgasm Sex Toy Orgasm is the best online sexshop. We have thousands of sextoys, the finest lingerie and the more powerful aphrodisiacs. We have the best brands on the sex market and the best prices. Take a look and chose your favourite sextoy or lingerie.

    ReplyDelete
  51. SEX VIDEOS ΤΑ ΚΑΛΥΤΕΡΑ SEX VIDEOS ΣΤΟ ΙΝΤΕΡΝΕΤ ΣΗΜΕΡΑ ΕΝΤΕΛΩΣ ΔΩΡΕΑΝ ΓΙΑ ΚΙΝΗΤΑ ΚΑΙ SMARTPHONES!

    ReplyDelete
  52. Swing Social Network for the BDSM, Fetish & Kinky Community - Explore the World of Kink, BDSM, Bondage & Alternative Lifestyles

    ReplyDelete
  53. sexy gay cams Sexy Hot Gay Cams is the ultimate streaming service where users can watch free sexy gay cams, interact in a chat room with gay models or broadcast their own webcam – totally free of charge! If you are looking for an amazing gay adult fantasy, then you are at the correct place. Would you like to enjoy the latest gay adult fantasy? Then you found what you’ve been looking for. Do not waste your time scrolling through endless low quality cams in other websites and enjoy the experience of Sexy Hot Gay Cams.

    ReplyDelete
  54. fuck Watch only ANAL free videos updated every hour. MONDO ANALE collects ANAL videos filtered by categories from all major porn sites: youporn, redtube, pornhub, tube8, xhamster, drtuber, xvideos and more... ! Find videos of all kinds and for all tastes, thousands of videos divided into 150+ categories: 3D, amateur, arab, asian, asslick, big-butt, big-cocks, big-tits, bisexual, black-woman, bondage, camel-toe, celebrities, college, creampie, czech, dildostoys, fat, fetish, italian, british, milf and more... ANAL IS BETTER!

    ReplyDelete
  55. sexy lingerie model Best Lingerie Models on the internet and how to blogs for your career.

    ReplyDelete
  56. Escorts Female Bangalore Escorts Point is the provider of the best Independent Escorts in Bangalore. We have the rich arena of hot and sexy escorts. Providing Hot vip Escort In bangalore.

    ReplyDelete
  57. Awesome Post! Check out Happy Diwali 2017 Facebook Status
    Also download latest movie PIRATES OF THE CARIBBEAN: DEAD MEN TELL NO TALES 2017
    Also Read trending Story Modern Society
    Also Check out Latest vacancy of Government Job BPSC Recruitment 2017

    ReplyDelete
  58. bangbros PornHot - Free HD PORN stream 720p Quality, updated daily with the best porn sites of the net.

    ReplyDelete
  59. free porn download Geeztube is a mainstream porn tube website providing a wide variety of different type of porn videos. The site has videos for every category you can image, with an extensive list of keywords like “Ebony” and “Brazilian” organized alphabetically, so you don’t have to waste any time getting to the good stuff. The site is also updated daily with new videos so never have to worry about watching the same repeat content. Pop-up ads are also rare to come by on the site, which is a definite plus. Sit back and enjoy this site, because navigation is simple and the living is easy.

    ReplyDelete
  60. sexy nylons Wanna see the hottest MILF legs worldwide in charming thinnest nylons? What may be more exciting than teasing of hot mature lady in crazy unlimited dildo and hardcore actions!

    ReplyDelete
  61. ΕΡΩΤΙΚΕΣ ΑΓΓΕΛΙΕΣ EROTIC ADDRESSES - SEX ADDRESSES - WOMEN SEX - EROTIC KNOWLEDGE

    ReplyDelete
  62. Dehradun Escorts Service Call Girls In Dehradun, O8171732999 Dehradun Escorts. Choose Independent High Profile Call Girls in Dehradun 5 3 star Hotels with Photos, Contact us at O8171732999, To Book Models Escorts in Dehradun In Hotels.

    ReplyDelete
  63. GYNAIKES SEX FIND THE BEST ESCORTS AND CALL GIRLS IN ATHENS GREECE NOW!

    ReplyDelete
  64. JAV Stream Watch 100s of full Japanese Adult Videos streaming at JAVRedlight.com no signup or credit card required. Just what you want on demand.

    ReplyDelete
  65. sex toys The Adult Co offers a great range of popular adult toys, lingerie and adult DVDs. Shop online for the best prices.

    ReplyDelete
  66. Penis Sleeve 09426671525 Sex Toy, Online Buy Sex Toy, Sex Toy Shop, Sex Toy Store, FleshLight Vagina, Pink Pussy, Dildo Vibrator, Artficial, Rabbit Vibrator, StrapOn Belt,

    ReplyDelete
  67. Video Bokep Download dan Streaming Video Bokep SEX Ngentot Mesum Indo Terbaru, video memek, video ngentot cewek abg sma bokep smp dan skandal video bokep mahasiswi.

    ReplyDelete
  68. cam porn Welcome to LivePornBabes.com one of the largest live porn cams and free adult chat rooms with hot nude cam girls and vip live porn shows on the internet where users worldwide can enjoy in real time to watch live free porn webcams videos or spy free any adult sex chat room having some cybersex fun !

    ReplyDelete
  69. private Brothelmate offers the ultimate solution to all clients interested in sex as well as sex advertisers around the world; and by doing so, we are making your search quick and easy. It doesn’t matter what sexual orientation you are of or look for, Brothelmate sextourism will help you fulfil your sexual dreams. Whether you’re a businessman, tourist, or visitor, we believe with our continuously extending database of sex advertisers you will find what you’re looking for. ALL FOR FREE, REAL LIFE REAL SEX

    ReplyDelete
  70. Customized San Francisco 49ers Jersey Custom 49ers Jersey today with stitched own name and number! Our Customized San Francisco 49ers Football Jersey Cheap Available for Free Shipping Delivery. We Have Custom Made Mens,Womens and Youth 49ers Jersey Shirt Featuring Nike Red Team Color, Away White and Alternate Black Styles. Support Team Today By Order Personalized 49ers Jersey!

    ReplyDelete
  71. voyance horoscope Meet the future with the voyance horoscope. Thanks to the astrology, you can discover what will happens in the next weeks and months. And if you are looking for a voyance sérieuse par telephone, the 0892 22 20 22 is waiting for your call, and permits you to discuss with a true fortune-teller which have things to tell you.

    ReplyDelete