Pages

Mar 12, 2013

Basic steps of applying machine learning methods


Deploying a machine learning model typically takes the following five steps:

1. Data collection.
2. Data preprocessing:
    1) Data cleaning;
    2) Data transformation;
    3) Divide data into training and testing sets.
3. Build a model on training data.
4. Evaluate the model on the test data.
5. If the performance is satisfying, deploy to the real system.

This process can be iterative, meaning we can re-start from step 1 again. For example, after a model is deployed, we can collect new data and repeat this process. Let’s look at the details of each step:

1. Data Collection:  
        At this stage, we want to collect all relevant data. For an online business, user click, search queries, and browsing information should be all be captured and saved into the database.
In manufacturing, log data capture machine status and activities. Such data are used to produce maintenance schedules and predict required parts for replacement.

2. Data Preprocessing:
       The data used in Machine Learning describes factors, attributes, or features of an observation.  Simple first steps in looking at the data include finding missing values.  What is the significance of that missing value?   Would replacing a missing data value with the median value for the feature be acceptable? For example, perhaps the person filling out a questionnaire doesn't want to reveal his salary.  This could be because the person has a very low salary or a very high salary.  In this case, perhaps using other features to predict the missing salary data might be appropriate.  One might infer the salary from the person’s zip code.  The fact that the value is missing may be important.  There are machine learning methods that ignore missing values and one of these could be used for this data set.
          2) Data Transformation: 
          In general we work with both numerical and categorical data.  Numerical data consists of actual   numbers, while categorical data have a few discrete values. Examples of categorical data include eye color, species type, marriage status, or gender.  Actually a zip code is categorical.  The zip code is a number but there is no meaning to adding two zip codes.  There may or may not be an order to categorical data.  For instance good, better, best is descriptive categorical data which has an order.

3) After the data has been cleaned and transformed it needs to be split into a training set and a test set.

3. Model Building:  
        This training data set is used to create the model which is used to predict the answers for new cases in which the answer or target is unknown.   For example, Section 1.3 describes how a decision tree is built using the training data set.  Several different modeling techniques have been introduced and will be discussed in detail in future sections.  Various models can be built using the same training data set.

4. Model Evaluation
         Once the model is built with the training data, it is used to predict the targets for the test data.  First the target values are removed from the test data set.  The model is applied to the test data set to predict the target values for the test data.  The predicted value of the target is then compared with the actual target value.  The accuracy of the model is the percentage of correct predictions made.  These accuracies of can be used to compare the different models.  Several other ways to compare model accuracy are discussed in the next section on Performance Evaluation.

5. Model Deployment:
        This is the most important step.  If the speed and accuracy of the model is acceptable, then that model should be deployed in the real system.  The model that is used in production should be made with all the available data. Models improve with the amount of available data used to create the model. The results of the model need to be incorporated in the business strategy.  Data mining models provide valuable information which give companies great advantages.  Obama won the election in part by incorporating the data mining results into his campaign strategy.   The last chapter of this book provides information in how a company can incorporate data mining results into its daily business.

18 comments:

  1. All steps are so important to learning machine method.

    ReplyDelete
  2. I do agree with you. This model is very important to learn because all concepts are related to the business. If you want a growth of your business it is necessary to learn these things. For that you can join AAtrainingandconsultinguk-business analysis courses online as well. So that you can learn many things regarding business process.

    ReplyDelete
  3. Basic steps of applying machine learning methods!
    Admin this topic give me an idea about my business.This model look like an s/w engineering and topic Spiral Model.In this model the iterative method apply and the steps repeat if the process not complete.We will start our business in step wise if first step complete then second step follow.Is that certified paper about Basic steps of applying machine learning methods! basically i am study about the CCNP 300-101 that paper are relevant to the IP,s and Routing Thanku.

    ReplyDelete
  4. This article has covered the topic quite well. Very informational and interesting. Thanks for sharing this knowledge with us.

    new year, new year images, new year wallpapers, new year quotes, new year wishes, new year sms, new year greetings, cool whatsapp status

    ReplyDelete
  5. Hey Admin!
    Basic steps of applying machine learning methods really fantastic knowledge shared in your blog. I am sure people like your topic and like your theme content. By the way i am find the blog about the Funny Videos this page provide entertaining content and funny content shared. By the way thanks for sharing nice post.

    ReplyDelete
  6. In case you are wanting to involving seeing the method wherein your site actually reaches burgeon like a skilled website, which in turn suits every one of the little requirements from the website visitors, you should definitely get the products and services of any specialized web development company. These are people who find themselves really experienced with this profession, and still have ample understanding of the assorted troubles, that may possibly be raised with this situation.

    ReplyDelete
  7. Contact us for Outbound Calling Services, call centre software, call centre software, telephony applications, Applications For Android and much more.....

    Buzz App

    ReplyDelete
  8. The war between humans, orcs and elves continues earn to die . Lead your race through a series of epic battles, using your crossbow to fend off foes and sending out units to destroy castleshappy wheels . Researching and upgrading wisely will be crucial to your success! There are 5 ages total and each one will bring you new units to train to fight in the war for you cause.
    earn to die 2
    Whatever you do, don’t neglect your home base because you cannot repair it and once it is destroyed, you lose! Age of War is the first game of the series and really sets the tone for the Age of War games . Also try out the Age of Defense series as it is pretty similar.
    In this game, you start at the cavern men’s age, then evolvetank trouble ! There is a total of 5 ages, each with its units and turrets. Take control of 16 different units and 15 different turrets to defend your base and destroy your enemy.
    The goal of the game also differs depending on the level. In most levels the goal is to reach a finish line or to collect tokens. Many levels feature alternate or nonexistent goals for the player. The game controls are shown just under gold miner. Movement mechanisms primarily include acceleration and tilting controls. cubefield
    It consists of a total of 17 levels and the challenge you face in each level increases as you go up. unfair mario The game basically has a red ball that has to be moved across the various obstacles in its path to the goal. slitherio
    In order to gain the highest tanh trouble | tank trouble 2 scores you should try to avoid the difficulties, be smart and quick. The game offers you tank death matches where you should show off your concentration and accurate shots the only way towards success tank trouble 3 . If your performance will be good, the game will reward you. Some bonuses will appear during the game play of tank trouble
    unfair mario

    ReplyDelete
  9. Great! Thanks for sharing the information. That is very helpful for increasing my knowledge in this fiel
    Red Ball | | duck life | Slitherio
    Red Ball 2 | Red Ball 3 | Red Ball 4

    ReplyDelete
  10. Want to know regular updates of Euro Cup 2016????
    Get Euro Cup live Streaming,Euro Cup 2016 Schedule,Euro Cup 2016 Fixture,Euro Cup 2016 Live Streaming,Euro Cup 2016 Live Stream,Euro Cup 2016 Live Score.
    Venue-France,From 10th june-10july. 24 teams,10 stadiums. Stay updated. Watch Portugal vs Poland Live Streaming.

    ReplyDelete
  11. awsome check out online all best and trending video lessons, official website link you will will need to abide by below guidance you by 1 as it is certainly. Videoder Download nice.

    ReplyDelete
  12. My Arcus offer java training with 100% placement. Our java training course that includes fundamentals and advance java training program with high priority jobs. java j2ee training with placement having more exposure in most of the industry nowadays in depth manner of java .

    java training in chennai

    ReplyDelete
  13. good Daily stats reveals that practically 60000 photographs Psiphon for pc and Explore yourself with the PicsArt on your computer system. nice.

    ReplyDelete
  14. The game controls are shown just under . Movement mechanisms primarily include acceleration and tilting controls.
    five nights at freddy's 2 | five nights at freddy's 4 |
    fireboy and watergirl 2 | 2048 online | zombies plants | red ball 6

    ReplyDelete