🎉 🎉 RAPIDMINER 9.10 IS OUT!!! 🎉🎉

Download the latest version helping analytics teams accelerate time-to-value for streaming and IIOT use cases.

CLICK HERE TO DOWNLOAD

Applying Normalization Parameters of Training Set to Test Set

JonesFoxJonesFox Member Posts: 5 Newbie
Hi,

before training a Neural Network the training set has to be normalized, e.g. with z-score. 
Before validating the model, one would also normalize the test set by using the normalization parameters obtained from the normalization of the training set. This is done to prevent information leakage through normalization.

In SKlearn this can be done by fitting a scaler on the training set (scaler_A.fit(training_data)) and normalizing the test set using the same scaler (scaler_A.transform(test_data))

How can this be achieved with the normalization block in RapidMiner?

Thanks!


Tagged:

Best Answer

  • mschmitzmschmitz Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, University Professor Posts: 3,123  RM Data Scientist
    Solution Accepted
    Hi,
    thats why the Normalize has this pre port. Its a preprocessing model which you can apply on the test set like a normal model.

    Best,
    Martin
    - Head of Data Science Services at RapidMiner -
    Dortmund, Germany
    BalazsBarany
Sign In or Register to comment.