🎉 🎉 RAPIDMINER 9.10 IS OUT!!! 🎉🎉

Download the latest version helping analytics teams accelerate time-to-value for streaming and IIOT use cases.

CLICK HERE TO DOWNLOAD

Weather Enrich Data by Webservice

DocMusherDocMusher Member Posts: 329   Unicorn
edited December 2018 in Help

Hi,

Someone attempted to add weather data related time and geolocation to a dataset with date (time) and location. 

The aim is to analyse the impact of the weather on disease admission to a hospital. 

Which weather related webservice would be best to integrate in a RM process?

Thanks

Sven

Answers

  • Telcontar120Telcontar120 Moderator, RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 1,625   Unicorn

    Are you looking for actual weather reports (after the fact) or weather forecasting?

     

    One service that I have used before in RapidMiner is the NOAA service, which delivers all sorts of different kinds of weather data via RSS that can be imported into RapidMiner.  Here's a page showing all the different data feeds: http://www.nws.noaa.gov/rss/

    I've used the National Severe Weather Alerts before and tested a few others as well.

     

     

     

    Brian T.
    Lindon Ventures 
    Data Science Consulting from Certified RapidMiner Experts
  • DocMusherDocMusher Member Posts: 329   Unicorn

    Thanks for the reply, its not forecasting I am interested in but historical weather data.

    Thanks

    Sven

  • Thomas_OttThomas_Ott RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 1,760   Unicorn

    There's a bunch of apis for this. Forecast.io and pywws. I used to use pywws to log my weather station data to the web. They have some open source weather station sites that you can upload to where you might be able to get this info using the Enrich operator: https://pywws.readthedocs.io/en/latest/guides/integration.html#other-services

     

  • eyey Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, RMResearcher, Member Posts: 21  RM Research

    Hi Sven,

     

    You can work with webservices in RapidMiner using the Web Mining extension. There you find the operators "Get Page" and "Enrich Data by Webservices". Both can make API calls and the latter also allows to extract data from response and create new attributes from it.

     

    There are tones of APIs available on the web but considering your initial question, you can create a free account for the weather API of the Weather Channel [1]. You get an API key which can be used to invoke API calls such as for their weather forecast service [2]. They also provide historical data. I am attaching a zip with a sample process for your reference. It uses a small dataset with city names (ioo file also attached). The "Enrich data by Webservices" loops over its examples and stuffs this attribute value in the URL. A little ETL is performed to create the expected URL. The "Get Page" is straight forward. The results can be seen in the attached screenshot (also inside zip file).

     

    Hope this helps.

     

    Best Regards,

    Edwin Yaqub

     

    [1] https://www.wunderground.com/signup?mode=api_signup

    [2] https://www.wunderground.com/weather/api/d/docs?d=data/forecast

    mschmitzyyhuang
Sign In or Register to comment.