RapidMiner 9.8 Beta is now available

Be one of the first to get your hands on the new features. More details and downloads here:

GET RAPIDMINER 9.8 BETA

loop files in Amazon S3 bucket (reposted)

sgenzersgenzer 12Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,954  Community Manager
edited December 2018 in Product Feedback - Resolved
Hi...how do I use the "loop files" operator to loop inside an Amazon S3 folder (which is inside a bucket of course)?

[reposted from December - got no response! :( ]
0
0 votes

Fixed and Released · Last Updated

Comments

  • Marco_BoeckMarco_Boeck Team Lead Software Engineering Administrator, Moderator, Employee, Member, University Professor Posts: 1,944   RM Engineering
    Hi,

    There is no out of the box way to loop over S3 files. It should be possible to do it via "Execute Program" which executes AWS commandline tools which then write the file names into a file which is then read and prepared via some other "Loop" operator and fed to a "Read Amazon S3" operator. Unfortunately, there is currently no convenient way.

    Regards,
    Marco
  • sgenzersgenzer 12Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,954  Community Manager
    yeah that's what I was afraid you'd say.  OK.  Feature request?  ;)
  • robinrobin Member Posts: 100  Guru

    And just to add to this request, not only being able to loop through data files but to also be able to pull images and their names down from the S3 bucket to feed into decisioning on which images to server on ad platforms. 

  • sgenzersgenzer 12Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,954  Community Manager

    Pushing to Product Ideas.


    Scott

     

  • robinrobin Member Posts: 100  Guru

    aws s3 ls s3://bucketname

  • sgenzersgenzer 12Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,954  Community Manager
Sign In or Register to comment.