Options

loop files in Amazon S3 bucket (reposted)

sgenzersgenzer Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 Community Manager
edited December 2018 in Product Feedback - Resolved
Hi...how do I use the "loop files" operator to loop inside an Amazon S3 folder (which is inside a bucket of course)?

[reposted from December - got no response! :( ]
0
0 votes

Fixed and Released · Last Updated

Comments

  • Options
    Marco_BoeckMarco_Boeck Administrator, Moderator, Employee, Member, University Professor Posts: 1,996 RM Engineering
    Hi,

    There is no out of the box way to loop over S3 files. It should be possible to do it via "Execute Program" which executes AWS commandline tools which then write the file names into a file which is then read and prepared via some other "Loop" operator and fed to a "Read Amazon S3" operator. Unfortunately, there is currently no convenient way.

    Regards,
    Marco
  • Options
    sgenzersgenzer Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 Community Manager
    yeah that's what I was afraid you'd say.  OK.  Feature request?  ;)
  • Options
    robinrobin Member Posts: 100 Guru

    And just to add to this request, not only being able to loop through data files but to also be able to pull images and their names down from the S3 bucket to feed into decisioning on which images to server on ad platforms. 

  • Options
    sgenzersgenzer Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 Community Manager

    Pushing to Product Ideas.


    Scott

     

  • Options
    robinrobin Member Posts: 100 Guru

    aws s3 ls s3://bucketname

  • Options
    sgenzersgenzer Administrator, Moderator, Employee, RapidMiner Certified Analyst, Community Manager, Member, University Professor, PM Moderator Posts: 2,959 Community Manager
Sign In or Register to comment.