"How to split a tokenized document into several documents?"

MSEMISMSEMIS Member Posts: 3 Contributor I
edited June 2019 in Help

We download a page from the web with the module "Get Page" and split the relevant data with "Extract Content", later we want to tokenize each extracted div as a single document.
Is there a possibly to do this?
With "Cut Document" we need regular expressions but every div has a different content (movie reviews) and the HTML tags are also removed.
So we are wondering how to define a splitting point for different reviews.

Thanks in advance
Sign In or Register to comment.