RapidMiner

How to work and use word2vec

Wisdom logo Registration now open for RapidMiner Wisdom Americas | New Orleans | October 10-12, 2018   Learn More
Contributor II khazan
Contributor II

How to work and use word2vec

Hello
I want to use Word2vec to convert sentences to a vector
But I do not know how to do it? My data is Twitter.
Please help me by sending the operator image
Thanks

25 REPLIES
Highlighted
RM Research RM Research
RM Research

Re: How to work and use word2vec

Hi and welcome to the community.

 

What you need is first install the Word2Vec extension from the RapidMiner marketplace.

Once done you'll find the Word2Vec Operator in the Operators search bar (or use the global search).

 

You can check this excellent post by Martin on how to apply the extension:

https://community.rapidminer.com/t5/RapidMiner-Studio-Knowledge-Base/Synonym-Detection-with-Word2Vec...

 

Best,
David

------------------------------------------------
Senior Data Scientist at RapidMiner research team
Contributor II khazan
Contributor II

Re: How to work and use word2vec

Hello
Thank
I saw the link
Unfortunately, the pictures are not clear.
You may want to send an image of the use of this operator to analyze emotions
Many thanks


@David_A wrote:

Hi and welcome to the community.

 

What you need is first install the Word2Vec extension from the RapidMiner marketplace.

Once done you'll find the Word2Vec Operator in the Operators search bar (or use the global search).

 

You can check this excellent post by Martin on how to apply the extension:

https://community.rapidminer.com/t5/RapidMiner-Studio-Knowledge-Base/Synonym-Detection-with-Word2Vec...

 

Best,
David


 

RM Staff RM Staff
RM Staff

Re: How to work and use word2vec

Dear @khazan,

 

the mentioned post has an attached .zip. It contains the full analysis so you can load it into your RM and use it yourself.

 

Best,

Martin

--------------------------------------------------------------------------
Head of Data Science Services at RapidMiner
Contributor II khazan
Contributor II

Re: How to work and use word2vec

Hello
Thank you for your attention
I downloaded the sample file to use Word2vec And I entered the RapidMiner.
But there is an error.
And I do not know what the process of using this operator is.
Please give me guidance.
thank you again
88.JPG

RM Staff RM Staff
RM Staff

Re: How to work and use word2vec

Hi,

this operator expects a collection of tokenized documents as an input. Not an Example Set.

 

~Martin

--------------------------------------------------------------------------
Head of Data Science Services at RapidMiner

Re: How to work and use word2vec

I also try this nice example and get this error

 

RapidMiner1.JPG

 

My input data

 

RapidMiner2.JPG

 

My data looks like this

 

RapidMiner3.JPG

 

Any hint...?

EDIT - Add RM Logfile

 

 

Thanks!

Thomas

 

RM Staff RM Staff
RM Staff

Re: How to work and use word2vec

Hi,

 

how many docs do you feed in? More than number of negative samples? Can you please try more?

 

Best,

Martin

--------------------------------------------------------------------------
Head of Data Science Services at RapidMiner

Re: How to work and use word2vec

Only this one example from the web page of point 1

The data is provided in one flat file for each hotel with the following structure:

 

<Overall Rating>4
<Avg. Price>$302
<URL>http://www.tripadvisor.com/ShowUserReviews-g60878-d100504-r22932337-Hotel_Monaco_Seattle_a_Kimpton_Hotel-Seattle_Washington.html

<Author>selizabethm
<Content>Wonderful time- even with the snow! What a great experience! From the goldfish in the room (which my daughter loved) to the fact that the valet parking staff who put on my chains on for me it was fabulous. The staff was attentive and went above and beyond to make our stay enjoyable. Oh, and about the parking: the charge is about what you would pay at any garage or lot- and I bet they wouldn't help you out in the snow!
<Date>Dec 23, 2008
<No. Reader>-1
<No. Helpful>-1
<Overall>5
<Value>4
<Rooms>5
<Location>5
<Cleanliness>5
<Check in / front desk>5
<Service>5
<Business service>-1
RM Staff RM Staff
RM Staff

Re: How to work and use word2vec

Hi,

 

you need to provide more data to be able to run word2vec. A single example won't work to train the model. I've tested it and it starts to work with 5 examples.

 

Best,

Martin

--------------------------------------------------------------------------
Head of Data Science Services at RapidMiner