RapidMiner

RapidMiner

Hive properties per Radoop Nest

Contributor

Hive properties per Radoop Nest

Hi,

 

is it somehow possible to set additional Hive properties on a Radoop Nest basis? 

 

Thanks,

Daniel

3 REPLIES
RMStaff

Re: Hive properties per Radoop Nest

Hi Daniel,

 

not without creating a new Radoop connection with the different advanced Hive properties, that you can then select as the Nest's connection.

 

Can you share your use case, like what properties would be helpful to have on the Nest level?

 

Best,

Peter 

Contributor

Re: Hive properties per Radoop Nest

Hi Peter,

 

thanks for your answer. In my case I have a join which fails with an OOM exception. However, setting hive.auto.convert.join to false resolves this problem. In general I would like to use MapJoins though, so it would be nice if I could set this property only for the nest with this join.

 

Best,

Daniel

RMStaff

Re: Hive properties per Radoop Nest

Hi Daniel,

 

that could be a useful feature, I take a note.

 

Maybe even setting these properties on an operator level (not just the Nest) could help. Of course, we do not want to make the parameters too complicated, but the need to have a general way to alter the behavior like this often comes up with Hadoop.

 

Best,

Peter