Hive properties per Radoop Nest

daniel_moserdaniel_moser Member Posts: 2 Contributor I
edited November 2018 in Help

Hi,

 

is it somehow possible to set additional Hive properties on a Radoop Nest basis? 

 

Thanks,

Daniel

Tagged:

Answers

  • phellingerphellinger Employee, Member Posts: 103 RM Engineering

    Hi Daniel,

     

    not without creating a new Radoop connection with the different advanced Hive properties, that you can then select as the Nest's connection.

     

    Can you share your use case, like what properties would be helpful to have on the Nest level?

     

    Best,

    Peter 

  • daniel_moserdaniel_moser Member Posts: 2 Contributor I

    Hi Peter,

     

    thanks for your answer. In my case I have a join which fails with an OOM exception. However, setting hive.auto.convert.join to false resolves this problem. In general I would like to use MapJoins though, so it would be nice if I could set this property only for the nest with this join.

     

    Best,

    Daniel

  • phellingerphellinger Employee, Member Posts: 103 RM Engineering

    Hi Daniel,

     

    that could be a useful feature, I take a note.

     

    Maybe even setting these properties on an operator level (not just the Nest) could help. Of course, we do not want to make the parameters too complicated, but the need to have a general way to alter the behavior like this often comes up with Hadoop.

     

    Best,

    Peter

Sign In or Register to comment.