Submit Radoop jobs to specific queues

bhupendra_patilbhupendra_patil Employee, Member Posts: 167  RM Data Scientist
edited November 2018 in Knowledge Base

Depending on the cluster configuration and nature of Radoop jobs there may be a need to allocate the jobs to specific queue.

 

Such needs can be handled by specifying the queues to use in the Radoop configuration dialog.

Add "mapred.job.queue.name"  as the property and the queue name as the value in the  added to Advanced Hadoop Parameters

for Hive, it is the same added to Advanced Hive Parameters

for Hive on Tez it is tez.queue.name property that controls it.

for Spark, it is "spark.yarn.queue" added to Advanced Spark Parameters 

Tagged:
Thomas_Ott
Sign In or Register to comment.