🎉 🎉 RAPIDMINER 9.10 IS OUT!!! 🎉🎉

Download the latest version helping analytics teams accelerate time-to-value for streaming and IIOT use cases.

CLICK HERE TO DOWNLOAD

How can I set tblproperties on hive table?

cesar_ortizcesar_ortiz Member Posts: 10 Contributor I
I want to create a hive table in PARQUET format but also compressed with SNAPPY. Can't find the way with the Store in Hive operator.
Any help would be appreciated 
Tagged:

Answers

  • Pavithra_RaoPavithra_Rao Administrator, Moderator, Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 123  RM Data Scientist
    @cesar_ortiz
    Store in Hive has a parameter 'custom storage' If selected, a new parameter called 'impala file format' there you could select 'PARQUET '.

    Hope this helps.
  • cesar_ortizcesar_ortiz Member Posts: 10 Contributor I
    @Pavithra_Rao
    The parameter 'hive file format' also has the option for PARQUET, ORC, AVRO,… but I wanted to change the compression algorithm.

    After experimenting with hive CLI, I realized the Store in Hive operator creates the table in Parquet with the default compression algorithm, in this case, Snappy. Good enough for the moment but would be nice to have the option to change to gzip or lzo.

    Thanks for your help
    Pavithra_Rao
Sign In or Register to comment.