Due to recent updates, all users are required to create an Altair One account to login to the RapidMiner community. Click the Register button to create your account using the same email that you have previously used to login to the RapidMiner community. This will ensure that any previously created content will be synced to your Altair One account. Once you login, you will be asked to provide a username that identifies you to other Community users. Email us at Community with questions.

How can I set tblproperties on hive table?

cesar_ortizcesar_ortiz Member Posts: 10 Contributor II
in Help
I want to create a hive table in PARQUET format but also compressed with SNAPPY. Can't find the way with the Store in Hive operator.
Any help would be appreciated 
Tagged:

Answers

  • Pavithra_RaoPavithra_Rao Employee, RapidMiner Certified Analyst, RapidMiner Certified Expert, Member Posts: 123 RM Data Scientist
    @cesar_ortiz
    Store in Hive has a parameter 'custom storage' If selected, a new parameter called 'impala file format' there you could select 'PARQUET '.

    Hope this helps.
  • cesar_ortizcesar_ortiz Member Posts: 10 Contributor II
    @Pavithra_Rao
    The parameter 'hive file format' also has the option for PARQUET, ORC, AVRO,… but I wanted to change the compression algorithm.

    After experimenting with hive CLI, I realized the Store in Hive operator creates the table in Parquet with the default compression algorithm, in this case, Snappy. Good enough for the moment but would be nice to have the option to change to gzip or lzo.

    Thanks for your help
Sign In or Register to comment.