当前位置: 代码迷 >> 综合 >> Hive动态分区表导入数据时报错
  详细解决方案

Hive动态分区表导入数据时报错

热度:22   发布时间:2023-09-14 14:34:22.0

主要报错信息如下:

Fatal error occurred when node tried to create too many dynamic partitions. The maximum number of dynamic partitions is controlled by hive.exec.max.dynamic.partitions and hive.exec.max.dynamic.partitions.pernode. Maximum was set to: 100

解决方法:

在执行插入数据到分区时,添加参数设置:
set hive.exec.dynamic.partition=true;
set hive.exec.dynamic.partition.mode=nonstrict;
set hive.exec.max.dynamic.partitions.pernode=10000;
set hive.exec.max.dynamic.partitions=10000;
set hive.exec.max.created.files=10000;