hive2.1.1 和 spark2.1.2

云计算 waitig 885℃ 百度已收录 0评论

把hive-site.xml 配置copy到spark conf 配置目录下,
启动完spark2.12,用pyspark命令进入,会报

Caused by: org.apache.hadoop.hive.metastore.api.MetaException: Hive
Schema version 1.2.0 does not match metastore’s schema version 2.1.0
Metastore is not upgraded or corrupt

最终解决方案是修改hive-site.xml里的配置去掉验证。

<property>
    <name>hive.metastore.schema.verification</name>
    <value>false</value>
</property>

参考:
https://stackoverflow.com/questions/43518683/could-not-connect-apache-spark-2-1-0-with-hive-2-1-1-metastore


本文由【waitig】发表在等英博客
本文固定链接:hive2.1.1 和 spark2.1.2
欢迎关注本站官方公众号,每日都有干货分享!
等英博客官方公众号
点赞 (0)分享 (0)