failed to get database default returning NoSuchObjectException
When I start spark I get this warnings:
Using Scala version 2.10.5 (OpenJDK 64-Bit Server VM, Java 1.8.0_77) Type in expressions to have them evaluated. Type :help for more information. Spark context available as sc. 16/04/03 15:07:31 WARN Connection: BoneCP specified but not present in CLASSPATH (or one of dependencies) 16/04/03 15:07:31 WARN Connection: BoneCP specified but not present in CLASSPATH (or one of dependencies) 16/04/03 15:07:39 WARN ObjectStore: Version information not found in metastore. hive.metastore.schema.verification is not enabled so recording the schema version 1.2.0 16/04/03 15:07:39 WARN ObjectStore: Failed to get database default, returning NoSuchObjectException SQL context available as sqlContext. scala>
And also when I execute this command: var sqlContext = new org.apache.spark.sql.hive.HiveContext(sc)
I get again this warning:
scala> var sqlContext = new org.apache.spark.sql.hive.HiveContext(sc) 16/04/03 15:04:31 WARN Connection: BoneCP specified but not present in CLASSPATH (or one of dependencies) 16/04/03 15:04:31 WARN Connection: BoneCP specified but not present in CLASSPATH (or one of dependencies) 16/04/03 15:04:35 WARN ObjectStore: Failed to get database default, returning NoSuchObjectException sqlContext: org.apache.spark.sql.hive.HiveContext = org.apache.spark.sql.hive.HiveContext@13453610
So my question is if you know why this warning is happening and if, although the warning is happening, the command var sqlContext = new org.apache.spark.sql.hive.HiveContext(sc)
its working correctly?
BoneCP is a Java JDBC connection pool and it's tries to bind to a JDBC connection and this is why you receive these warnings. You may suppress this kind of warnings by configure the logger level.
Solved: Re: Spark failed to get database default, ObjectStore: Failed to get database default, returning NoSuchObjectException. SQL context available as sqlContext. Is this some bug related to Spark 1.6? The exception " objectStore: failed to get database default, returning NoSuchObjectException" has a background story. We have derby which will act as a default database for hive meta store when a proper hive.metastore.warehouse.location is not specified in your hive-site.xml.
I meet this warning,too as :
"Failed to get database default, returning NoSuchObjectException"
but i can connect to hive correctly,so check your hive-site.xml
and i am not sure if this warning will affect the sentry.
ObjectStore: Failed to get database default, returning , 0 17/01/17 03:48:40 WARN ObjectStore: Failed to get database default, returning NoSuchObjectException root |-- action: string (nullable = true) |-- device_os_ver: � OS:ubuntu14.04 LTS 3 vms, 1, having start hadoop cluster with 3 nodes; 2, having start spark's standalone deploy mode cluster with 3 nodes by sbin/start-all.sh 3, then before entering scala console, an exception happened as below, but can type :help command.
Check if you have assigned SQLContext:
sqlContext = pyspark.SQLContext(sc)
[#SPARK-14067] spark-shell WARN ObjectStore: Failed to get , spark-shell WARN ObjectStore: Failed to get database default,returning NoSuchObjectException. Status: Assignee: Priority: Resolution: Closed. 17/06/22 19:30:59 WARN metastore.ObjectStore: Failed to get database default, returning NoSuchObjectException SQL context available as sqlContext. Is this some bug related to Spark 1.6?
(SPARK-14067) spark-shell WARN ObjectStore: Failed to get , Subject, [jira] [Created] (SPARK-14067) spark-shell WARN ObjectStore: Failed to get database default,returning NoSuchObjectException. question 19 : CCA175 Certification Preparation guide, study Guide, Training, Doubts, Discounts, Cloudera Certification Hadoop and Spark Questions, CCA175 Dumps, CCA175 PDF Download, HadoopExam review
16/12/21 03:14:52 WARN ObjectStore: Failed to get database default, returning NoSuchObjectException . 16/12/21 03:15:00 WARN ObjectStore: Version information not found in metastore. hive.metastore.schema.verification is not enabled so recording the schema version 1.2.0
15/09/22 18:46:27 WARN ObjectStore: Failed to get database default, returning NoSuchObjectException 15/09/22 18:46:27 WARN : Your hostname, DESKTOP-8JS2RD5 resolves to a loopback/non-reachable address: fe80:0:0:0:0:5efe:c0a8:103%net1, but we couldn't find any external IP address! java.lang.RuntimeException: java.lang.NullPointerException
Comments
- Thanks for your answer. And the other warning about failed to get database default? Do you know if although the warning is appearing the command works correctly?
- Why is it returning a NoSuchObjectException! and Failure?