Failing trino-minio setup

[iuliu-b]

After pulling the latest version I'm getting a failure different from #45 Edit: scratch that, see extended stack trace: it's the same error as before

hive-metastore_1     | Metastore connection URL:	 jdbc:mysql://mariadb:3306/metastore_db
hive-metastore_1     | Metastore Connection Driver :	 com.mysql.cj.jdbc.Driver
hive-metastore_1     | Metastore connection User:	 admin
hive-metastore_1     | Starting metastore schema initialization to 3.0.0
hive-metastore_1     | Initialization script hive-schema-3.0.0.mysql.sql
hive-metastore_1     | 1/506        -- MySQL dump 10.13  Distrib 5.5.25, for osx10.6 (i386)
hive-metastore_1     | 2/506        --
hive-metastore_1     | 3/506        -- Host: localhost    Database: test
hive-metastore_1     | 4/506        -- ------------------------------------------------------
hive-metastore_1     | 5/506        -- Server version	5.5.25
hive-metastore_1     | 6/506        
hive-metastore_1     | 7/506        /*!40101 SET @OLD_CHARACTER_SET_CLIENT=@@CHARACTER_SET_CLIENT */;
hive-metastore_1     | Warning: Unknown column 'RESERVED' in 'where clause' (state=42S22,code=1054)
hive-metastore_1     | java.sql.SQLWarning: Unknown column 'RESERVED' in 'where clause'
hive-metastore_1     | 	at com.mysql.cj.protocol.a.NativeProtocol.convertShowWarningsToSQLWarnings(NativeProtocol.java:2065)
hive-metastore_1     | 	at com.mysql.cj.jdbc.StatementImpl.getWarnings(StatementImpl.java:1733)
hive-metastore_1     | 	at sqlline.Commands.execute(Commands.java:828)
hive-metastore_1     | 	at sqlline.Commands.sql(Commands.java:733)
hive-metastore_1     | 	at sqlline.SqlLine.dispatch(SqlLine.java:795)
hive-metastore_1     | 	at sqlline.SqlLine.runCommands(SqlLine.java:1706)
hive-metastore_1     | 	at sqlline.Commands.run(Commands.java:1317)
hive-metastore_1     | 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore_1     | 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore_1     | 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore_1     | 	at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore_1     | 	at sqlline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:38)
hive-metastore_1     | 	at sqlline.SqlLine.dispatch(SqlLine.java:791)
hive-metastore_1     | 	at sqlline.SqlLine.initArgs(SqlLine.java:595)
hive-metastore_1     | 	at sqlline.SqlLine.begin(SqlLine.java:643)
hive-metastore_1     | 	at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.runSqlLine(MetastoreSchemaTool.java:1034)
hive-metastore_1     | 	at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.runSqlLine(MetastoreSchemaTool.java:1007)
hive-metastore_1     | 	at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.doInit(MetastoreSchemaTool.java:596)
hive-metastore_1     | 	at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.doInit(MetastoreSchemaTool.java:574)
hive-metastore_1     | 	at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.run(MetastoreSchemaTool.java:1273)
hive-metastore_1     | 	at org.apache.hadoop.hive.metastore.tools.MetastoreSchemaTool.main(MetastoreSchemaTool.java:1178)
hive-metastore_1     | 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore_1     | 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore_1     | 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore_1     | 	at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore_1     | 	at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
hive-metastore_1     | 	at org.apache.hadoop.util.RunJar.main(RunJar.java:236)

hive-metastore_1     | MetaException(message:Error creating transactional connection factory)
hive-metastore_1     | 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:84)
hive-metastore_1     | 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:93)
hive-metastore_1     | 	at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:8541)
hive-metastore_1     | 	at org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:8536)
hive-metastore_1     | 	at org.apache.hadoop.hive.metastore.HiveMetaStore.startMetaStore(HiveMetaStore.java:8806)
hive-metastore_1     | 	at org.apache.hadoop.hive.metastore.HiveMetaStore.main(HiveMetaStore.java:8723)
hive-metastore_1     | 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
hive-metastore_1     | 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
hive-metastore_1     | 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
hive-metastore_1     | 	at java.lang.reflect.Method.invoke(Method.java:498)
hive-metastore_1     | 	at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
hive-metastore_1     | 	at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
hive-metastore_1     | Caused by: MetaException(message:Error creating transactional connection factory)
hive-metastore_1     | 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:208)
hive-metastore_1     | 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
hive-metastore_1     | 	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:80)
hive-metastore_1     | 	... 11 more

[bitsondatadev]

Ah, okay I think this calls for a refactoring. At this point there are a few catalog options and I need to add REST to this catalog and I'll see if there are upstream issues going on or if there was a change in the configuration for HMS I need to figure out.

Thanks for continuing to report this! @tschaub also thanks for removing the other config that was breaking everything :) I need to reconsider how I manage these configs at some point. It would be nice to create a primary template that would allow for extra properties for each subproject.

[bitsondatadev]

I think a setup like this would be beneficial with a tutorial on catalogs.

[iuliu-b]

@bitsondatadev

I'll see if there are upstream issues going on or if there was a change in the configuration for HMS I need to figure out

Correct me if I'm wrong - seems like the HMS image is fixed at 3.0.0 (this project's compose file is targeting bitsondatadev/hive-metastore:latest, but bitsondatadev/hive-metastore itself has 3.0.0 hardcoded) - so HMS configuration couldn't have changed?

Asking because I'd love to have a working version of trino-minio to play around with, and am wondering if the answer is to walk back through the package versions of the latest depedencies (trinodb/trino:latest, mariadb:latest, minio/minio:latest) until I reach a working hardcoded version set)

[iuliu-b]

I think the root cause is this issue sysown/proxysql#3017

and the project works fine using mariadb:10.6.16

[bitsondatadev]

resolved with #55