System tables queries

[BadMachine]

Specifications

• Client Version: 1.1.0
• InfluxDB Version: Core/Enterprise (3.2)
• Platform: Win

Code sample to reproduce problem

const { InfluxDBClient } = require('@influxdata/influxdb3-client');

const host = 'http://addr:port';
const token = 'apiv3_token';
const database = '_internal'

const client = new InfluxDBClient({ host , token, database})

const query = `
    SELECT * from system.databases`;

const main = async () => {
	const queryResult = await client.query(query, database)

	for await (const row of queryResult) {
		console.log(`avg is ${row}`)

	}
}

main();

Expected behavior

All queries to the system tables work just fine

Actual behavior

Some of them fail due to a parsing error

Additional info

Some of the queries fail with parsing error (comes from apache-arrow dependency).
To reproduce: try to query system.databases and you will see the error. At the same time if you try to query from system.queries it works just fine

[NguyenHoangSon96]

Hi @BadMachine
Thank you for reaching out.
Can you upload the code sample again. I could not see it for some reason.

[BadMachine]

@NguyenHoangSon96
I put the code example

The trace is:

C:\temp\influx_example\node_modules\apache-arrow\ipc\metadata\message.js:402
    throw new Error(`Unrecognized type: "${type_js_1.Type[typeId]}" (${typeId})`);
          ^

Error: Unrecognized type: "undefined" (24)
    at decodeFieldType (C:\temp\influx_example\node_modules\apache-arrow\srcipc\metadata\message.ts:493:11)
    at Function.decodeField (C:\temp\influx_example\node_modules\apache-arrow\srcipc\metadata\message.ts:384:16)
    at decodeSchemaFields (C:\temp\influx_example\node_modules\apache-arrow\srcipc\metadata\message.ts:355:33)
    at Function.decodeSchema (C:\temp\influx_example\node_modules\apache-arrow\srcipc\metadata\message.ts:295:20)
    at Message._createHeader (C:\temp\influx_example\node_modules\apache-arrow\srcipc\metadata\message.ts:229:54)
    at Message.header (C:\temp\influx_example\node_modules\apache-arrow\srcipc\metadata\message.ts:132:35)
    at AsyncRecordBatchStreamReaderImpl.<anonymous> (C:\temp\influx_example\node_modules\apache-arrow\srcipc\reader.ts:5

I found this issue on apache-arrow github repository apache/arrow#46073

[BadMachine]

With python pyarrow.flight response is

|    | database_name                       |   retention_period_ns | deleted   | hard_deletion_time   |
|---:|:------------------------------------|----------------------:|:----------|:---------------------|
|  0 | _internal                           |                   nan | False     | NaT                  |
|  1 | test                                |                   nan | False     | NaT                  |
|  2 | sample-bird-migration-1753351273642 |                   nan | False     | NaT                  |

influxdb_client_3 python package gives the same result as above with the raw Flight client implementation

[BadMachine]

So basically it's just a serialization issue, probably on Apache-Arrow js side

[NguyenHoangSon96]

Hi @BadMachine
After some investigations, we have found that the cause is that Influxdb is using an arrow type "Utf8View" that is not supported by the arrow-js library. Currently, there is a request for adding support for "Utf8View" in the arrow-js library Link, but I'm not sure when they will start working on this 😃.
We will try to find a way to work around this (temporarily).

[BadMachine]

@NguyenHoangSon96. Got you. Thanks