Coral edge tpu bindings for tf.js

[oveddan]

I'm not sure if this is possible, but:

the current starter code for the Coral edge board on Raspberry Pi contains python bindings for the c++ edge tpu engine. Would it be possible to create tf.js node bindings as well? It would be awesome to be able to use javascript for this, especially because of its non-blocking nature, and types provided by typescript.

[ericpelland]

I would love to see this as well!! Please and thank you!

[chenqing]

+1

[larsgk]

Another option could be to make e.g. the accelerator work directly with a web application (e.g. using WebUSB)

[dsmilkov]

Thanks for filling this. Unfortunately, we don't have the bandwidth to do this. Also, I think this would be best as an external project and the TF.js team can help provide guidance and feedback.

[EddieOne]

Using the Coral TPU is shocking fast. Would be amazing to get the Coral team to make a tfjs module. For me at least, I want to do scheduling in Node as it works with the pi camera and motor controllers. We are not too far off from having a computer that can plug itself in.

[EddieOne]

Just to update everyone

We have already received this feature request and our engineering team is analysing this. However, We don't have this on our roadmap as of now.

[bhack]

This could be interesting in the roadmap to run out of the browser:
tensorflow/mlir#140

[larsgk]

I am wondering - is there a reason for the .so files to only be closed source? If Coral were to open it, others could add support

[EddieOne]

Yeah I am disappointed with the Google Coral implementation. Maybe a better setup in my case is to use something like the Nvidia Jetson. Can someone confirm TFJS works with GPUs in NodeJs?

[moeiscool]

@EddieOne apparently tfjs works with CUDA GPUs https://github.com/tensorflow/tfjs/tree/master/tfjs-node. im not sure about the browser version

I really want to get a Coral though, but until it has Node.js support its kind of useless to me

[EddieOne]

For evaluation, it's like having a big GPU. Easily 30 frames per second. Yet, it only takes a tiny amount of power. Can run off batteries for hours with no motors running. In that way it is amazing. A lot of work if you need to do things in NodeJs + Python

[EddieOne]

Hello everyone, people are starting to notice the power of TFJS. If you want Coral support, please do this 5 min survey! https://t.co/RdQ9YreToH?amp=1