This are some discussions internally on how to support Coral within TFJS. I think the best solution forward is to compile TFLite + Coral runtime + libusb natively for RaspberryPI, and provide the node (NAPI buiding) API similar to tfjs-node for TensorFlow (CPU and GPU).
It can use the same API as TFJS-TFLite library but everything runs natively.