Storing proprietary data inside a bundle

glow
1

Hi,

We currently develop a Glow backend for CEVA target DSP that supports AOT (offline) compilation mode.

During the bundle creation stage, our backend generates metadata which is required by the target DSP during runtime.

We need to access this data from the main application on the ARM host before it calls the bundle entry point to start the actual Glow inference process.

Is there an existing mechanism in Glow that allows the backend to store proprietary raw data inside the bundle or the weights file, and then access it during inference initialization?

If not, is it possible then for the backend to write the data to a “private” file and then open it for read during runtime?

Thanks

2

Hi, AFAIK currently there is no such ability to save the metadata, at least not in a hacky way (e.g. create some Constant blob that has a single Save user that will then be written out as part of the Constant weights). However it should be relatively simple for the backend to do this – just save it to some location on disk, and then in the driver file that loads the weights you can also add your own custom handling to load the file and do with it whatever you need.

3

Thanks for your reply.