Model Compatibility Testing?

[JoshuaChil]

Hey all, apologies if this is already implemented - I'm new to on-device AI and have been exploring this repo out of interest. Would the project benefit from the addition of Model Compatibility checks, which allow devs to quickly log if a given model can run on their device? Was primarily curious if this exists for the React Native SDK. Thanks!

[shubhammalhotra28]

This would be a great addition. We don't have this functionality within any of our SDK.
Although we do support llamacpp format i.e ggml/gguf and then onnx format as well.

If we could also add like some performance metrics or quality metrics - i think it would add a lot of value too.

[shubhammalhotra28]

That's interesting, let me know if there's any issues!!
Also, if there's any new feature or support you'd like let us know - will try to prioritize that as well. We'll be open sourcing our roadmap soon.

[JoshuaChil]

Sounds amazing. I believe this is already in progress, but vision-language model support would definitely be helpful!

[shubhammalhotra28]

yes they're going to be coming up soon :)
Also, feel free to share the POC of the smart glasses - seems super interesting

[JoshuaChil]

Would love to share more details in private channels. Is e-mail a good way to reach you?

[shubhammalhotra28]

Sure, please feel free to join discord : https://discord.gg/6E3RgJUm
Email : shubham@runanywhere.ai