Deploy Transformer Models in the Browser with

[@neoblackcyptron]

This is really helpful it is surprising that very few people have checked this video out. Shows the market is more focused on cloud based LLMs rather than private LLMS that guarantee data security. This video is will do well in the coming future when the tides shift.

[@seikatsu_ki]

This instructor is actually an angel, thank you Madam for the straightforward tutorial!

[@santoshmohanram536]

Really helpful thanks.

[@Gerald-iz7mv]

Nice. How to convert it to onnx using cuda?

[@helaluddinmullah2869]

I have trained a new transformer model (dinov2) for image classification on own data and locally saved the checkpoint. Now I want to convert this dinov2 model into onnx. Since the saved checkpoint is a directory containing several files (no a single .pth file), how to convert it to onnx?

[@nmstoker]

Check out around 4m18s in the video and it shows how to do it in code

[@jn-zr2ki]

very useful and clear

[@ONNXRuntime]

Thank you!!

[@nemines001]

hi thanks for this video

[@ONNXRuntime]

You're welcome!! 😊

[@amanbishnoi6894]

there is a bug- InvalidArgument: [ONNXRuntimeError] : 2 : INVALID_ARGUMENT : Unexpected input data type. Actual: (tensor(int32)) , expected: (tensor(int64))

[@ONNXRuntime]

Hi, your comment is appreciated, and we want to follow up on this. Could you file an issue in ORT repo with details so we can take a look? github.com/microsoft/onnxruntime

[@KrisMerckx]

This is not "in the browser". This is still node.js. That's server technology.

[@nocomment00]

Well actually 🤓☝