Getting Started with AI and WebAssembly - Angel M De Miguel Meana, VMware & Michael Yuan

Getting Started with AI and WebAssembly - Angel M De Miguel Meana, VMware & Michael Yuan, WasmEdge / Second State
AI/ML (Artificial Intelligence / Machine Learning ) and related technologies are everywhere nowadays. After the release of popular products like ChatGPT, both users and developers realized the new possibilities that this technology opens. In this talk, we will cover WASI-nn, which is a technology that sits at the crossroads of AI/ML and WebAssembly. WASI-nn is a standard proposal for performing ML inference. It allows WebAssembly modules to call the low-level bits required for running the inference. Wasi-nn abstracts the module from the underlying system, allowing the host to use any available hardware. In other words, you can use the same module to run inference in a server, a browser or in an IoT edge device. We will explain the basic concepts and showcase multiple demos using different runtimes such as Wasmtime and WasmEdge, as well as more complete applications like Wasm Workers Server. After this talk you will be ready to build and deploy your first AI/ML application using Wasm.