The potential ability of WebGPU AI applications

[Aisuko]

I personally believe that the WebGPU AI apps will have potentials than the others. Especially for our next step plan. An example see: https://youtu.be/IWBh5yt5wvM?feature=shared

Our model gallery should support gguf and also @xenova/transformers.

cc @Micost @cbh778899

[Micost]

＠Aisuko do you plan to use WebGPU to replace llamacpp?

[Micost]

@Aisuko

[Aisuko]

No, I'd like to have both of them, like "Apple intelligence". Different solution that focus on different tasks. @cbh778899

[Aisuko]

And also, I think WASM+RUST should better work with transformer.js for some special case.

[cbh778899]

lets discuss about Electron+ to build cross platform application based on WebGPU

[Aisuko]

His working on this idea, will show you as soon as we can @Micost @Murkeee