Menu

What if diffusion models generates Neural Network weights? Gen AI generate Gen AI [R]

Reading 0:00
15s threshold

I'have been dreaming about using a Diffusion Model that will generates Weights instead of pixels.

Diffusion models actually are vast used in order to generate from a natural language text description into images, and what is an image? a three dimensional matrix of value representig luminosity of red , green and blue. What if instead of matrix of colour intensity we train a diffusion model in order to create a neural network, and maybe a drawing NN too.

If it works you can ask something like:

"create me a neural network that will guide a pen in order to draw a man"

"create a NN of a game field where i have two paddle on left and right side of the field and a bounching ball..."....to create Pong

and in the future more complex scenarios!

I made, with the help of z.ai zcode and their fantastic GLM model a small POC that i published on my github:

https://github.com/vagrillo/nngen

It's a very small experimental implementation , but somenthing seems to work!

I have not find paper on similar implementation…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.