Building blocks (real ones, not metaphorical ones) are also simple.

Your brain is made of relatively simple cells. Even earthworms have neurons.

But emergent complexity of systems made of simple neurons is staggering! That's the point, I guess. Simple bricks made complex systems.