You don't need protein to build muscle per se....
AMINO ACIDS build muscle, protein is just the middle man...
If you can ingest enough food that will (combined) cotain a complete amino acid profile for your body to use then you will build muscle.
Lots of vegan bodybuilders out there, some really big too.