The swing looks flimsy not being boxed up until the rear end. And the brake force on that small bolt will be far too great and cause it to fail. Not a good or sturdy design.
Oh I don't like the sound of that. This is almost 1/4" steel and those bolts on the brake arm are 3/8", just for scale. You would box the arm all the way to the axle?