Edit: OK, start with 2 half arches and cross them together:
exampleNote the points of intersection between them:
exampleClip them so that the points of intersection line up:
exampleAlways remember to check if this caused any vertices to fall off the grid. If this happened, just correct them with some quick VM work.
You can also cut each brush of the arch into a triangular prism if this causes any invalid solids.Duplicate and mirror your brushes, then put some space between them:
exampleFor that cool thin piece, you can just duplicate half of one of your arches...
example...and use VM to match all of the vertices:
exampleYou shouldn't ever have to worry about these becoming invalid solids because all of the brushes' faces will all be oriented the same way. This piece should ALWAYS be at a 45 degree angle.
You only need to do this once. Just duplicate the rest:
exampleSo this is what you end up with.For more complex structures or wider angles, like the curved walls to the right and far left of your screenshot, start with one arch that is wider than the other.