I would leave it until the end and put a matt varnish over the lot to seal it, then just add the gloss prop afterwards.

Only a suggestion, you need to be happy with your build the way you envisaged it.

Pantherman