PVA or "white glue" (Elmer's?) will not dissolve the paint, but it is hard to use without being visible when it dries.
For things like you show with the fire extinguishers I would use CA (cyanoacrylate or something sciency like that) or "superglue".
Note, it will also dissolve paint, but unlike the thin cements it is easier to control how much you put and where it goes. I use a superglue that it a bit on the thick side, there are MANY brands and I do not think it matters much. But you can use a toothpick and get a tiny little ball of it under the extinguisher where the dissolved paint will not be seen.