Just put it on and retune. With strap on, tie on, or limb bolt on a take down you will need to retune to some extent. I just put my on and leave them on. I also tune the bow with one arrow missing out of the quiver as this will be the case with my first shot at the entended target.

I have had this problem myself, hard not to use a bow quiver, to make it easier carrying arrows.  But I did notice that if I got certain quivers (tried alot) off the limbs and just on the riser the bow shot the same.  But alas in this great sport we are all a passionate group of individuals.