You can do it without removing it or holding it out. You just have to go at an angle from the top and bottom. What sometimes helps is if you turn the little directional piece(in the tip) 90· Doing this will change the spray pattern. You will be able to get the spray can in and follow the handle horizontally. This catching behind the handle.