When a smaller buck keeps looking back on the trail he just arrived on it could be because he is keeping tabs on a larger more dominant buck. If you see this happening try to refrain from shooting the smaller buck until you can verify what has it's attention.