How to move stuff on the timeline without it sliding around like its running away from me

So sometimes i have stuff on my timeline and i cant lengthen or shorten the clip but i want to move them around. Either to make more space between them or to bring two clips together. But when i try to, i click on it and drag it, and suddenly im somewhere on the other end of the timeline like 5 minutes away when i was trying to move something only a few nanoseconds earlier. And when i try to slide it back im all the way to the beginning of the timeline. Theres never any in between

Click on the timeline to place the playhead, then move things around.