We keep moving because there isn't any force to counteract your movement. And yes asteroids do create gravity, we all do, but there is still enough force from planets to make it so the asteroids don't have a effect. (Planets do effect while your in space just not nearly as much.)