Should I be leaving bases I'm sitting in Battleground Blitz?

A teammate was telling me that I should be leaving to go fight at other bases when I'm sitting a base in AB or DG. I feel like there isn't enough time to go to another base and fight and get back in time to cap the flag in 40 seconds. Am I right or were they right and it's a skill issue on my part?