what is wrong with my torch (or myself)

Okay so really basic, i have a torch, it’s empty. i have a butane bottle to refill it, over half full. here’s the issue. took WAY too long to realize that the intake on the torch also acts as a release for the gas. so when i try to fill the torch, it shoots it out as im filling it…? i genuinely don’t know what im doing wrong.