Starting a Sipp After Retirement

Hi, I have just started my State Pension but was thinking of opening a Sipp. My ISA is full after sale of a house and although I realise I can only put in £2000ish it still seems worth it for the additional 20%. Of course I am old enough to take money back out again should I wish. Anything wrong with my logic or things I haven't considered? Thanks