(Convergence) Can’t exchange starlight shards for puppets.

Got up to the point where I could give the potion to Dungeater and was able to trade for one of the puppets. Waited a few days, did some stuff then came back. I could purchase puppets but the game thought I only had a single shard despite having at least 5, only one being registered. Decided to purchase more from Sellen, made sure to puck them off the ground and saw 10 in my inventory and 4 in chest. Game still only recognizes one.

Are the ones you can but different from those you pick up? Are only the ones you pick up in world the only valid ones?