Awhile ago, my bro had his nose pierced (for the 2nd or 3rd time..) and he took his stud out, then a few mins after wanted to put a different one in... I forget if he actually got it back in... all I remember is him trying to force it back in. He'd had it pierced for a few weeks or so, and it'd already started to close. Also, one time he had to have all his piercings out, many of which he'd had for at least a couple months or so, and in the few days or so he had them out, most had closed up (his eyebrow, his tongue, and his nose)
My cartliage I've had pierced for 7 years or so, and whenever I take it out(which now is rarely), I still have to force it back in. It's funny how quickly piercings can close up, while others seem to stay forever.
Anyway... I'd suggest keeping the area well cleaned, and getting it repierced. Maybe even let it fully close before you do-? I dunno if it makes a difference getting a piercing redone right away, or letting it fully heal and close before getting it redone. The only holes I've had fully close then repierced were my 2nd holes in my ears... other body parts may differ. Either way, I definitly wouldn't try shoving it back in any time soon.