It would of definatly have gotten bigger.
How long did you take it out for because some peoples ears can shrink back quickly, especially if you took it out straight after the stretching had finished and seeing as the hole is only small.
Try putting a 5mm plug in and see if that works.
But if you can put a 5mm stretcher all the way through, it has gotten bigger.
Are you judging whether it’s gotten bigger on how it looks to you? Because a 1mm stretch can look the same size as it was before.