Porting

I recently ordered Cricket wireless service and requested to use my exsisting phone number. 

I changed my mind and want to switch to different company.   The told me I had to call my current provider to cancel the Cricket port request.  I did this but AT&T told me it takes a few days to cancel this port request.  Is this true?  I don’t want to loose my phone number.