Confidence isn't one substance. A person can reverse a lorry into a loading bay without breathing hard, then spend forty minutes rehearsing a phone call to the dentist.
Which is oddly encouraging, because it means the thing grows in places rather than all at once. Whatever you are currently unbothered by was once genuinely difficult. Junctions. Interviews. Saying no to something small.
The growth is real and locally distributed. Look for it in the particular task you now do without a run-up, rather than in some general feeling about yourself that never seems to arrive on schedule.