Oh, that’s no fun, you poor sausage.
What is it that you get anxious about when on your own? Do you have to make decisions and you’re worried you’ll get it wrong? Do you have a certain number of things to get done and you’re worried that you can’t/will miss something? Are you worried about something unexpected happening and not being able to deal with it?

What shift pattern are you working? Is it possible your body clock is struggling and causing at least some of the issue?