Should i allow my 3 wk old baby sleep alone in his cot and in his own room? Or should a caregiver sleep with him in the same room?

I make him sleep separately in his cot in my room as I am afraid I will risk his safety if I make him sleep together with me in the same bed. I don't let the car caregiver to sleep with my 3 week old baby, No way!!