Carry toddler with carrier while pregnant

Is it OK to use a carrier to carry my toddler (20m) in front of me while I'm in my first trimester? I don't really have a bump yet so it doesn't feel uncomfortable but I wonder if it can be bad for the baby in any way. And when would it be not recommended to use carrier?