Endometrial polyp - to remove or not?

Hello, based on an ultrasound scan, my gynae said that I have endometrial polyp. I am currently trying to conceive to have 2nd child and now I have to make a decision as to whether to have the polyp removed or not. According to my gynae, the polyp could make it difficult to conceive and could result in a miscarriage if conceive. But at the same time, he said that there is less than 1% chance of being cancerous. I am still undecided whether to have it removed or not but i am leaning towards having it removed as I think it is better than having to worry if I were to conceive while the polyp is still there. I am also wondering if it is accurate to conclude that it is polyp based on the scan. Has anyone had this experience before or what do you think I should do?