maybe you can add on some safety belts, or is your chair adjustable? if not you can try to this type of chair. (refer to pic). my nephew like it. his 2.5 years old.
i have ever come across safety belts that even i myself find difficult to detach though i cannot quite recall which... hope u find one 💕