It is not fair, and your actions can't even be justified.
Life and love are things of choice not force. You are not and can't be your child. Two of you are two special and unique human beings. Unless you are running a regimented barracks in your home in the name of a family don't expect your children to take after you in every aspect of your life.