According to the situation you described, the procedure for you to get a marriage certificate is illegal, and the marriage certificate is of course invalid. To apply for a marriage certificate, both men and women must be present at the same time and signed and sealed by both parties. The issuing authority of marriage certificate must be stamped by the Civil Affairs Bureau to be effective. If you want a divorce, all you have to do is provide evidence to the court to invalidate the marriage certificate. Since the marriage certificate is invalid, there is no need to go through the divorce formalities, and it is ok to leave directly. Of course, it means leaving without the children. If you have children, you should think about it!