This sentence means that two people's feelings, if sincere, don't have to be together every day.
If you can't be together every day for various reasons, as long as the other person has himself in mind, then this relationship is also worth cherishing.
Another meaning is that there is not only love but also career in our life. In the process of working hard for our career, we should put aside our children's affairs and take a longer view for a better life in the future.