What belongs to you, of course, must be owned by yourself. No one can take it away without your permission. This is what you should guard or mark your belonging. You can be rude to others if they want to snatch the past by force. Therefore, although this sentence is a bit domineering, it is also very reasonable.