Some people will go in and out of your life. Some will come back. Some will not. The key is to allow those to go whose time serving you, and you them, is complete. Do not hold onto the past, but rather be grateful and allow the future to come to you, which just might include those you have loved sharing time with the most. But if you are holding on to what was, you are stifling "both of you".