Ben Affleck quietly moved his issues out of his marital house with Jennifer Lopez whereas she was having fun with in Europe