Considering the fact that your needs are not and will not be met inside of marriage, then if the need to have a nice conversation or spend a pleasant afternoon with an interesting person is being met by another, IMO, so be it.