I think as long as people respect each other there shouldn't be a problem. If your neightbour seems ok with it then by all means carry on. It is when the neighbour doesn't listen to the owner - that is when it gets annoying I should think.