Neighbor filmed me on my property, legal?

I've had problems with this person and his wife over the last 3 years that I've lived next door to them. Basically if I have friends/family round they will stare at them, and it makes my visitors very uncomfortable. If I make any kind of noise, I have three children... So our house makes a bit of NORMAL family noise, they come round, threatening and accusing me and family of all sorts. So far I have ignored them, thinking they were bonkers. I just wanted to raise my family. The husband has threatened my friends, and my ex partner. And now myself, he also tried to FILM me on my property. I told him that I won't speak to him, or allow myself to be filmed by him on my own door step. He left, but his wife stayed and basically sprouted a load of slanderous rubbish about my children (All under 7), who are now living with family in the area I'm moving to in 2 weeks time, I only spend weekends at my property due to the problem, my council are aware of this, I wanted to get my eldest into the local school and settled into the area as soon as I knew I was moving. But on a serious note, the neighbors have said that the local councillor, Colin Wood, (he lives just across the road from me) told them I was moving, and that the whole street have serious concerns about my children! Should I go to my solicitor? I have heard many things from different people in that village, also private things like where I used to live... How do these people know this? Sorry for ranting... I'm very depressed and upset by all this.