Can my neighbor force me to move my mailbox if its on their property?

Question Details:

I have been in my house over 2 years. My neighbors have been there maybe a year. They're want to extend their driveway towards my house and have told me that I need to move my mailbox. It appears that my mailbox is completely on their property(I am waiting for a survey to confirm). My house is about 10 years old but I do know mine was built about 4 years before theirs was. Does that make a difference? Can they force me to move it? I don't want to seem un-neighborly but if I have to move it - the brick won't match and my mailbox will be the only one on the opposite side of the street. Important Notice