That sure looks like an elm to me. Those leaves are good in a salad! And the seeds, too, when they are green. I had a post last spring about eating Siberian elm seeds in a salad. And here's a video with a wild salad made from 11 different different weeds and trees - including an American elm, and another salad with Elm leaves, too. But even if it's a mulberry, their leaves are good to eat in a salad, too!
Do you ever see berries fall from the tree? Or does it get papery seeds that are flat and shaped like a circle? I've tried 16 ways to convince myself that your neighbors can think this is a mulberry tree, but I just can't. I'm looking at how the veins in the leaf go out to the edges, and the form of the tree, like you are standing and reaching up and out with your arms. That's all elm!
Yep I think you are right. I googled more pics and I believe it is an elm. I will never understand why people would not want a Mulberry or an Elm. I think if some people had their way, they would pave the entire Earth.