Should I move across the country away from my friends and family to be with my fience of three years?

He and I met in high school. He and I have been inseparable since. When he was a senior and I had already left high school after being kicked out, he moved in with my family and I. That was a year ago. He is my best friend and my everything. With planning the wedding for the summer of 2012 and stress of living with my family he decided to take a 6 week long vacation to see his family in New York, we live in Oregon together. After only two weeks of being there I got a phone call saying that he was thinking about staying there. The topic of he and I moving there had come up a few hundred times but I always stuck to my guns about my job and my family being here in Oregon. I never thought that after this long, he would choose to go back. Well that day has come and now I'm blaming myself for not chancing it and allowing myself to trust that God would take me in the path I'm supposed to go. I'm starting to think he was right and I should have packed a suit case and moved. Should I have or did I spend three years of my life with a wonderful man who I've grown up with and adored since day one who decided to just go and never come back? Is it too late?