If I were to move to a different country it would be England, Germany or Latvian. And I've often thought of whether I could leave. It's an issue I think most Latvian-Americans/Canadians/Australians/etc. deal with. There was a major exodus during WWII with people thinking, "we'll be back once the Soviets are gone and our country regains independence." But it took until 1990 for this to happen, by which point Latvians had established lives in the countries they'd moved to. My grandparents were living with their children who had grown up in the United States. Their whole lives were in America, not Latvia. The same goes for me and all the other Latvians I know. We've created a culture here and become completely invested within it. Thankfully I speak Latvian (and also German), but I'm not sure if I could ever leave. The problem for me wouldn't be a culture shock or a language barrier, but leaving my home.
Have you ever thought of simply moving to Latvia for a year or two to try it out? It's extremely common for Canadians and Australians to spend a couple of years in their 20s in the UK on working holiday visas. If Latvia doesn't suit there's nothing stopping you from heading back to the states.
I have thought about it, but my first goal is to finish school, whenever that happens. But one of the things about having this community is that there are so many things happen on a regular schedule that I don't want to miss. It's like having a family reunion biannually that I don't want to miss.