Ah! I know exactly what you mean. It was a beautiful game, with amazing additions but it got a bit annoying when you would accidentally touch the wrong spot on the screen (even though you swore it was the right spot) and then you lose alot of stamina. I actually stopped playing a little bit after I married Vaughn so I didn't have my kid yet or anything....
Now I'm playing Harvest Moon SNES on Wii and Harvest Moon Tree of Tranquility to get me by. ToT is a very pretty game and the characters are amazing. They actually have different personalities in this one that are noticeable.

and the SNES version is just awesome because it's the very first Hm ever. It's nice to see how the HM series grew and flourished. I look at the old games and then the new ones and it's just amazing.