We used to sit around with my grandparents and sing this song...

I remember part of the lyrics as below:

Though my earthly abode be a cabin
Many miles from that busy square

...
...on main street in heaven city fair..
...
For with God i'm an heir.

Chorus:
I have a home
In that land
O'er the ...