Dime of time

It is all but upon me,
but it is never near.
It is within my grasp,
yet it fills me with fear.
Destiny that is in stone,
if only it wasn't you my dear.