There are actually more grains of sands on earth than stars in the sky. I know. I counted them. AND, in case you're wondering, I don't have a life so I had the time.
I think its clearly metaphorical. Since we have an accurate count of neither sand grains nor stars, and may never have, who’s to say for certain it’s untrue?