Hi Shekhar,
The neutral is connected to ground probably in the transformer down the street from your home.
I think they ground it to provide a path to ground for lightning, and for any leakage current.
If you worry about being shocked, then you should have Ground-Fault-Interrupters installed on...