Hi Shekhar,
If your building has steel floor beams with steel-rods in reinforced concrete, I doubt that a simple FM transmitter will penetrate.
However if it just has wood-sticks and string, it will probably be OK to travel a few stories. Of course, it also depends on the sensitivity of your...