That's quite a nice little design!
OK, start with a specific case and figure out why it's not working. For example, say station #1 transmitting to station #2. Disconnect stations #3 and #4, if possible, so they don't confuse the issue, and check that there's still a problem.
Measure the...