The crystal set takes all its power from the aerial. The power can only be extracted efficiently by inserting the set between aerial and ground. Sets with amplifiers can manage a much smaller input.
The connection will be to the common line in the set, often termed ground. You could show us a...