Is there anything you can bring kayaking, swimming, or really anywhere people are fishing that will scare the fish away from the fishers? Ideally something not very obvious, and for kayaking something you can easily turn on near fishers and off when you’re not near them?
Fish don’t like noise. Simply talking loudly can be enough.