Beaver/ Muskrat - Scare Fish?

[MO3N]

So I went fishing today and I got a few bites got two in the boat. Nothing huge. But I had to pick every place apart before I would get bit. Plus it was around 3 o'clock so not the best time. But around 7 my buddy showed up and joined me on the boat. As we were fishing different spots it seemed like this Muskrat would fallow us. Anytime it got within 20 to 30 feet of us my buddy would say "great now all the bass have moved, lets find a new spot." This made it tough to get a bit or anything moving so much. Now I understand if the thing was right in the same cove or on the log your fishing. But do they really scare the bass at all? I would say that bass get used to the beavers and such being in the lake and they do not bother them as much but what do you guys think?

Sorry for the long post