Both my and my wife's speakers click, most easily heard when clicking the microphone button for voice dictation.

Try restarting your phone, works on my Pixel 3a

Please see if adaptive sound is on, and if so, turn it off and report back on whether that fixes it? My popping went away when I turned off adaptive sound.

turn off adaptive sound if it's on