Likely the BFO is too far down the slope of the filter. I've heard two locally and both had that issue
and cleaned up nicely with adjustment of the BFO.
When you adjust do it in small steps maybe 10hz. I do it by ear having built more
than a few SSB radios I know what I"m listening for in my case.