What Jack backend settings are you using? The buffer size is the major factor that determines the latency you’re going to get.
Please see Suitable as guitar effect pedal? - #2 by Giedrius for some additional details.
1 Like