Tried extracting the Lora, then tried dpmpp_2s_ancestral+linear_quadratic. While it was significantly better, it wasn't good enough yet.
However, this time I found settings that actually seem to work quite well.
If using base with anyMODE's extracted Lora (used here), my settings are:
Weight: 0.7-0.8 (0.7 makes skin overly smooth sometimes and 0.8 gives grid more often),
Sampler/scheduler: dpmpp_2s_ancestral+linear_quadratic
Steps: 6
Cfg: 1-2 (1 works well)
If using my extracted lora, you can use the following:
Weight: 1
Sampler/scheduler: dpmpp_2s_ancestral+linear_quadratic
Steps: 4+
Cfg: 3
I have almost completely stopped getting any grid artifacts using these settings. But with some occasional prompts, it might be more prominent than with the others.