8621: feat: make sure nightly regressions don't break users r=lnicola a=matklad Co-authored-by: Aleksey Kladov <aleksey.kladov@gmail.com>