Mergify allows to pause the merge queue repository wide through anewly added API endpoint. (`/api/repos/<owner>/<repo>/queue/pause`)