A health check after the switch only tells you how long the outage was. Starting the new release on a spare port against a VACUUM INTO copy of the live SQLite database catches broken dependencies, syntax errors and failing migrations while the old version…
rails-preflight reads a Rails app and lists what stands between it and the next Rails version. Before releasing it, I checked it against Rails upgrades that already happened in Mastodon, Discourse, and Forem.