There are a few specific things we've done at GitHub to help our maintainability and reliability of our Ruby apps. Focusing on improving documentation, optimizing the first-run experience, splitting out our API as Sinatra apps, and being careful about how we ship impacting infrastructure changes has helped us out dramatically.