All of us test in production all the time (2019)
I love articles like this because it&#x27;s so easy to just add that company to a list of places to never ever work.<p>I did read the whole article, btw. It&#x27;s an absolute clickbait title that the author doesn&#x27;t really mean, and after the article spends a lot of time diffusing the clickbait title it really boils down to, &quot;This is hard, so I give up.&quot;<p>It&#x27;s true that many--if not most--companies operate this way without ever acknowledging it. And that&#x27;s bad. It&#x27;s also true that systems are harder to test than code. But it&#x27;s not deep fucking magic. Look at the work aphyr does. Look at the testing work that the FoundationDB team did to prove their system&#x27;s guarantees. Look at the work that security and devops people do every day. She is right that it is hard to test systems. So what? We don&#x27;t get paid as much as we do because it&#x27;s easy.<p>In a certain environment, it is truly impossible to test a system. That&#x27;s when you have a dev culture that refuses to actually design knowable systems. A much better approach for the article would be to address exactly why systems are so hard to test rather than just saying fuck it. Everything she cites in her list of things that are hard to test are absolutely testable, if you have a knowable system. The real problem here is that agile&#x2F;scrum&#x2F;Xtreme programming practices inevitably and by principle do not result in knowable, testable systems. When you have 30+ agile teams on their own sprint cycles and product managers leaning on them to ship features and figure the rest out later, there can be no other result than fragile, broken, unknowable, untestable system.<p>But the answer to that isn&#x27;t &quot;Everybody else is doing it so why can&#x27;t I.&quot; The answer isn&#x27;t to &quot;embrace it.&quot; The answer isn&#x27;t &quot;This is hard, fuck it.&quot; The answer is most definitely not to make individual engineers pay the price of being on call because a company&#x27;s culture and process are totally and completely hosed.<p>The answer is to address the problems in your company that caused this situation in the first place. The answer is to get your head out of the feature cult and the velocity war and reset your priorities. Systems aren&#x27;t hard because your engineers suck. They&#x27;re hard because companies suck. Systems are hard because in most places, no one is allowed to spend more than a couple minutes <i>thinking about the systems.</i><p>Agile culture after your early startup cycle is a lot like being a 40 year old guy who&#x27;s 30 lbs over weight. How did this happen? How did I get here? I was just taking life one thing at a time and getting shit done. Now nothing works quite as well as it used to, it&#x27;s harder to find dates, and everything just sort of hurts. Would anyone in their right mind just say, &quot;Embrace it! Most 40 year old tech dudes look about like you and are in the same situation! It&#x27;s fine!&quot; No. Of course not. You have to realize that your priorities have been totally broken for the last 15-20 years of your life, that you really weren&#x27;t getting shit done, and you have to take some responsibility for your diet and get off your ass and exercise.<p>That&#x27;s what companies have to do. They won&#x27;t, of course. But they have to, otherwise they&#x27;ll die young deaths. This article is totally correct when she recognizes a terrible symptom of unhealthy companies. But her treatment is hopelessly and tragically wrong.