2026-10-01 23:20:01
Another great article from Brent Chapman - "What managing emergencies at Burning Man teaches me about incident management in tech"
#sre #devops #incidentmanagement
Another great article from Brent Chapman - "What managing emergencies at Burning Man teaches me about incident management in tech"
#sre #devops #incidentmanagement
Security-minded #devops folks who are adding package cooldowns to your deployment rules…
…how are you possibly dealing with zero day fixes? (Short of auditing everything, which… you're lying to yourself if you truly believe that is happening, thoroughly.)
(defs:
Cooldowns: "don't update this package until the version you'd update to has been available for at least 48h”
Se dice Aplicación, no Aplicativo. Aplicativo es lo que se usa para meterse el tampón.
#devOps #castellano #ohCervantes
We tweaked our firewalls and our Anubis rules. The attack persisted, but it was contained.
We also scaled our systems to avoid more accidental downtimes caused by these scrapping operations... Then the attackers scaled up their scrapping campaign, and found new ways to bypass our #Anubis config.
This past night I managed to come up with a stricter configuration that blocks virtually all of them (I don't know for how long this will last, though).
As of now, our Anubis instance is stopping around 40 requests per second.
I know that this is "nothing" for anyone working in very big systems, but bear in mind that this is after I already blocked around 3.5% of all the IPv4 addresses existing, and it accounts for 95% of our traffic. For every legitimate request we have, we have 19 that come from bots.
P.S.: In an ideal world, I would openly share the rules I found to work well... Unfortunately I don't think that would be a good idea. I don't want to make the scrappers' job any easier.
#FuckAI #Fuck_AI #Devops #DevSecOps
OH on slack: i'm sure reconciling state across partitions would be part of the hardest things in computer science, but it never arrived on the list
#sre #devops #swe #computer_science
I wrote some notes on my recent work deploying rootless containers #devops #podman #containers #rootless