Global IT Outage: Strategic Insights for MSPs

If you're an MSP, you've likely spent the past week navigating the fallout from the CrowdStrike outage. Whether you were mitigating blue screens of death (BSODs) or fielding anxious calls from clients, this incident has undoubtedly tested your team's resilience and resourcefulness.

Even if you were not directly affected, you may still want to take a step back and ask: What can we learn from this? How can we use this experience to strengthen services and better prepare for future challenges?

In this post, we'll break down the CrowdStrike incident, not to rehash what you already know, but to extract valuable insights that can drive your business forward. We'll explore the long-term implications for the MSP industry and discuss practical strategies to enhance your service offerings in light of these events.

The CrowdStrike Incident: What Really Happened

By now, you're all too familiar with the basics. A faulty update to CrowdStrike's Falcon Sensor on July 19 turned what should have been a routine procedure into an IT nightmare. Millions of computers running on Windows were suddenly caught in a boot loop with far-reaching implications; Axios reports all Fortune 500 airlines and roughly 75% of the top healthcare organizations and banks were affected by the outages. (Macs escaped this issue because Apple’s MacOS operating system does not grant developers kernel-level access).

But let's break this down further. This wasn't just any software hiccup but a failure in a critical Endpoint Detection and Response (EDR) tool, the very thing meant to protect systems from threats.  The scale of the issue was particularly notable given CrowdStrike's position as a leading cybersecurity provider.

Immediate Impact: Operational Challenges for MSPs

The fallout from this incident created a multi-faceted challenge for MSPs:

1. Support Surge: Many of you experienced a significant spike in support requests, stretching resources and testing incident response capabilities.
2. Client Relationship Management: The incident likely necessitated careful communication to maintain client trust and manage expectations during the resolution process.
3. Financial Implications: System downtime often translates to revenue loss. This event may have led to discussions about SLAs and compensation.
4. Security Reassessment: With critical security tools offline, many MSPs had to quickly implement alternative measures to maintain security postures.
5. Increased Threat Activity: The incident sparked opportunistic phishing campaigns, with threat actors exploiting domains like crowdstrikebluescreen.com, adding another layer of complexity to the situation.

Long-Term Implications: Where Do We Go From Here?

Now, it’s time to think ahead. This event highlights several areas for strategic improvement in MSP operations:

1. Robust Testing Protocols: Before deploying updates from third-party vendors, MSPs should implement stringent testing protocols. Simulating updates in a controlled environment can help identify potential issues before they impact client systems. Also, having some insight to the vendor’s testing process, so you can make an early assessment of the risk, can also be valuable.
2. Enhanced Communication: Maintaining clear and open lines of communication with clients is crucial. Keeping clients informed about the nature of the problem, the steps being taken to resolve it, and the expected timelines can help manage expectations and maintain trust.
3. Crisis Management Plans: Developing and regularly updating crisis management plans can help MSPs respond more effectively to unforeseen incidents. These plans should include clear protocols for diagnosing issues, communicating with clients, and deploying fixes swiftly.
4. Continuous Monitoring and Improvement: MSPs should continuously monitor their systems and processes, learning from incidents to improve their response strategies. Regular reviews and updates to protocols can help ensure readiness for future challenges.

Best Practices: Your Action Plan Moving Forward

So, what concrete steps can you take to prevent or build resilience against similar incidents? Here's a starting point:

• Develop a multi-stage change management process with rigorous testing protocols.
• Implement layered security architectures to mitigate single points of failure.
• Create and regularly update detailed incident response plans, including scenarios for major vendor outages.
• Invest in advanced training programs to keep your team at the forefront of emerging technologies and threat landscapes.
• Establish clear, efficient communication channels with clients and vendors for rapid information dissemination during critical events.
• Conduct regular security audits and updates, ensuring all systems are optimized for current threat environments.

Leveraging Insights for Growth

The CrowdStrike outage was a wake-up call for our entire industry. By carefully analyzing this event and implementing strategic improvements, you can strengthen your service offerings and build more resilient IT management solutions.

Remember, in the world of IT management, it's not a question of if challenges will come but how well you're prepared to meet them. If you would like to see how ConnectSecure can help your clients (and your own MSP) optimize for cyber fitness by taking a proactive approach to cybersecurity, schedule a One-on-One Demo today or sign up for a 14-day Free Trial.

Keep Reading
ConnectSecure MSP Survey Reveals Critical Cybersecurity Insights
MSP Business Strategy: The Value of Hardening Client Attack Surfaces
Vulnerability Patching: The MSP’s Toolkit for Client Success