Earlier this week NSS Labs were able to share with me a copy of their latest endpoint protection product group test – covering Host Intrusion Prevention. Their test regime was designed to identify the effectiveness of the most popular corporate endpoint protection products against the exploits most commonly encountered during Internet surfing – i.e. measuring the products capability to withstand every-day drive-by-download attack vectors.
The results, as a whole, were disappointing – but actually better than what I would’ve normally expected. By that I mean a handful of products could be deemed to have been “good enough” for everyday desktop protection against the standard drive-by criminal fare (which is a bit of a pleasant surprise* – but more on that heavily caveated surprise later), but most failed the test and some missed by an abysmal margin (which is more attuned to what I expected).
Some key findings taken from the report include:
- Endpoint protection products differ up to 71% in effectiveness at stopping exploits, between 29% and 100%.
- Based on market share, between 70-75% of the market is under-protected. Most vendors lack adequate protection against exploits.
- Keeping endpoint protection software up-to-date does not yield adequate protection against exploits, as evidenced by coverage gaps for vulnerabilities several years old.
Endpoint protection suites are the absolute last line of defense against Internet threats and it’s deeply disappointing that they constantly perform so poorly against the threats they’re specifically designed to protect against. You’d think that with all the CPU, RAM and hard-drive capacity they gobble up that they’d carry their weight and perform better. Perhaps Intel (with it’s newly acquired McAfee) will be able to get this kind of protection in to the silicon powering our computers and do away with the cumbersome software suites that plague the performance and stability of our operating systems.
NSS Labs tested the products against 123 exploits grabbed from the wild (i.e. exploits that are in common use by Internet criminals and likely to be encountered by their preferred victims). Out of the ten products, only three managed to stop all the “original” exploits, and only one product managed to stop the alternative exploit versions. That sucks!
Seriously; that really does suck. To understand this better you need to appreciate the way in which Internet criminals construct their malicious drive-by-download sites. They don’t just randomly pick one exploit and hope it works against their victims computer, they try every single exploit they have available to them and cycle through the list until one of them works – and then install their malicious payload (e.g. botnet agent). This means that the endpoint protection product has to stop all of the exploits, or else its failed. Stopping 80% of the exploits is of no consolation. There’s no benefit to being “almost secure”.
The failure to handle the alternative exploit versions is most worrying to me (and any organization reliant upon that vendors endpoint technology). The “alternative” exploit versions reflect the way in which exploits are commonly refined and tuned by different criminal groups for inclusion in their exploit packs and drive-by-download sites. By missing the “alternative” exploits these vendors have failed on two critical counts:
- They’ve focused on detecting the nuances of the exploit sample, rather than identifying attempts to exploit the vulnerability. This is a subtle but significant evaluation of their core protection technology. Legacy signature systems focus on the code structure of the exploit – meanwhile preemptive technologies understand the protocol and/or data format that the vulnerable application depends upon and is exploitable via – thereby stopping any malicious code permutations that the criminals can think of or want to throw at it.
- If the product only caught the “original” version of the exploit and not the subsequent public alternative versions (which are similarly being distributed by the criminals), this signifies to me one of two equally depressing conclusions – (a) the vendors protection is marketing centric (i.e. skin deep) and coverage of the vulnerability is limited to “yes, we have protection – see it’s signature CBA321″ or (b) the vendors threat analysts do a very poor job and probably rely upon public analysis of threats rather than their own.
I know that I’m sounding pretty harsh in this blog posting, but this is serious business – and better protection is attainable. The customers of the vendor’s whose products failed to stop 100% of these endpoint exploit tests have an expectation for threat protection which obviously isn’t being met today.
– Gunter Ollmann, VP Research



