Computer magazines and ezine Antivirus Testing and Recommendations (i.e., Editor's Pick Awards)
by Andrew J. Lee
AVIEN Founding Member
http://www.avien.net
It is indisputable that any magazine can test and compare the usability, the interface, the update method, the system performance impact, the "user friendliness" and the features of respective products, and, on that basis, many magazines have conducted good and fair reviews of the anti-virus software included.
However, on the basis of their stated methodology for testing the virus detection functionality of the scanners, they often have not. The idea that a magazine will be able to test any virus scanner with their own "quarantined" virus collection is at best foolish and at worst dangerous.
Let me put it simply. When it comes to Scanner testing such magazines usually do not know what they are doing. This is proved by telling us how their test was conducted. It is simply wrong to assume that they can test a scanner just by seeing if it detects the viruses that they have. If it detects them they have proved nothing, except that there are some files they suspect of being viruses that it detects, you cannot extrapolate any further conclusion. If it does not detect, they have no way of telling why.
This is because they don't know whether their samples are viable* either fully or in part, nor whether the samples they have are mutations or variants (i.e. someone or something has made changes to it). The major criticisms that I have of such methodologies are these:
[FONT=Arial,Helvetica, sans-serif]For reliable results check the tests done by respected independent bodies in the field, you will often see that their testing contradicts such arbitrary magazine test results. See these links for some real tests :[/FONT]
[FONT=Arial,Helvetica, sans-serif]http://www.av-test.org/index.php3?lang=en [/FONT]
[FONT=Arial,Helvetica, sans-serif]http://www.virusbtn.com/100[/FONT]
[FONT=Arial,Helvetica, sans-serif]http://agn-www.informatik.uni-hamburg.de/vtc/[/FONT]
[FONT=Arial,Helvetica, sans-serif]ftp://agn-www.informatik.uni-hamburg.de/pub/texts/tests/pc-av/2001-07/0xecsum.txt[/FONT]
[FONT=Arial,Helvetica, sans-serif]http://www.uta.fi/laitokset/virus/[/FONT]
[FONT=Arial,Helvetica, sans-serif]http://www.check-mark.com/cgi-bin/redirect.pl[/FONT]
[FONT=Arial,Helvetica, sans-serif]http://www.icsalabs.com/html/communities/antivirus/certifiedproducts.shtml[/FONT]
[FONT=Arial,Helvetica, sans-serif]Real world anti-virus scanner testing is carried out using thousands of verified viruses under strictly controlled conditions. They are also carried out, at least the recognized tests, by experts in the field, who understand not only the implications of the results, but who are able to correctly interpret the results. Any tests a computer magazine have conducted in the manner described earlier are immediately invalidated by the non scientific method. [/FONT]
[FONT=Arial,Helvetica, sans-serif]*Viable here means able to replicate and infect other files. [/FONT]
[FONT=Arial,Helvetica, sans-serif]Read more...[/FONT]
Source: http://www.claymania.com/scannertest.html
by Andrew J. Lee
AVIEN Founding Member
http://www.avien.net
It is indisputable that any magazine can test and compare the usability, the interface, the update method, the system performance impact, the "user friendliness" and the features of respective products, and, on that basis, many magazines have conducted good and fair reviews of the anti-virus software included.
However, on the basis of their stated methodology for testing the virus detection functionality of the scanners, they often have not. The idea that a magazine will be able to test any virus scanner with their own "quarantined" virus collection is at best foolish and at worst dangerous.
Let me put it simply. When it comes to Scanner testing such magazines usually do not know what they are doing. This is proved by telling us how their test was conducted. It is simply wrong to assume that they can test a scanner just by seeing if it detects the viruses that they have. If it detects them they have proved nothing, except that there are some files they suspect of being viruses that it detects, you cannot extrapolate any further conclusion. If it does not detect, they have no way of telling why.
This is because they don't know whether their samples are viable* either fully or in part, nor whether the samples they have are mutations or variants (i.e. someone or something has made changes to it). The major criticisms that I have of such methodologies are these:
- They do not define and publish the sample set used - listing by family, variant and type.
- [FONT=Arial, Helvetica, sans-serif]They have not tested the ability to replicate, (the definition of a virus), of each member of that sample set.[/FONT]
- [FONT=Arial, Helvetica, sans-serif]They do not publish the methodology of testing, which must be consistent for each product, i.e. how they set it up, were the files tested against in their natural state (as they would appear in the wild) etc.[/FONT]
- [FONT=Arial, Helvetica, sans-serif]They do not state whether they have distinguished viruses from Trojans or other non viral malware.[/FONT]
- [FONT=Arial, Helvetica, sans-serif]They often state disinfection or healing as a benefit, when it is far from agreed that it is of any benefit.[/FONT]
- [FONT=Arial, Helvetica, sans-serif]They often do not state the update or engine level of each product, nor the platforms on which they tested.[/FONT]
[FONT=Arial,Helvetica, sans-serif]For reliable results check the tests done by respected independent bodies in the field, you will often see that their testing contradicts such arbitrary magazine test results. See these links for some real tests :[/FONT]
[FONT=Arial,Helvetica, sans-serif]http://www.av-test.org/index.php3?lang=en [/FONT]
[FONT=Arial,Helvetica, sans-serif]http://www.virusbtn.com/100[/FONT]
[FONT=Arial,Helvetica, sans-serif]http://agn-www.informatik.uni-hamburg.de/vtc/[/FONT]
[FONT=Arial,Helvetica, sans-serif]ftp://agn-www.informatik.uni-hamburg.de/pub/texts/tests/pc-av/2001-07/0xecsum.txt[/FONT]
[FONT=Arial,Helvetica, sans-serif]http://www.uta.fi/laitokset/virus/[/FONT]
[FONT=Arial,Helvetica, sans-serif]http://www.check-mark.com/cgi-bin/redirect.pl[/FONT]
[FONT=Arial,Helvetica, sans-serif]http://www.icsalabs.com/html/communities/antivirus/certifiedproducts.shtml[/FONT]
[FONT=Arial,Helvetica, sans-serif]Real world anti-virus scanner testing is carried out using thousands of verified viruses under strictly controlled conditions. They are also carried out, at least the recognized tests, by experts in the field, who understand not only the implications of the results, but who are able to correctly interpret the results. Any tests a computer magazine have conducted in the manner described earlier are immediately invalidated by the non scientific method. [/FONT]
[FONT=Arial,Helvetica, sans-serif]*Viable here means able to replicate and infect other files. [/FONT]
[FONT=Arial,Helvetica, sans-serif]Read more...[/FONT]
Source: http://www.claymania.com/scannertest.html
Last edited:
My Computer
System One
-
- CPU
- T7600G Core2Duo 2.66 Ghz
- Motherboard
- Intel 945PM + ICH7 Chipset
- Memory
- 4GB DDR2 PC2-5300 667MHz
- Graphics Card(s)
- Mobility Radeon x1900 256MB
- Sound Card
- Realtek HD
- Monitor(s) Displays
- WUXGA 17"
- Screen Resolution
- 1920X1200
- Hard Drives
- 640GB 7200RPM SATA/RAID 0 (2x320GB)
and 320GB 7200RPM External
- Mouse
- Wireless Microsoft 3000
- Internet Speed
- 10 mbps/2 mbps
- Other Info
- Optical Drive:
Panasonic UJ-220 DL BD-RE (Blu-Ray)