Quality Counts
We gave product performance a relatively heavy weighting of 30 percent in our overall evaluation, and most of the performance metrics we applied relate directly to voice quality. Although the rest of the metrics relate to efficiency how much data-network bandwidth each product uses and requires as a minimum, per voice conversation there seems to be a definite correlation between efficiency and quality. We stressed the quality issue because it is the most common concern people have about voice-over-IP gateways: Is the quality acceptable for business use? The answer is: Yes, most of the time, under normal network conditions. Of course, this depends to a considerable degree on your definition of "acceptable."
The VOIP gateways we tested turned in consolidated scores between 5.0 and 8.1. A rating of 10 would represent the best possible PSTN voice phone connection originated on an analog loop, converted once to a 64 kbps, pulse code modulated (PCM) digital DS0 channel, sent a short distance via T1 and then converted back to the destination's analog loop. Most dial up long distance calls would probably score from 7 to 8 on this scale. There is also a point on this scale at which the voice quality would be considered minimally acceptable for normal business voice communications. Our admittedly subjective judgment places this point somewhere around 4.0.
In contrast to the scores for ideal conditions, the voice quality ratings of all the products fell to between 4.0 and 7.0 when burst errors were applied on the routed T1 link connecting the gateways. In this test scenario, we introduced errors into about 10 percent of passing data packets to simulate the not-uncommon manifestations of electrical noise on telco T1 circuits.
|