Thumbnail
Access Restriction
Subscribed

Author Cody, W. J. ♦ Kuki, H.
Source ACM Digital Library
Content type Text
Publisher Association for Computing Machinery (ACM)
File Format PDF
Language English
Subject Keyword Guard digits ♦ Error analysis ♦ Number representation ♦ Floating point arithmetic ♦ Rounding
Abstract This paper presents the statistical results of tests of the accuracy of certain arithmetic systems in evaluating sums, products and inner products, and analytic error estimates for some of the computations. The arithmetic systems studied are 6-digit hexadecimal and 22-digit binary floating point number representations combined with the usual chop and round modes of arithmetic with various numbers of guard digits, and with a modified round mode with guard digits. In a certain sense, arithmetic systems differing only in their use of binary or hexadecimal number representations are shown to be approximately statistically equivalent in accuracy. Further, the usual round mode with guard digits is shown to be statistically superior in accuracy to the usual chop mode in all cases save one. The modified round mode is found to be superior to the chop mode in all cases.
Description Affiliation: Argonne National Lab, Argonne, IL (Cody, W. J.) || Univ. of Chicago, Chicago, IL (Kuki, H.)
Age Range 18 to 22 years ♦ above 22 year
Educational Use Research
Education Level UG and PG
Learning Resource Type Article
Publisher Date 2005-08-01
Publisher Place New York
Journal Communications of the ACM (CACM)
Volume Number 16
Issue Number 4
Page Count 8
Starting Page 223
Ending Page 230


Open content in new tab

   Open content in new tab
Source: ACM Digital Library