round-off error

difference between the result produced by an algorithm when using exact arithmetic and when using finite-precision, rounded arithmetic

en-US/ˈɹaʊnd - ɑf ˈɛɹɚ/
en-GB/ˈɹaʊnd - ˈɒf ˈɛɹə/

Categorias:

quantization errorcalculation mistake