Object Oriented Software Engineering   View all facts   Glossary   Help

subject > problem > defect > defect in a numerical algorithm > not using enough places after the decimal point

not using enough places after the decimal point comparison table

Subject	have testing strategy	is a kind of	force
defect in a numerical algorithm		defect
not using enough places after the decimal point	perform calculations that involve many significant figures, and large differences in magnitude	defect in a numerical algorithm	the system to round excessively, which can mean that data is stored inaccurately and can also lead to a build-up of errors

Next defect in a numerical algorithm: not using enough significant figures    Up: defect in a numerical algorithm    Previous defect in a numerical algorithm: not using enough bits or digits to store maximum values