Version française
Home     About     Download     Resources     Contact us    
Browse thread
What library to use for arbitrary precision decimals
[ Home ] [ Index: by date | by threads ]
[ Search: ]

[ Message by date: previous | next ] [ Message in thread: previous | next ] [ Thread: previous | next ]
Date: -- (:)
From: Richard Jones <rich@a...>
Subject: Re: [Caml-list] What library to use for arbitrary precision decimals 

I checked the standard and for standard operations on NUMERIC, the
precision of the result is implementation defined, while the scale
depends on the operation:

 + -    S_r = max (S_1, S_2)
 *      S_r = S_1 + S_2
 /      S_r = implementation defined

where S_r = scale of the result, and S_1 = scale of the first operand
and S_2 = scale of the second operand.

Rich.

-- 
Richard Jones, CTO Merjis Ltd.
Merjis - web marketing and technology - http://merjis.com
Team Notepad - intranets and extranets for business - http://team-notepad.com