You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The bitstring exotic floats go through an intermediate step for efficiency reasons. They truncate to 16 bits and can then use a lookup table.
This works OK, but it does mean that sometimes things can get rounded in the wrong direction. See scott-griffiths/bitstring#342
With bitformat we have a Rust core which should be pretty fast at this sort of thing, without needing the rounding approximation, so suggest it's implemented in Rust rather than porting over the LUT code.
The text was updated successfully, but these errors were encountered:
The bitstring exotic floats go through an intermediate step for efficiency reasons. They truncate to 16 bits and can then use a lookup table.
This works OK, but it does mean that sometimes things can get rounded in the wrong direction. See scott-griffiths/bitstring#342
With bitformat we have a Rust core which should be pretty fast at this sort of thing, without needing the rounding approximation, so suggest it's implemented in Rust rather than porting over the LUT code.
The text was updated successfully, but these errors were encountered: