Bug with rounding in STACK

Bug with rounding in STACK

by Joel Scott -
Number of replies: 2
So I'm following the documentaton here regarding the formatting of numbers which suggests that using stackfltfmt:"~,2f"; should result in {@float(2/3)@} producing 0.67 but it doesn't, I get 0.66 both in the CasChat and in a question. Similar behaviour for other fractions 7/9  => 0.77 for example.

Am I misunderstanding the docs? Or am I doing it wrong?

Average of ratings: -
In reply to Joel Scott

Re: Bug with rounding in STACK

by Tim Hunt -
Picture of Core developers Picture of Documentation writers Picture of Particularly helpful Moodlers Picture of Peer reviewers Picture of Plugin developers
You need to read the Maxima documentatoin carefully. I think 'float' is truncating the number, not rounding it. If you want to round the number, you need to use the round function. Only, Maxima users 'Banker's rounding', which is probalby not what you want.

See https://docs.stack-assessment.org/en/CAS/Numbers/#notes-about-numerical-rounding for wht you do want.
Average of ratings: Useful (1)