@neauoire What number representation is used here?...

Devine Lu Linvega's posts Post Back to profile

@neauoire What number representation is used here? It looks like the display format is integer part plus fraction. Are the individual component regular machine words or bignums?

Like 20 Jul 2022 at 19:17 | Wall-to-wall | Open on merveilles.town

6 comments

Devine Lu Linvega

@csepp A mixed fraction is a whole number and a portion less than 1 together, like 2 3/4.

20 Jul 2022 at 19:19 | Open on merveilles.town

Csepp 🌢

@neauoire So that's what they are called. But what's the whole number in memory? Like, what's the biggest number it can represent, and what happens in case of an overflow?

20 Jul 2022 at 19:21 | Open on merveilles.town

Devine Lu Linvega

@csepp fractions are made of two shorts, it'll overflow after 65k

20 Jul 2022 at 19:22 | Open on merveilles.town

Devine Lu Linvega

@csepp it'll wrap around in case of an overflow.

20 Jul 2022 at 19:23 | Open on merveilles.town

Csepp 🌢

@neauoire Thanks! Well, not ideal but I guess fine for a toy. UwU

20 Jul 2022 at 19:25 | Open on merveilles.town

Devine Lu Linvega

@csepp it's really rare that I noodling around with numbers higher than 60 thousands, but I might add a warning or something at some point if that starts bothering me.

20 Jul 2022 at 19:26 | Open on merveilles.town

Go Up