What Every Computer Scientist Should Know about Floating-Point Arithmetic [pdf]
https://www.itu.dk/~sestoft/bachelor/IEEE754_article.pdf
#HackerNews #FloatingPointArithmetic #ComputerScience #IEEE754 #ProgrammingKnowledge #TechEducation
What Every Computer Scientist Should Know about Floating-Point Arithmetic [pdf]
https://www.itu.dk/~sestoft/bachelor/IEEE754_article.pdf
#HackerNews #FloatingPointArithmetic #ComputerScience #IEEE754 #ProgrammingKnowledge #TechEducation
All these recent discussions of error handling and mishandling and parsing and NaNs in my timeline all circulating like NaTs on an #Itanium are reminiscent of the video player controls seen on a very much not-small website.
Oh, and as for NaNs and videos, and for the ~three of you that haven’t yet seen it, “A lightning talk by Gary Bernhardt from CodeMash 2012”, a very short and very funny video on this same topic:
https://www.destroyallsoftware.com/talks/wat
#humor #humour #wat #NaN #floatingpoint #FloatingPointArithmetic #fp
https://oldbytes.space/@arclight/112047281273277753
Thanks Duolingo! I appreciate myself some EXTRA precise stats! 😎
#Duolingo #Floats #FloatingPoint #FloatingPointArithmetic #Precision
Interesting floating-point summation tip [ https://twitter.com/raymondh/status/1301800636866940928 ]:
"Raymond Hettinger @raymondh
#Python floating point ninja tip: Use parentheses to regroup sums to minimize accumulated round-off error.
Instead of:
a + b + c + d + e + f + g + h
Write:
((a + b) + (c + d)) + ((e + f) + (g + h))
Note, the total work is unchanged."
For more on this see [ https://en.wikipedia.org/wiki/Pairwise_summation ]
Extracting ROM constants from the 8087 math coprocessor's die
http://www.righto.com/2020/05/extracting-rom-constants-from-8087-math.html
#Intel8087 #FloatingPointArithmetic #ComputerHistory #Math #Intel