Python Forum
Round float according to uncertainty
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Round float according to uncertainty
#2
you can use fixed point arithmetic, where you have full control over rounding
python.org has a section on this method here: https://docs.python.org/3/library/decimal.html

This, by the way, is the same method that we (Spectrochemical engineering Lab, Instrumentation Laboratories 1980's) used to do all of the math for a scanning plasma monochromator. Never used floating point. Programming language was forth.
Reply


Messages In This Thread
RE: Round float according to uncertainty - by Larz60+ - Jun-08-2021, 09:25 PM

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020