Jul-08-2023, 10:12 PM
Classic question regarding floating point math. It is not exact, though 10 to the -17 is about as close to zero as it gets. Suggest rounding to the nearest 10 to the minus 14 and being happy with the result.
math problem for experts
|
|
Messages In This Thread |
math problem for experts - by miltmobley - Jul-08-2023, 08:24 PM
RE: math problem for experts - by jefsummers - Jul-08-2023, 10:12 PM
RE: math problem for experts - by deanhystad - Jul-08-2023, 11:13 PM
RE: math problem for experts - by miltmobley - Jul-09-2023, 12:50 AM
RE: math problem for experts - by deanhystad - Jul-09-2023, 02:16 AM
RE: math problem for experts - by Gribouillis - Jul-09-2023, 07:14 AM
|
Possibly Related Threads… | |||||
Thread | Author | Replies | Views | Last Post | |
math.log versus math.log10 | stevendaprano | 10 | 4,779 |
May-23-2022, 08:59 PM Last Post: jefsummers |
|
Why getting ValueError : Math domain error in trig. function, math.asin() ? | jahuja73 | 3 | 5,404 |
Feb-24-2021, 05:09 PM Last Post: bowlofred |
|
Problem with the math.sin(x) function | Carson147 | 4 | 4,689 |
Feb-21-2019, 05:12 PM Last Post: Carson147 |
|
matrices math problem | lokoprof | 1 | 2,896 |
Aug-27-2018, 07:48 PM Last Post: perfringo |
|
Math problem python | Dhaval | 1 | 3,588 |
Jun-05-2017, 10:28 AM Last Post: wavic |