Python Forum
Gmpy2 Newbie Working on Precision
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Gmpy2 Newbie Working on Precision
#6
Thank you Case.

JTLYK, I spent hours carefully looking into the significands (see video), first and second 'derivatives,' and stretching limits (see image), including working with the different rounding types. And yes, it is ALL PERFECT and SO impressive.

Some plots using RoundToNearest, when I was at the limit:

   

I'm so grateful for your help, and putting me on the right track. Gmpy2 works exactly as expected, once I started moving up the learning curve a bit. Now I can get back to the actual math (that I virtually forgot over these last few days). LOL

I would like to add that I use the GNU graphics software GIMP a lot, and it's really funny that I keep adding a letter "I" and must backspace to delete it. LOL

If you need any images and I could save you some time, please let me know.

Thank you so much !!!


.mp4   forum.mp4 (Size: 1,020.1 KB / Downloads: 18)
Reply


Messages In This Thread
Gmpy2 Newbie Working on Precision - by charlesrkiss - Jan-21-2024, 11:54 PM
RE: Gmpy2 Newbie Working on Precision - by casevh - Jan-23-2024, 06:51 AM
RE: Gmpy2 Newbie Working on Precision - by charlesrkiss - Jan-23-2024, 04:23 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Precision with Decimal Type charlesrkiss 9 918 Jan-18-2024, 06:30 PM
Last Post: charlesrkiss
  Precision conversion garynewport 2 1,037 Oct-19-2022, 10:47 AM
Last Post: garynewport
Photo Filtering data and precision during calculations Scientifix 0 1,833 Mar-30-2021, 01:00 PM
Last Post: Scientifix
  High-Precision Board Voltage Reading from Python into PD Liam484 1 2,140 Mar-29-2021, 02:57 PM
Last Post: Marbelous
  Decimal (Global precision setting) Valentina 3 3,735 Aug-23-2019, 11:53 AM
Last Post: Valentina
  python decimal scale precision massimo_m 5 5,596 Aug-22-2019, 11:47 AM
Last Post: perfringo
  Trouble with decimal precision Cassie 4 3,238 Feb-14-2019, 08:23 PM
Last Post: Cassie
  precision error chris64 1 2,290 Nov-29-2017, 09:40 PM
Last Post: micseydel

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020