Python Forum
Filtering data and precision during calculations
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Filtering data and precision during calculations
#1
Photo 
Hello everyone,

I am currently working on a project which requires me to find the minimum of two fonctions.
The problem is that the process generating the data seems very very sensitive (see photos, step = 1e-6) :
[Image: qdWxy3d.png]
[Image: 9TrG9vG.png]

So I have two questions :

1/ Do you think that the "V" and the "horizontal line" for both graph are due to a lack of precision when performing calculations (generating process is complicated and has a lot of steps)

2/ How would you filter the data to only keep the "V"

Thanks in advance,
Best
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Gmpy2 Newbie Working on Precision charlesrkiss 6 869 Jun-14-2024, 09:53 AM
Last Post: sunflower36002
  Precision with Decimal Type charlesrkiss 9 1,012 Jan-18-2024, 06:30 PM
Last Post: charlesrkiss
  Precision conversion garynewport 2 1,090 Oct-19-2022, 10:47 AM
Last Post: garynewport
Question Parameterized math calculations? babaliaris 7 17,167 Jun-01-2022, 10:19 AM
Last Post: Gribouillis
  Python, how to manage multiple data in list or dictionary with calculations and FIFO Mikeardy 8 2,856 Dec-31-2021, 07:47 AM
Last Post: Mikeardy
  Filtering a data frame according to number of occurences of an observation Menthix 1 1,955 May-31-2021, 10:50 PM
Last Post: supuflounder
  High-Precision Board Voltage Reading from Python into PD Liam484 1 2,207 Mar-29-2021, 02:57 PM
Last Post: Marbelous
  List calculations rturus 1 1,917 Mar-23-2021, 04:40 PM
Last Post: deanhystad
  Automation in calculations interdisciplinary 5 2,843 Dec-10-2020, 11:22 PM
Last Post: deanhystad
  Filtering Excel Document Data Based On Numerical Values eddywinch82 30 11,467 Feb-25-2020, 06:08 PM
Last Post: eddywinch82

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020