Python Forum
Filtering data and precision during calculations
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Filtering data and precision during calculations
#1
Photo 
Hello everyone,

I am currently working on a project which requires me to find the minimum of two fonctions.
The problem is that the process generating the data seems very very sensitive (see photos, step = 1e-6) :
[Image: qdWxy3d.png]
[Image: 9TrG9vG.png]

So I have two questions :

1/ Do you think that the "V" and the "horizontal line" for both graph are due to a lack of precision when performing calculations (generating process is complicated and has a lot of steps)

2/ How would you filter the data to only keep the "V"

Thanks in advance,
Best
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Gmpy2 Newbie Working on Precision charlesrkiss 6 860 Jun-14-2024, 09:53 AM
Last Post: sunflower36002
  Precision with Decimal Type charlesrkiss 9 1,007 Jan-18-2024, 06:30 PM
Last Post: charlesrkiss
  Precision conversion garynewport 2 1,086 Oct-19-2022, 10:47 AM
Last Post: garynewport
Question Parameterized math calculations? babaliaris 7 17,160 Jun-01-2022, 10:19 AM
Last Post: Gribouillis
  Python, how to manage multiple data in list or dictionary with calculations and FIFO Mikeardy 8 2,854 Dec-31-2021, 07:47 AM
Last Post: Mikeardy
  Filtering a data frame according to number of occurences of an observation Menthix 1 1,954 May-31-2021, 10:50 PM
Last Post: supuflounder
  High-Precision Board Voltage Reading from Python into PD Liam484 1 2,203 Mar-29-2021, 02:57 PM
Last Post: Marbelous
  List calculations rturus 1 1,914 Mar-23-2021, 04:40 PM
Last Post: deanhystad
  Automation in calculations interdisciplinary 5 2,839 Dec-10-2020, 11:22 PM
Last Post: deanhystad
  Filtering Excel Document Data Based On Numerical Values eddywinch82 30 11,456 Feb-25-2020, 06:08 PM
Last Post: eddywinch82

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020