Python Forum
Filtering data and precision during calculations
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Filtering data and precision during calculations
#1
Photo 
Hello everyone,

I am currently working on a project which requires me to find the minimum of two fonctions.
The problem is that the process generating the data seems very very sensitive (see photos, step = 1e-6) :
[Image: qdWxy3d.png]
[Image: 9TrG9vG.png]

So I have two questions :

1/ Do you think that the "V" and the "horizontal line" for both graph are due to a lack of precision when performing calculations (generating process is complicated and has a lot of steps)

2/ How would you filter the data to only keep the "V"

Thanks in advance,
Best
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  Gmpy2 Newbie Working on Precision charlesrkiss 5 573 Jan-23-2024, 04:23 PM
Last Post: charlesrkiss
  Precision with Decimal Type charlesrkiss 9 759 Jan-18-2024, 06:30 PM
Last Post: charlesrkiss
  Precision conversion garynewport 2 955 Oct-19-2022, 10:47 AM
Last Post: garynewport
Question Parameterized math calculations? babaliaris 7 16,942 Jun-01-2022, 10:19 AM
Last Post: Gribouillis
  Python, how to manage multiple data in list or dictionary with calculations and FIFO Mikeardy 8 2,623 Dec-31-2021, 07:47 AM
Last Post: Mikeardy
  Filtering a data frame according to number of occurences of an observation Menthix 1 1,890 May-31-2021, 10:50 PM
Last Post: supuflounder
  High-Precision Board Voltage Reading from Python into PD Liam484 1 2,094 Mar-29-2021, 02:57 PM
Last Post: Marbelous
  List calculations rturus 1 1,817 Mar-23-2021, 04:40 PM
Last Post: deanhystad
  Automation in calculations interdisciplinary 5 2,712 Dec-10-2020, 11:22 PM
Last Post: deanhystad
  Filtering Excel Document Data Based On Numerical Values eddywinch82 30 10,801 Feb-25-2020, 06:08 PM
Last Post: eddywinch82

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020