Python Forum
Search Results
Post Author Forum Replies Views Posted [asc]
    Thread: Split gps files based on time (text splitting)
Post: Split gps files based on time (text splitting)

Hi all. I have a gps file that has the following format. Someone said that it seems to be json file but I am not sure. Segment of the file looks like that : ยด 2020-10-12 14:30:23: {"class":"VERSION",...
dervast General Coding Help 0 380 Nov-09-2020, 09:19 AM
    Thread: Pipelines for different processing steps
Post: RE: Pipelines for different processing steps

Thanks I have seen pipelines before and I think is mostly for calling the estimators. Can we have a pre-step on the filtering and data scaling? Like try this or that filtering and this or that data sc...
dervast Data Science 3 739 Jun-05-2020, 06:08 AM
    Thread: Pipelines for different processing steps
Post: Pipelines for different processing steps

Hi all, I am having a dataset that I want to try -different filtering techniques -different transformations -different machine learning techniques. Is there in python a way to set all those differen...
dervast Data Science 3 739 Jun-04-2020, 08:07 AM
    Thread: How to take the rest of indeces
Post: How to take the rest of indeces

Hi all, I am using the following method to take elements from a list. this method takes from the list classes_samples the indexes that are given from the list below_zero_baseline_indexes (itemgetter...
dervast General Coding Help 1 534 Dec-11-2019, 11:31 AM
    Thread: Compare two lists. Count larger values
Post: Compare two lists. Count larger values

Hi all I have two lists A and B and I want to compare them element-wise, to check how more often (as percentage) list A has a larger value than list B. In R that would have been a for loop, but I thi...
dervast Data Science 2 799 Dec-11-2019, 06:56 AM
    Thread: List comprehension. Shor for loop version
Post: List comprehension. Shor for loop version

Hi all, I have read about list comprehensions and I was wondering if my simple for loop below can be reduced to a list comprehension in python: The loop only checks if the initial list has an entry o...
dervast General Coding Help 1 650 Dec-11-2019, 06:30 AM
    Thread: When dictionarys do no have same keys
Post: RE: When dictionarys do no have same keys

This will not work in my case for key, value in a_dict.items(): print(key, '->', value)since the value does not bring precision directly that I want but one more dictionary.
dervast General Coding Help 3 1,035 Dec-06-2019, 07:24 AM
    Thread: When dictionarys do no have same keys
Post: When dictionarys do no have same keys

I am new to accessing nested dictionaries and here is the problem I have. One of my columns in a panda frame contains dictionaries. These dictionaries have as a first key ta number, that is not sequen...
dervast General Coding Help 3 1,035 Dec-05-2019, 10:04 PM
    Thread: Sample based on the distribution of a feature to create more balanced data set
Post: Sample based on the distribution of a feature to c...

Hi all, I am stuck with a classification problem of unlabeled data. One of the issues I have is that the dataset is imbalanced and I would like to improve it a bit to give less hard job to the cluste...
dervast Data Science 1 741 Sep-25-2019, 05:56 PM
    Thread: Clustering for imbalanced data sets
Post: Clustering for imbalanced data sets

Hi all, I have a set of measurements with four features. Two features are continuous (time and distance) and two are discrete. We also know that the population consists of two groups. One is the m...
dervast Data Science 0 563 Sep-25-2019, 06:34 AM
    Thread: Drop rows if a set of columns has a value
Post: Drop rows if a set of columns has a value

Hi, I am looking for a way in pandas to do the following: First lets assume a data frame with the following columns small_df=df[['1','2','3','4','5','dist','unique']]then I would like to drop any r...
dervast Data Science 1 826 Sep-06-2019, 01:45 PM
    Thread: pandas data frame
Post: pandas data frame

Hi all, I would like to drop all unique entries based on a specific column value. I give an example below data = [[10105, 1], [10105, 1], [10105, 0], [20205, 0], [20205, 0], [20205, 1], [20205, 1],[80...
dervast Data Science 1 820 Aug-28-2019, 06:16 AM
    Thread: Python group by and aggregate
Post: Python group by and aggregate

I have a dataframe with two columns ID and labels. Labels can only be 0 or 1. The code below generates such a dataframe data = [[10105, 1], [10105, 1], [10105, 0], [20205, 0], [20205, 0], [20205, 1],...
dervast General Coding Help 1 675 Aug-27-2019, 06:57 AM
    Thread: unsupervised learning for distribution of outliers
Post: RE: unsupervised learning for distribution of outl...

Thanks for your reply. Actually I would like a clustering technique that is able to see those outliers highlighted in red as a cluster. The picture is here: https://i.postimg.cc/mrx2R4Q4/image.png ...
dervast Data Science 3 1,125 Jul-31-2019, 12:54 PM
    Thread: unsupervised learning for distribution of outliers
Post: unsupervised learning for distribution of outliers

Hi all, I have two questions related to unsupervised learning. 1. How I can try a few unsupervised learning algorithms and get a measure on the purity of the classification. How clear in other words ...
dervast Data Science 3 1,125 Jul-30-2019, 05:36 PM
    Thread: 5 python columns, row-wise as input to a function
Post: 5 python columns, row-wise as input to a function

Hi all, I have a data frame that has 5 columns named as '0','1','2','3','4' small_pd Out[53]: 0 1 2 3 4 0 93.0 94.0 93.0 33.0 0.0 1 92.0 94.0 92.0 33.0...
dervast General Coding Help 1 881 Jul-17-2019, 04:44 PM
    Thread: appending to the same csv file
Post: RE: appending to the same csv file

thanks! I will use that. Anything special for writing a csv file or I just setup the extension when setting the file name. Thanks again Alex
dervast General Coding Help 3 1,046 Jul-16-2019, 05:53 AM
    Thread: appending to the same csv file
Post: appending to the same csv file

Hi all, inside of one of my for loops I am keeping four parameters that I want to store into four columns of a csv file # part of an omitted for loop print('to be saved to the csv, id:',id,' record...
dervast General Coding Help 3 1,046 Jul-15-2019, 02:25 PM
    Thread: Learning indexing with python, pick dates
Post: Learning indexing with python, pick dates

Hi all, I have two data frames both contain time indexes with the same time period. I want to pick start and end periods from the first data frame start=small_df.index[1]Output:Out[894]: Timestamp('...
dervast Data Science 1 784 Jul-11-2019, 06:23 AM
    Thread: extract from strings some parts
Post: extract from strings some parts

Hi, I have a data frame where a specific columns is filled in with long strings. I want for each entry there to extract a specific word if that word has some of the following attributes: -word ends w...
dervast General Coding Help 1 833 Jul-04-2019, 09:25 PM

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020