|
Search Results
|
| Post |
Author |
Forum |
Replies |
Views |
Posted
[asc]
|
| |
|
Thread: Split gps files based on time (text splitting)
Post: Split gps files based on time (text splitting)
| Hi all.
I have a gps file that has the following format. Someone said that it seems to be json file but I am not sure.
Segment of the file looks like that :
ยด
2020-10-12 14:30:23: {"class":"VERSION",... |
|
dervast |
General Coding Help |
0 |
1,893 |
Nov-09-2020, 09:19 AM |
| |
|
Thread: Pipelines for different processing steps
Post: RE: Pipelines for different processing steps
| Thanks I have seen pipelines before and I think is mostly for calling the estimators. Can we have a pre-step on the filtering and data scaling?
Like try this or that filtering and this or that data sc... |
|
dervast |
Data Science |
3 |
2,123 |
Jun-05-2020, 06:08 AM |
| |
|
Thread: Pipelines for different processing steps
Post: Pipelines for different processing steps
| Hi all,
I am having a dataset that I want to try
-different filtering techniques
-different transformations
-different machine learning techniques.
Is there in python a way to set all those differen... |
|
dervast |
Data Science |
3 |
2,123 |
Jun-04-2020, 08:07 AM |
| |
|
Thread: How to take the rest of indeces
Post: How to take the rest of indeces
| Hi all,
I am using the following method to take elements from a list.
this method takes from the list classes_samples the indexes that are given from the list below_zero_baseline_indexes
(itemgetter... |
|
dervast |
General Coding Help |
1 |
1,480 |
Dec-11-2019, 11:31 AM |
| |
|
Thread: Compare two lists. Count larger values
Post: Compare two lists. Count larger values
| Hi all
I have two lists A and B
and I want to compare them element-wise, to check how more often (as percentage) list A has a larger value than list B.
In R that would have been a for loop, but I thi... |
|
dervast |
Data Science |
2 |
2,849 |
Dec-11-2019, 06:56 AM |
| |
|
Thread: List comprehension. Shor for loop version
Post: List comprehension. Shor for loop version
| Hi all,
I have read about list comprehensions
and I was wondering if my simple for loop below can be reduced to a list comprehension in python:
The loop only checks if the initial list has an entry o... |
|
dervast |
General Coding Help |
1 |
1,605 |
Dec-11-2019, 06:30 AM |
| |
|
Thread: When dictionarys do no have same keys
Post: RE: When dictionarys do no have same keys
| This will not work in my case
for key, value in a_dict.items():
print(key, '->', value)since the value does not bring precision directly that I want but one more dictionary. |
|
dervast |
General Coding Help |
3 |
2,326 |
Dec-06-2019, 07:24 AM |
| |
|
Thread: When dictionarys do no have same keys
Post: When dictionarys do no have same keys
| I am new to accessing nested dictionaries and here is the problem I have. One of my columns in a panda frame contains dictionaries. These dictionaries have as a first key ta number, that is not sequen... |
|
dervast |
General Coding Help |
3 |
2,326 |
Dec-05-2019, 10:04 PM |
| |
|
Thread: Sample based on the distribution of a feature to create more balanced data set
Post: Sample based on the distribution of a feature to c...
| Hi all,
I am stuck with a classification problem of unlabeled data. One of the issues I have is that the dataset is imbalanced and I would like to improve it a bit to give less hard job to the cluste... |
|
dervast |
Data Science |
1 |
1,797 |
Sep-25-2019, 05:56 PM |
| |
|
Thread: Clustering for imbalanced data sets
Post: Clustering for imbalanced data sets
| Hi all,
I have a set of measurements with four features.
Two features are continuous (time and distance) and two are discrete.
We also know that the population consists of two groups. One is the m... |
|
dervast |
Data Science |
0 |
1,624 |
Sep-25-2019, 06:34 AM |
| |
|
Thread: Drop rows if a set of columns has a value
Post: Drop rows if a set of columns has a value
| Hi,
I am looking for a way in pandas to do the following:
First lets assume a data frame with the following columns
small_df=df[['1','2','3','4','5','dist','unique']]then I would like to
drop any r... |
|
dervast |
Data Science |
1 |
1,993 |
Sep-06-2019, 01:45 PM |
| |
|
Thread: pandas data frame
Post: pandas data frame
| Hi all, I would like to drop all unique entries based on a specific column value.
I give an example below
data = [[10105, 1], [10105, 1], [10105, 0], [20205, 0], [20205, 0], [20205, 1], [20205, 1],[80... |
|
dervast |
Data Science |
1 |
1,832 |
Aug-28-2019, 06:16 AM |
| |
|
Thread: Python group by and aggregate
Post: Python group by and aggregate
| I have a dataframe with two columns ID and labels. Labels can only be 0 or 1.
The code below generates such a dataframe
data = [[10105, 1], [10105, 1], [10105, 0], [20205, 0], [20205, 0], [20205, 1],... |
|
dervast |
General Coding Help |
1 |
1,588 |
Aug-27-2019, 06:57 AM |
| |
|
Thread: unsupervised learning for distribution of outliers
Post: RE: unsupervised learning for distribution of outl...
| Thanks for your reply.
Actually I would like a clustering technique that is able to see those outliers highlighted in red as a cluster.
The picture is here:
https://i.postimg.cc/mrx2R4Q4/image.png
... |
|
dervast |
Data Science |
3 |
2,749 |
Jul-31-2019, 12:54 PM |
| |
|
Thread: unsupervised learning for distribution of outliers
Post: unsupervised learning for distribution of outliers
| Hi all,
I have two questions related to unsupervised learning.
1. How I can try a few unsupervised learning algorithms and get a measure on the purity of the classification. How clear in other words ... |
|
dervast |
Data Science |
3 |
2,749 |
Jul-30-2019, 05:36 PM |
| |
|
Thread: 5 python columns, row-wise as input to a function
Post: 5 python columns, row-wise as input to a function
| Hi all,
I have a data frame that has 5 columns named as '0','1','2','3','4'
small_pd
Out[53]:
0 1 2 3 4
0 93.0 94.0 93.0 33.0 0.0
1 92.0 94.0 92.0 33.0... |
|
dervast |
General Coding Help |
1 |
2,030 |
Jul-17-2019, 04:44 PM |
| |
|
Thread: appending to the same csv file
Post: RE: appending to the same csv file
| thanks! I will use that.
Anything special for writing a csv file or I just setup the extension when setting the file name.
Thanks again
Alex |
|
dervast |
General Coding Help |
3 |
2,503 |
Jul-16-2019, 05:53 AM |
| |
|
Thread: appending to the same csv file
Post: appending to the same csv file
| Hi all,
inside of one of my for loops I am keeping four parameters that I want to store into four columns of a csv file
# part of an omitted for loop
print('to be saved to the csv, id:',id,' record... |
|
dervast |
General Coding Help |
3 |
2,503 |
Jul-15-2019, 02:25 PM |
| |
|
Thread: Learning indexing with python, pick dates
Post: Learning indexing with python, pick dates
| Hi all,
I have two data frames both contain time indexes with the same time period.
I want to pick start and end periods from the first data frame
start=small_df.index[1]Output:Out[894]: Timestamp('... |
|
dervast |
Data Science |
1 |
1,758 |
Jul-11-2019, 06:23 AM |
| |
|
Thread: extract from strings some parts
Post: extract from strings some parts
| Hi,
I have a data frame where a specific columns is filled in with long strings. I want for each entry there to extract a specific word if that word has some of the following attributes:
-word ends w... |
|
dervast |
General Coding Help |
1 |
1,801 |
Jul-04-2019, 09:25 PM |
