Search Results
|
Post |
Author |
Forum |
Replies |
Views |
Posted
[asc]
|
|
|
Thread: How to set PYTHONPATH in Visual Studio Code?
Post: RE: How to set PYTHONPATH in Visual Studio Code?
I appreciate your reply. One of my project environments is the integration of Apache Spark. So I have to import pyspark module. Lots of python files include pyspark module. For example,
from pyspark.... |
|
aupres |
General Coding Help |
5 |
4,129 |
Aug-15-2023, 06:25 AM |
|
|
Thread: How to set PYTHONPATH in Visual Studio Code?
Post: RE: How to set PYTHONPATH in Visual Studio Code?
Thanks for your reply. In my vs code, I have only one python interpreter - conda base. And I always activate the conda. But the same error is thrown.
[attachment=2494] |
|
aupres |
General Coding Help |
5 |
4,129 |
Aug-15-2023, 03:37 AM |
|
|
Thread: How to set PYTHONPATH in Visual Studio Code?
Post: How to set PYTHONPATH in Visual Studio Code?
Hello!
Belows are my dev environment,
OS : Windows 11
python : Anaconda3
Apache Spark : 3.4.1
IDE : Visual Studio Code 1.18.1And I try to integrate apache spark pyspark into VS code. So I set the p... |
|
aupres |
General Coding Help |
5 |
4,129 |
Aug-14-2023, 10:17 AM |
|
|
Thread: can not import anaconda pandas module. PySpark pandas module is imported!!
Post: can not import anaconda pandas module. PySpark pan...
My visual Studio Code is integrated with apache spark module. So pyspark module is imported with python codes. But I try to import anaconda pandas and it brings the error
Error:File "/home/joseph/VSC... |
|
aupres |
General Coding Help |
0 |
715 |
Aug-06-2023, 01:09 AM |
|
|
Thread: multi index issue of one hot encoder preprocessing
Post: multi index issue of one hot encoder preprocessing
Hello, I am a newbie on feature engineering. Belows are the sample pandas DataFrame and the results
df = pd.DataFrame({'city':['seoul', 'seoul', 'seoul', 'pusan', 'pusan', 'pusan', 'gwangju', 'gwangj... |
|
aupres |
Data Science |
0 |
1,075 |
Jun-10-2022, 11:23 AM |
|
|
Thread: How to set LD_LIBRARY_PATH on python codes?
Post: How to set LD_LIBRARY_PATH on python codes?
I am using eclipse ide. So I configure LD_LIBRARY_PATH environment variable on eclipse ide. But I try to generate python codes which are independent on development ide. I want to generate codes which ... |
|
aupres |
General Coding Help |
1 |
8,437 |
Mar-25-2021, 08:32 AM |
|
|
Thread: OSError: Unable to load libjvm when connecting to hdfs with pyarrow 3.0.0
Post: OSError: Unable to load libjvm when connecting to ...
I try to develop hadoop file system client application with pyarrow 3 on windows 10. First, my development environment are like below,
OS : Windows 10
Language : Anaconda 2020.11
IDE : eclipse
And m... |
|
aupres |
General Coding Help |
0 |
3,152 |
Mar-22-2021, 10:25 AM |
|
|
Thread: Integration of apache spark and Kafka on eclipse pyspark
Post: Integration of apache spark and Kafka on eclipse p...
These are my development environments to integrate kafka and spark.
IDE : eclipse 2020-12
python : Anaconda 2020.02 (Python 3.7)
kafka : 2.13-2.7.0
spark : 3.0.1-bin-hadoop3.2
My eclipse configurati... |
|
aupres |
General Coding Help |
1 |
3,752 |
Feb-27-2021, 06:53 AM |
|
|
Thread: KafkaUtils module not found on spark 3 pyspark
Post: KafkaUtils module not found on spark 3 pyspark
I use hadoop 3.3.0 and spark 3.0.1-bin-hadoop3.2. And my python ide is eclipse version 2020-12. I try to develop python application with KafkaUtils pyspark module. My configuration reference of pyspar... |
|
aupres |
General Coding Help |
2 |
7,360 |
Feb-17-2021, 07:11 AM |
|
|
Thread: how to create pythonic codes including for loop and if statement?
Post: how to create pythonic codes including for loop an...
I am a newbie on python coding. Below are my legacy python codes.
for i, df_list in enumerate(df_list_of_list):
for j, df in enumerate(df_list):
if i == 0 & j ==0:
fred.wr... |
|
aupres |
General Coding Help |
1 |
1,922 |
Jan-02-2021, 12:46 AM |
|
|
Thread: pyarrow throws oserror winerror 193 1 is not a valid win32 application
Post: RE: pyarrow throws oserror winerror 193 1 is not a...
Thanks for your reply. As you told, I sent the e-mail to the maintainer of pyarrow project. But I receive no reply until now. Kindly inform me of any reply. |
|
aupres |
General Coding Help |
2 |
3,776 |
Oct-21-2020, 01:04 AM |
|
|
Thread: pyarrow throws oserror winerror 193 1 is not a valid win32 application
Post: pyarrow throws oserror winerror 193 1 is not a val...
Hello! My OS is windows 10 64bit and IDE is eclipse python. I try to install pyarrow with both pip and conda. The installation of pyarrow is successful. But my codes throw the errors like below,
impo... |
|
aupres |
General Coding Help |
2 |
3,776 |
Oct-19-2020, 11:03 AM |
|
|
Thread: ImportError: Can not find the shared library: libhdfs3.so
Post: ImportError: Can not find the shared library: libh...
I am developing Hadoop File System client with python module hdfs3. My OS is CentOS 8 and IDE is eclipse. First I try to install hdfs3 with conda install command.
# conda config --add channels conda... |
|
aupres |
General Coding Help |
1 |
4,040 |
Oct-18-2020, 03:57 AM |
|
|
Thread: how to handling time series data file with Python?
Post: RE: how to handling time series data file with Pyt...
Hello, How about this python codes using pandas median function. Because the 'people_in_poverty' columns have list values, I use the pandas median function to get the single value of feature matrix,
... |
|
aupres |
Data Science |
4 |
2,988 |
Aug-07-2020, 11:00 PM |
|
|
Thread: how to handling time series data file with Python?
Post: RE: how to handling time series data file with Pyt...
I try to make model to predict 'people_in_poverty' of each 'state' with inputs of 'earning' and 'races'. So my feature matrix would be like below,
State Earnings Hispanic Indian Asian Black... |
|
aupres |
Data Science |
4 |
2,988 |
Jul-29-2020, 10:53 AM |
|
|
Thread: how to handling time series data file with Python?
Post: how to handling time series data file with Python?
I am a newbie in deep learning and try to make feature matrix with python. My sample data structure is like below,
dataset.csv
State Earnings Hispanic Indian Asian Black White people_i... |
|
aupres |
Data Science |
4 |
2,988 |
Jul-28-2020, 01:01 AM |