Python Forum
Search Results
Post Author Forum Replies Views Posted [asc]
    Thread: How to set PYTHONPATH in Visual Studio Code?
Post: RE: How to set PYTHONPATH in Visual Studio Code?

I appreciate your reply. One of my project environments is the integration of Apache Spark. So I have to import pyspark module. Lots of python files include pyspark module. For example, from pyspark....
aupres General Coding Help 5 4,129 Aug-15-2023, 06:25 AM
    Thread: How to set PYTHONPATH in Visual Studio Code?
Post: RE: How to set PYTHONPATH in Visual Studio Code?

Thanks for your reply. In my vs code, I have only one python interpreter - conda base. And I always activate the conda. But the same error is thrown. [attachment=2494]
aupres General Coding Help 5 4,129 Aug-15-2023, 03:37 AM
    Thread: How to set PYTHONPATH in Visual Studio Code?
Post: How to set PYTHONPATH in Visual Studio Code?

Hello! Belows are my dev environment, OS : Windows 11 python : Anaconda3 Apache Spark : 3.4.1 IDE : Visual Studio Code 1.18.1And I try to integrate apache spark pyspark into VS code. So I set the p...
aupres General Coding Help 5 4,129 Aug-14-2023, 10:17 AM
    Thread: can not import anaconda pandas module. PySpark pandas module is imported!!
Post: can not import anaconda pandas module. PySpark pan...

My visual Studio Code is integrated with apache spark module. So pyspark module is imported with python codes. But I try to import anaconda pandas and it brings the error Error:File "/home/joseph/VSC...
aupres General Coding Help 0 715 Aug-06-2023, 01:09 AM
    Thread: multi index issue of one hot encoder preprocessing
Post: multi index issue of one hot encoder preprocessing

Hello, I am a newbie on feature engineering. Belows are the sample pandas DataFrame and the results df = pd.DataFrame({'city':['seoul', 'seoul', 'seoul', 'pusan', 'pusan', 'pusan', 'gwangju', 'gwangj...
aupres Data Science 0 1,075 Jun-10-2022, 11:23 AM
    Thread: How to set LD_LIBRARY_PATH on python codes?
Post: How to set LD_LIBRARY_PATH on python codes?

I am using eclipse ide. So I configure LD_LIBRARY_PATH environment variable on eclipse ide. But I try to generate python codes which are independent on development ide. I want to generate codes which ...
aupres General Coding Help 1 8,437 Mar-25-2021, 08:32 AM
    Thread: OSError: Unable to load libjvm when connecting to hdfs with pyarrow 3.0.0
Post: OSError: Unable to load libjvm when connecting to ...

I try to develop hadoop file system client application with pyarrow 3 on windows 10. First, my development environment are like below, OS : Windows 10 Language : Anaconda 2020.11 IDE : eclipse And m...
aupres General Coding Help 0 3,152 Mar-22-2021, 10:25 AM
  Photo Thread: Integration of apache spark and Kafka on eclipse pyspark
Post: Integration of apache spark and Kafka on eclipse p...

These are my development environments to integrate kafka and spark. IDE : eclipse 2020-12 python : Anaconda 2020.02 (Python 3.7) kafka : 2.13-2.7.0 spark : 3.0.1-bin-hadoop3.2 My eclipse configurati...
aupres General Coding Help 1 3,752 Feb-27-2021, 06:53 AM
    Thread: KafkaUtils module not found on spark 3 pyspark
Post: KafkaUtils module not found on spark 3 pyspark

I use hadoop 3.3.0 and spark 3.0.1-bin-hadoop3.2. And my python ide is eclipse version 2020-12. I try to develop python application with KafkaUtils pyspark module. My configuration reference of pyspar...
aupres General Coding Help 2 7,360 Feb-17-2021, 07:11 AM
    Thread: how to create pythonic codes including for loop and if statement?
Post: how to create pythonic codes including for loop an...

I am a newbie on python coding. Below are my legacy python codes. for i, df_list in enumerate(df_list_of_list): for j, df in enumerate(df_list): if i == 0 & j ==0: fred.wr...
aupres General Coding Help 1 1,922 Jan-02-2021, 12:46 AM
    Thread: pyarrow throws oserror winerror 193 1 is not a valid win32 application
Post: RE: pyarrow throws oserror winerror 193 1 is not a...

Thanks for your reply. As you told, I sent the e-mail to the maintainer of pyarrow project. But I receive no reply until now. Kindly inform me of any reply.
aupres General Coding Help 2 3,776 Oct-21-2020, 01:04 AM
    Thread: pyarrow throws oserror winerror 193 1 is not a valid win32 application
Post: pyarrow throws oserror winerror 193 1 is not a val...

Hello! My OS is windows 10 64bit and IDE is eclipse python. I try to install pyarrow with both pip and conda. The installation of pyarrow is successful. But my codes throw the errors like below, impo...
aupres General Coding Help 2 3,776 Oct-19-2020, 11:03 AM
    Thread: ImportError: Can not find the shared library: libhdfs3.so
Post: ImportError: Can not find the shared library: libh...

I am developing Hadoop File System client with python module hdfs3. My OS is CentOS 8 and IDE is eclipse. First I try to install hdfs3 with conda install command. # conda config --add channels conda...
aupres General Coding Help 1 4,040 Oct-18-2020, 03:57 AM
    Thread: how to handling time series data file with Python?
Post: RE: how to handling time series data file with Pyt...

Hello, How about this python codes using pandas median function. Because the 'people_in_poverty' columns have list values, I use the pandas median function to get the single value of feature matrix, ...
aupres Data Science 4 2,988 Aug-07-2020, 11:00 PM
    Thread: how to handling time series data file with Python?
Post: RE: how to handling time series data file with Pyt...

I try to make model to predict 'people_in_poverty' of each 'state' with inputs of 'earning' and 'races'. So my feature matrix would be like below, State Earnings Hispanic Indian Asian Black...
aupres Data Science 4 2,988 Jul-29-2020, 10:53 AM
    Thread: how to handling time series data file with Python?
Post: how to handling time series data file with Python?

I am a newbie in deep learning and try to make feature matrix with python. My sample data structure is like below, dataset.csv State Earnings Hispanic Indian Asian Black White people_i...
aupres Data Science 4 2,988 Jul-28-2020, 01:01 AM

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020