Python Forum
pyarrow error when importing pandas
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
pyarrow error when importing pandas
#1
I am trying to import pandas but I keep getting an error relating to pyarrow. It worked fine before, but started giving me the error once I installed/uninstalled some programs/libraries using conda and pip3. Attached is my code and error.

Attached Files

Thumbnail(s)
   
Reply
#2
There is conflict in your environment between pandas and pyarrow.
The Path to environment seem wrong,should never point Python 3.9 inside Lib.
Just make new environment,this much easier than troubleshooting the conflict.

Follow this as i do not think you have done this right last time.
This will install full Python 3.10.8 version with Pandas and Selenium,Jupyterlab
C:\Anaconda3
λ cd Scripts\

C:\Anaconda3\Scripts
λ activate.bat

# Now is base environment activateted,you always start from here
(base) C:\Anaconda3\Scripts

# Make new environment 
(base) C:\Anaconda3\Scripts
λ conda create --name new_env -c conda-forge jupyterlab pandas selenium python=3.10.8
Collecting package metadata (current_repodata.json): done
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: done

The following NEW packages will be INSTALLED:

  anyio              conda-forge/noarch::anyio-3.7.0-pyhd8ed1ab_1
  argon2-cffi        conda-forge/noarch::argon2-cffi-21.3.0-pyhd8ed1ab_0
  argon2-cffi-bindi~ conda-forge/win-64::argon2-cffi-bindings-21.2.0-py310h8d17308_3
  asttokens          conda-forge/noarch::asttokens-2.2.1-pyhd8ed1ab_0
  async-lru          conda-forge/noarch::async-lru-2.0.2-pyhd8ed1ab_0
  async_generator    conda-forge/noarch::async_generator-1.10-py_0
  attrs              conda-forge/noarch::attrs-23.1.0-pyh71513ae_1
  babel              conda-forge/noarch::babel-2.12.1-pyhd8ed1ab_1
  backcall           conda-forge/noarch::backcall-0.2.0-pyh9f0ad1d_0
  backports          conda-forge/noarch::backports-1.0-pyhd8ed1ab_3
  backports.functoo~ conda-forge/noarch::backports.functools_lru_cache-1.6.4-pyhd8ed1ab_0
  beautifulsoup4     conda-forge/noarch::beautifulsoup4-4.12.2-pyha770c72_0
  bleach             conda-forge/noarch::bleach-6.0.0-pyhd8ed1ab_0
  brotli             conda-forge/win-64::brotli-1.0.9-hcfcfb64_8
  brotli-bin         conda-forge/win-64::brotli-bin-1.0.9-hcfcfb64_8
  bzip2              conda-forge/win-64::bzip2-1.0.8-h8ffe710_4
  ca-certificates    conda-forge/win-64::ca-certificates-2023.5.7-h56e8100_0
  certifi            conda-forge/noarch::certifi-2023.5.7-pyhd8ed1ab_0
  cffi               conda-forge/win-64::cffi-1.15.1-py310h628cb3f_3
  charset-normalizer conda-forge/noarch::charset-normalizer-3.1.0-pyhd8ed1ab_0
  colorama           conda-forge/noarch::colorama-0.4.6-pyhd8ed1ab_0
  comm               conda-forge/noarch::comm-0.1.3-pyhd8ed1ab_0
  debugpy            conda-forge/win-64::debugpy-1.6.7-py310h00ffb61_0
  decorator          conda-forge/noarch::decorator-5.1.1-pyhd8ed1ab_0
  defusedxml         conda-forge/noarch::defusedxml-0.7.1-pyhd8ed1ab_0
  entrypoints        conda-forge/noarch::entrypoints-0.4-pyhd8ed1ab_0
  exceptiongroup     conda-forge/noarch::exceptiongroup-1.1.1-pyhd8ed1ab_0
  executing          conda-forge/noarch::executing-1.2.0-pyhd8ed1ab_0
  flit-core          conda-forge/noarch::flit-core-3.9.0-pyhd8ed1ab_0
  h11                conda-forge/noarch::h11-0.14.0-pyhd8ed1ab_0
  idna               conda-forge/noarch::idna-3.4-pyhd8ed1ab_0
  importlib-metadata conda-forge/noarch::importlib-metadata-6.6.0-pyha770c72_0
  importlib_metadata conda-forge/noarch::importlib_metadata-6.6.0-hd8ed1ab_0
  importlib_resourc~ conda-forge/noarch::importlib_resources-5.12.0-pyhd8ed1ab_0
  intel-openmp       conda-forge/win-64::intel-openmp-2023.1.0-h57928b3_46319
  ipykernel          conda-forge/noarch::ipykernel-6.23.1-pyh025b116_0
  ipython            conda-forge/noarch::ipython-8.14.0-pyh08f2357_0
  jedi               conda-forge/noarch::jedi-0.18.2-pyhd8ed1ab_0
  jinja2             conda-forge/noarch::jinja2-3.1.2-pyhd8ed1ab_1
  json5              conda-forge/noarch::json5-0.9.5-pyh9f0ad1d_0
  jsonschema         conda-forge/noarch::jsonschema-4.17.3-pyhd8ed1ab_0
  jupyter-lsp        conda-forge/noarch::jupyter-lsp-2.2.0-pyhd8ed1ab_0
  jupyter_client     conda-forge/noarch::jupyter_client-8.2.0-pyhd8ed1ab_0
  jupyter_core       conda-forge/win-64::jupyter_core-5.3.0-py310h5588dad_0
  jupyter_events     conda-forge/noarch::jupyter_events-0.6.3-pyhd8ed1ab_0
  jupyter_server     conda-forge/noarch::jupyter_server-2.6.0-pyhd8ed1ab_0
  jupyter_server_te~ conda-forge/noarch::jupyter_server_terminals-0.4.4-pyhd8ed1ab_1
  jupyterlab         conda-forge/noarch::jupyterlab-4.0.1-pyhd8ed1ab_0
  jupyterlab_pygmen~ conda-forge/noarch::jupyterlab_pygments-0.2.2-pyhd8ed1ab_0
  jupyterlab_server  conda-forge/noarch::jupyterlab_server-2.22.1-pyhd8ed1ab_0
  libblas            conda-forge/win-64::libblas-3.9.0-17_win64_mkl
  libbrotlicommon    conda-forge/win-64::libbrotlicommon-1.0.9-hcfcfb64_8
  libbrotlidec       conda-forge/win-64::libbrotlidec-1.0.9-hcfcfb64_8
  libbrotlienc       conda-forge/win-64::libbrotlienc-1.0.9-hcfcfb64_8
  libcblas           conda-forge/win-64::libcblas-3.9.0-17_win64_mkl
  libffi             conda-forge/win-64::libffi-3.4.2-h8ffe710_5
  libhwloc           conda-forge/win-64::libhwloc-2.9.1-cpu_hadd60ae_5
  libiconv           conda-forge/win-64::libiconv-1.17-h8ffe710_0
  liblapack          conda-forge/win-64::liblapack-3.9.0-17_win64_mkl
  libsodium          conda-forge/win-64::libsodium-1.0.18-h8d14728_1
  libsqlite          conda-forge/win-64::libsqlite-3.42.0-hcfcfb64_0
  libxml2            conda-forge/win-64::libxml2-2.11.4-hc3477c8_0
  libzlib            conda-forge/win-64::libzlib-1.2.13-hcfcfb64_4
  markupsafe         conda-forge/win-64::markupsafe-2.1.3-py310h8d17308_0
  matplotlib-inline  conda-forge/noarch::matplotlib-inline-0.1.6-pyhd8ed1ab_0
  mistune            conda-forge/noarch::mistune-2.0.5-pyhd8ed1ab_0
  mkl                conda-forge/win-64::mkl-2022.1.0-h6a75c08_874
  nbclient           conda-forge/noarch::nbclient-0.8.0-pyhd8ed1ab_0
  nbconvert-core     conda-forge/noarch::nbconvert-core-7.4.0-pyhd8ed1ab_0
  nbformat           conda-forge/noarch::nbformat-5.9.0-pyhd8ed1ab_0
  nest-asyncio       conda-forge/noarch::nest-asyncio-1.5.6-pyhd8ed1ab_0
  notebook-shim      conda-forge/noarch::notebook-shim-0.2.3-pyhd8ed1ab_0
  numpy              conda-forge/win-64::numpy-1.24.3-py310hd02465a_0
  openssl            conda-forge/win-64::openssl-3.1.1-hcfcfb64_1
  outcome            conda-forge/noarch::outcome-1.2.0-pyhd8ed1ab_0
  overrides          conda-forge/noarch::overrides-7.3.1-pyhd8ed1ab_0
  packaging          conda-forge/noarch::packaging-23.1-pyhd8ed1ab_0
  pandas             conda-forge/win-64::pandas-2.0.2-py310h1c4a608_0
  pandocfilters      conda-forge/noarch::pandocfilters-1.5.0-pyhd8ed1ab_0
  parso              conda-forge/noarch::parso-0.8.3-pyhd8ed1ab_0
  pickleshare        conda-forge/noarch::pickleshare-0.7.5-py_1003
  pip                conda-forge/noarch::pip-23.1.2-pyhd8ed1ab_0
  pkgutil-resolve-n~ conda-forge/noarch::pkgutil-resolve-name-1.3.10-pyhd8ed1ab_0
  platformdirs       conda-forge/noarch::platformdirs-3.5.1-pyhd8ed1ab_0
  prometheus_client  conda-forge/noarch::prometheus_client-0.17.0-pyhd8ed1ab_0
  prompt-toolkit     conda-forge/noarch::prompt-toolkit-3.0.38-pyha770c72_0
  prompt_toolkit     conda-forge/noarch::prompt_toolkit-3.0.38-hd8ed1ab_0
  psutil             conda-forge/win-64::psutil-5.9.5-py310h8d17308_0
  pthreads-win32     conda-forge/win-64::pthreads-win32-2.9.1-hfa6e2cd_3
  pure_eval          conda-forge/noarch::pure_eval-0.2.2-pyhd8ed1ab_0
  pycparser          conda-forge/noarch::pycparser-2.21-pyhd8ed1ab_0
  pygments           conda-forge/noarch::pygments-2.15.1-pyhd8ed1ab_0
  pyrsistent         conda-forge/win-64::pyrsistent-0.19.3-py310h8d17308_0
  pysocks            conda-forge/noarch::pysocks-1.7.1-pyh0701188_6
  python             conda-forge/win-64::python-3.10.8-h4de0772_0_cpython
  python-dateutil    conda-forge/noarch::python-dateutil-2.8.2-pyhd8ed1ab_0
  python-fastjsonsc~ conda-forge/noarch::python-fastjsonschema-2.17.1-pyhd8ed1ab_0
  python-json-logger conda-forge/noarch::python-json-logger-2.0.7-pyhd8ed1ab_0
  python-tzdata      conda-forge/noarch::python-tzdata-2023.3-pyhd8ed1ab_0
  python_abi         conda-forge/win-64::python_abi-3.10-3_cp310
  pytz               conda-forge/noarch::pytz-2023.3-pyhd8ed1ab_0
  pywin32            conda-forge/win-64::pywin32-304-py310h00ffb61_2
  pywinpty           conda-forge/win-64::pywinpty-2.0.10-py310h00ffb61_0
  pyyaml             conda-forge/win-64::pyyaml-6.0-py310h8d17308_5
  pyzmq              conda-forge/win-64::pyzmq-25.1.0-py310hcd737a0_0
  requests           conda-forge/noarch::requests-2.31.0-pyhd8ed1ab_0
  rfc3339-validator  conda-forge/noarch::rfc3339-validator-0.1.4-pyhd8ed1ab_0
  rfc3986-validator  conda-forge/noarch::rfc3986-validator-0.1.1-pyh9f0ad1d_0
  selenium           conda-forge/noarch::selenium-4.9.1-pyhd8ed1ab_0
  send2trash         conda-forge/noarch::send2trash-1.8.2-pyh08f2357_0
  setuptools         conda-forge/noarch::setuptools-67.7.2-pyhd8ed1ab_0
  six                conda-forge/noarch::six-1.16.0-pyh6c4a22f_0
  sniffio            conda-forge/noarch::sniffio-1.3.0-pyhd8ed1ab_0
  sortedcontainers   conda-forge/noarch::sortedcontainers-2.4.0-pyhd8ed1ab_0
  soupsieve          conda-forge/noarch::soupsieve-2.3.2.post1-pyhd8ed1ab_0
  stack_data         conda-forge/noarch::stack_data-0.6.2-pyhd8ed1ab_0
  tbb                conda-forge/win-64::tbb-2021.9.0-h91493d7_0
  terminado          conda-forge/noarch::terminado-0.17.0-pyh08f2357_0
  tinycss2           conda-forge/noarch::tinycss2-1.2.1-pyhd8ed1ab_0
  tk                 conda-forge/win-64::tk-8.6.12-h8ffe710_0
  tomli              conda-forge/noarch::tomli-2.0.1-pyhd8ed1ab_0
  tornado            conda-forge/win-64::tornado-6.3.2-py310h8d17308_0
  traitlets          conda-forge/noarch::traitlets-5.9.0-pyhd8ed1ab_0
  trio               conda-forge/win-64::trio-0.21.0-py310h5588dad_0
  trio-websocket     conda-forge/noarch::trio-websocket-0.10.2-pyhd8ed1ab_0
  typing-extensions  conda-forge/noarch::typing-extensions-4.6.3-hd8ed1ab_0
  typing_extensions  conda-forge/noarch::typing_extensions-4.6.3-pyha770c72_0
  typing_utils       conda-forge/noarch::typing_utils-0.1.0-pyhd8ed1ab_0
  tzdata             conda-forge/noarch::tzdata-2023c-h71feb2d_0
  ucrt               conda-forge/win-64::ucrt-10.0.22621.0-h57928b3_0
  urllib3            conda-forge/noarch::urllib3-2.0.2-pyhd8ed1ab_0
  vc                 conda-forge/win-64::vc-14.3-hb25d44b_16
  vc14_runtime       conda-forge/win-64::vc14_runtime-14.34.31931-h5081d32_16
  vs2015_runtime     conda-forge/win-64::vs2015_runtime-14.34.31931-hed1258a_16
  wcwidth            conda-forge/noarch::wcwidth-0.2.6-pyhd8ed1ab_0
  webencodings       conda-forge/noarch::webencodings-0.5.1-py_1
  websocket-client   conda-forge/noarch::websocket-client-1.5.2-pyhd8ed1ab_0
  wheel              conda-forge/noarch::wheel-0.40.0-pyhd8ed1ab_0
  win_inet_pton      conda-forge/noarch::win_inet_pton-1.1.0-pyhd8ed1ab_6
  winpty             conda-forge/win-64::winpty-0.4.3-4
  wsproto            conda-forge/noarch::wsproto-1.2.0-pyhd8ed1ab_0
  xz                 conda-forge/win-64::xz-5.2.6-h8d14728_0
  yaml               conda-forge/win-64::yaml-0.2.5-h8ffe710_2
  zeromq             conda-forge/win-64::zeromq-4.3.4-h0e60522_1
  zipp               conda-forge/noarch::zipp-3.15.0-pyhd8ed1ab_0


Proceed ([y]/n)? y
.....

Executing transaction: done
#
# To activate this environment, use
#
#     $ conda activate new_env
#
# To deactivate an active environment, use
#
#     $ conda deactivate
......

# Activate new_env,see that it change to  (new_env)
(base) C:\Anaconda3
λ activate new_env

# Now in new_env environment test Pandas 
(new_env) C:\Anaconda3
λ python
Python 3.10.8 | packaged by conda-forge | (main, Nov 22 2022, 08:16:33) [MSC v.1929 64 bit (AMD64)] on win32
Type "help", "copyright", "credits" or "license" for more information.
>>> import pandas as pd
>>>
>>> pd.__version__
'2.0.2'
>>> exit()

(new_env) C:\Anaconda3\Scripts 
sravva likes this post
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  pandas.errors.ParserError: Error tokenizing data. C error: Expected 9 fields in line Anldra12 9 15,375 Jun-15-2021, 08:16 AM
Last Post: Anldra12
  ERROR: importing desired module mbgamer28 0 1,688 Apr-05-2021, 07:46 PM
Last Post: mbgamer28
  OSError: Unable to load libjvm when connecting to hdfs with pyarrow 3.0.0 aupres 0 3,177 Mar-22-2021, 10:25 AM
Last Post: aupres
  How to update values in a pyarrow table? xraphael75 1 3,684 Jan-25-2021, 02:14 PM
Last Post: xraphael75
Bug Error while importing numpy Erfan 3 3,292 Nov-28-2020, 07:49 AM
Last Post: bowlofred
  pyarrow throws oserror winerror 193 1 is not a valid win32 application aupres 2 3,797 Oct-21-2020, 01:04 AM
Last Post: aupres
  Pandas installation error pyzyx3qwerty 3 2,539 Jun-04-2020, 10:09 AM
Last Post: pyzyx3qwerty
  Importing module from a package results in import error goghvv 2 2,409 Mar-27-2020, 07:13 PM
Last Post: goghvv
  Error importing package julio2000 3 3,784 Jan-26-2020, 06:15 PM
Last Post: buran
  Error in importing numpy fullstop 1 1,933 Dec-18-2019, 12:07 PM
Last Post: jefsummers

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020