Python Forum
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
output limited
#1
Running Python 2.7 and Pandas.
Editor is Sublime Text.
Wrote a program to display two columns from a large csv file. The output seems correct, but truncates after 29 lines and then returns at line 2584504 through to the end. I don't know what is controlling this. Perhaps a setting, or a function of my editor? Any thoughts?
# read specific columns from a csv file using pandas
#
import csv
import pandas as pd
#
df = pd.read_csv('/home/bob/Python_data_sets/phila_crime_incidents_part1_part2.csv', usecols = ['location_block', 'text_general_code'])
print(df)
Reply
#2
Hi, check this out:
https://stackoverflow.com/a/30691921/4620679
tsvikas Wrote:
with pd.option_context('display.max_rows', None, 'display.max_columns', None):  # more options can be specified also
    print(df)
Reply
#3
Added the pd.option context -
import csv
import pandas as pd
#
df = pd.read_csv('/home/bob/Python_data_sets/phila_crime_incidents_part1_part2.csv', usecols = ['location_block', 'text_general_code'])
# print(df)
with pd.option_context('display.max_rows'), None, 'display.max_columns', None:
print(df)

This returned -
Traceback (most recent call last):
File "/home/bob/Python_work_area/read_specific_columns_from_a_csv_file_using_pandas.py", line 8, in <module>
with pd.option_context('display.max_rows'), None, 'display.max_columns', None:
File "/usr/lib64/python2.7/site-packages/pandas/core/config.py", line 390, in __init__
raise ValueError('Need to invoke as'
ValueError: Need to invoke asoption_context(pat, val, [(pat, val), ...)).
[Finished in 3.9s with exit code 1]
[shell_cmd: python -u "/home/bob/Python_work_area/read_specific_columns_from_a_csv_file_using_pandas.py"]
[dir: /home/bob/Python_work_area]
[path: /usr/bin:/usr/lib64/qt5/bin:/usr/share/kf5:/usr/libexec:/bin:/usr/bin:/usr/local/bin:/usr/games:/usr/lib64/qt5/bin:/usr/lib64/qt4/bin:/home/bob/bin:/sbin:/usr/sbin]
Reply
#4
It looks like this line was copied incorrectly, closing bracket is to early.
loren41 Wrote:
with pd.option_context('display.max_rows'), None, 'display.max_columns', None:
Reply


Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020