Python Forum
Byte string catenation inefficient in 3.7?
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Byte string catenation inefficient in 3.7?
#3
Seems low on an 8 GB Ram machine. Unless there is some parameter limiting the amount of memory used. (I did check there was no paging activity, it occurred to me that possibly byte strings have some internal representation that takes up inordinate amount of space). There was not much else running on the machine and gobs of RAM available.

I’m guessing that char string catenation is done with pointers, and hence the very roughly constant time per increment. And byte strings look like they aren’t, it’s maintaining a single contiguous entity, which seems odd to me. But that’s just an ignorant guess.

Whatever the reason it’s pretty bad. Eight and a half minutes to build a mere 3 MB bmp file is ludicrous. So I’m looking for ways to speed this up.
Reply


Messages In This Thread
RE: Byte string catenation inefficient in 3.7? - by RMJFlack - Aug-16-2019, 01:15 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  pyreadstat write_sav inefficient mikisDeWitte 2 2,756 Jun-21-2021, 09:49 AM
Last Post: mikisDeWitte
  'utf-8' codec can't decode byte 0xe2 in position 122031: invalid continuation byte tienttt 12 11,570 Sep-18-2020, 10:10 PM
Last Post: tienttt
  'utf-8' codec can't decode byte 0xda in position 184: invalid continuation byte karkas 8 31,701 Feb-08-2020, 06:58 PM
Last Post: karkas
  First Byte of a string is missing while receiving data over TCP Socket shahrukh1987 3 4,248 Nov-20-2019, 10:34 AM
Last Post: shahrukh1987
  HELP: String of Zero's and One's to binary byte schwasskin 1 3,876 May-19-2019, 07:31 AM
Last Post: heiner55
  4 byte hex byte swap from binary file medievil 7 22,117 May-08-2018, 08:16 AM
Last Post: killerrex
  get the content of the byte as string ricardons 5 3,695 Mar-02-2018, 02:41 PM
Last Post: ricardons
  byte string Skaperen 5 3,867 Feb-04-2018, 08:58 AM
Last Post: Gribouillis
  byte string in python2 Skaperen 4 4,351 Nov-23-2017, 03:13 AM
Last Post: Skaperen
  Does Python 3.x have a built-in byte string compare function? Raptor88 2 16,420 Feb-18-2017, 10:44 AM
Last Post: Raptor88

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020