Python Forum
Byte string catenation inefficient in 3.7?
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Byte string catenation inefficient in 3.7?
#3
Seems low on an 8 GB Ram machine. Unless there is some parameter limiting the amount of memory used. (I did check there was no paging activity, it occurred to me that possibly byte strings have some internal representation that takes up inordinate amount of space). There was not much else running on the machine and gobs of RAM available.

I’m guessing that char string catenation is done with pointers, and hence the very roughly constant time per increment. And byte strings look like they aren’t, it’s maintaining a single contiguous entity, which seems odd to me. But that’s just an ignorant guess.

Whatever the reason it’s pretty bad. Eight and a half minutes to build a mere 3 MB bmp file is ludicrous. So I’m looking for ways to speed this up.
Reply


Messages In This Thread
RE: Byte string catenation inefficient in 3.7? - by RMJFlack - Aug-16-2019, 01:15 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  pyreadstat write_sav inefficient mikisDeWitte 2 2,691 Jun-21-2021, 09:49 AM
Last Post: mikisDeWitte
  'utf-8' codec can't decode byte 0xe2 in position 122031: invalid continuation byte tienttt 12 11,356 Sep-18-2020, 10:10 PM
Last Post: tienttt
  'utf-8' codec can't decode byte 0xda in position 184: invalid continuation byte karkas 8 31,480 Feb-08-2020, 06:58 PM
Last Post: karkas
  First Byte of a string is missing while receiving data over TCP Socket shahrukh1987 3 4,172 Nov-20-2019, 10:34 AM
Last Post: shahrukh1987
  HELP: String of Zero's and One's to binary byte schwasskin 1 3,829 May-19-2019, 07:31 AM
Last Post: heiner55
  4 byte hex byte swap from binary file medievil 7 21,940 May-08-2018, 08:16 AM
Last Post: killerrex
  get the content of the byte as string ricardons 5 3,631 Mar-02-2018, 02:41 PM
Last Post: ricardons
  byte string Skaperen 5 3,769 Feb-04-2018, 08:58 AM
Last Post: Gribouillis
  byte string in python2 Skaperen 4 4,282 Nov-23-2017, 03:13 AM
Last Post: Skaperen
  Does Python 3.x have a built-in byte string compare function? Raptor88 2 16,306 Feb-18-2017, 10:44 AM
Last Post: Raptor88

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020