Python Forum
Automating to save generated data
Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
Automating to save generated data
#3
Thanks, I tried that. Although it runs fine, I wonder why the information is not stores in the map.dat files created.

That is, when I read via print(f[:10]), I get all zeros. Do you know what's happening?


L = 1000
data = np.random.rand(4064, 1)
print(data.shape[0])

for j in range(data.shape[0] // L):
    mapper = np.memmap(f'map{j}.dat', dtype='float64', mode='w+', shape=(L, 1))
    mapper = data[j * L:j * L + L]
    print(mapper[:10])

if data.shape[0] % L != 0:
    mapper = np.memmap(f'map{j + 1}.dat', dtype='float64', mode='w+', shape=(data.shape[0] % L, 1))
    mapper = data[j * L + L:]
    print(mapper.shape)

# Reading the maps
L = 10**3
M = 1
f = np.memmap('map1.dat', dtype='float64', mode='r', shape=(L,M))
print(f[:10])


(Aug-12-2020, 12:51 AM)scidam Wrote: I didn't test it, but something like the following should help you:

L = 1000
data = np.random.rand(4064, 1)

for j in range(data.shape[0] // L):
    mapper = np.memmap(f'map{j}.dat', dtype='float64', mode='w+', shape=(L,1))
    mapper = data[j*L:j*L+L]

if data.shape[0] % L != 0:
    mapper = np.memmap(f'map{j+1}.dat', dtype='float64', mode='w+', shape=(data.shape[0] % L,1))
    mapper = data[j*L + L:]
Reply


Messages In This Thread
Automating to save generated data - by Robotguy - Aug-11-2020, 09:49 PM
RE: Automating to save generated data - by scidam - Aug-12-2020, 12:51 AM
RE: Automating to save generated data - by Robotguy - Aug-12-2020, 02:07 AM
RE: Automating to save generated data - by Robotguy - Aug-12-2020, 03:32 PM

Possibly Related Threads…
Thread Author Replies Views Last Post
  Automating to generate multiple arrays Robotguy 1 1,853 Nov-05-2020, 08:14 AM
Last Post: Gribouillis
  Automating PyTables Dataset Creation and Append Robotguy 1 1,863 Oct-18-2020, 08:35 PM
Last Post: jefsummers
  save my sensor data from the bme680 into a json or csv file Plastefuchs84 1 3,188 Aug-23-2019, 03:04 AM
Last Post: Plastefuchs84
  save parameters an data from image to csv pifko22 0 1,981 Apr-02-2019, 10:22 PM
Last Post: pifko22
  save video frames into pandas data-frame tofi 0 2,730 Oct-18-2018, 07:02 PM
Last Post: tofi
  Automating the code using os.walk kiton 20 14,599 Apr-13-2017, 06:15 PM
Last Post: kiton

Forum Jump:

User Panel Messages

Announcements
Announcement #1 8/1/2020
Announcement #2 8/2/2020
Announcement #3 8/6/2020