Search Results
|
Post |
Author |
Forum |
Replies |
Views |
Posted
[asc]
|
|
|
Thread: how to parse data
Post: RE: how to parse data
nm ..... worked it out....
numrecords=(len(res))
for x in range(0, numrecords):
print (res[x]['addr'])
**cry** |
|
fakka |
General Coding Help |
2 |
1,498 |
Sep-22-2021, 10:36 PM |
|
|
Thread: how to parse data
Post: how to parse data
Raw data
[{'accept_servers': True, 'addr': '10.64.1.41', 'architecture': 'x86_64', 'bigredis_storage_path': '/var/opt/redislabs/flash', 'bigstore_driver': '', 'cores': 4, 'ephemeral_storage_path': ... |
|
fakka |
General Coding Help |
2 |
1,498 |
Sep-22-2021, 10:14 PM |
|
|
Thread: design
Post: RE: design
(Aug-26-2021, 03:15 PM)deanhystad Wrote: This does not look like differences. P2 is the same for all three machines. The value of P1 is different for Machine2, but Machine1 and Machine3 are the sa... |
|
fakka |
General Coding Help |
4 |
1,767 |
Aug-26-2021, 03:24 PM |
|
|
Thread: design
Post: RE: design
machine1, p1, dog
machine1, p2, 3
machine1, p3, 1
machine2, p1, cat
machine2, p2, 3
machine2, p3, 2
machine3, p1, dog
machine3, p2, 3
machine3, p3, 4
Output really just has to spit out the difference... |
|
fakka |
General Coding Help |
4 |
1,767 |
Aug-26-2021, 03:02 PM |
|
|
Thread: design
Post: design
HI
I have data that will look like this. Idea is to compare all parameters from machine 2 and 3 to the master machine (machine 1).
Whats the best way to store this ...... and then to compare. Was thin... |
|
fakka |
General Coding Help |
4 |
1,767 |
Aug-26-2021, 01:14 PM |
|
|
Thread: Memory Use in array
Post: RE: Memory Use in array
(Jan-28-2020, 09:31 PM)DeaD_EyE Wrote: Maybe it's a xyproblem.
Why do you need everything in memory?
Why does your query have no filter nor limit?
What do you want to do with the data?
Can you do th... |
|
fakka |
General Coding Help |
11 |
4,497 |
Jan-29-2020, 04:21 PM |
|
|
Thread: Memory Use in array
Post: RE: Memory Use in array
Any ideas here ?
Not sure how to take this any further ? |
|
fakka |
General Coding Help |
11 |
4,497 |
Jan-28-2020, 06:22 PM |
|
|
Thread: Memory Use in array
Post: RE: Memory Use in array
Did confirm its not pycharm. Occurs in regular linux python also.
I dumped some data into a text file - 40 million lines
$ cat /tmp/datadump.txt | wc -l
49568121
]$ du -sh /tmp/datadump.txt
... |
|
fakka |
General Coding Help |
11 |
4,497 |
Jan-24-2020, 06:01 PM |
|
|
Thread: Memory Use in array
Post: RE: Memory Use in array
(Jan-23-2020, 05:14 PM)perfringo Wrote: There is built-in tracemalloc which could be used to trace memory allocation.
Thanks I will google it.
Is there a suggestion on doing it a different way ? M... |
|
fakka |
General Coding Help |
11 |
4,497 |
Jan-24-2020, 04:01 PM |
|
|
Thread: Memory Use in array
Post: RE: Memory Use in array
Anyone with any ideas/suggestions ?
thanks |
|
fakka |
General Coding Help |
11 |
4,497 |
Jan-23-2020, 04:22 PM |
|
|
Thread: Memory Use in array
Post: RE: Memory Use in array
(Jan-22-2020, 07:48 PM)DeaD_EyE Wrote: Quote:Is this a coding issue or a pycharm issue ?
If you use sys.getsize on a list, you'll see only how much the list itself consumes in memory.
Each element ... |
|
fakka |
General Coding Help |
11 |
4,497 |
Jan-22-2020, 07:50 PM |
|
|
Thread: Memory Use in array
Post: Memory Use in array
Hi all.
I have a loop that populates an array via a DB query of keys (short text) .... raw data size is [1580990412 bytes] => 1.5GB
mydocsarray=[]
for eachrow in cbs.my_query(q):
m... |
|
fakka |
General Coding Help |
11 |
4,497 |
Jan-22-2020, 04:31 PM |
|
|
Thread: debugging
Post: debugging
Hi
Using pycharm IDE
Generally I can work out the issues with code based on output or line number., But every now and then I cant easily work out the issue. here is an example.
Error:Traceback (most... |
|
fakka |
General Coding Help |
0 |
1,539 |
Jan-03-2020, 07:02 PM |
|
|
Thread: Cleaner way to rewrite
Post: RE: Cleaner way to rewrite
Thats awesome stullis (and others) ... I wouldnt have have thought about it like that, adding a defined program back to array. IS that because essentially each call is being 'bound' to a variable ....... |
|
fakka |
General Coding Help |
5 |
3,087 |
Dec-04-2019, 04:16 PM |
|
|
Thread: Cleaner way to rewrite
Post: Cleaner way to rewrite
Whats a clean way to rewrite this dynamically. Rather than essentially hardcoded.
ProcessInput1 is a defined function.
a1,b2,c3,d4,e5,f6,g7,h8,i9,j10,k11,l12,m13,n14,o15,p16,q17,r18,s19,t20 = np... |
|
fakka |
General Coding Help |
5 |
3,087 |
Dec-03-2019, 09:48 PM |
|
|
Thread: JSON parsing (nested)
Post: JSON parsing (nested)
RAW JSON below
How would I output 'mem_free' value under the nested JSON - only if the 'hostname': 'hcb005sp01p.mydoman.com:8091'
{'name': 'default', 'nodes': [{'systemStats': {'cpu_utilization_ra... |
|
fakka |
General Coding Help |
0 |
3,076 |
Nov-25-2019, 09:25 PM |
|
|
Thread: JSON
Post: JSON
JSON looks like this
===========================
{
"op": {
"samples": {
"COL_1_RESULT": [
2533973817,
3745333807,
3745333807,
3745333... |
|
fakka |
General Coding Help |
0 |
1,208 |
Jul-12-2019, 03:08 PM |
|
|
Thread: cProfile debugging
Post: cProfile debugging
Have some basic code that loops through a set of databases and assigns a count to a python list.
At end I just make a sum of that python list.
The sum seems to be where its really slow - which is stra... |
|
fakka |
General Coding Help |
0 |
1,284 |
Jul-10-2019, 01:41 PM |