David,
Thanks for the feedback. Looking it over, I can see some places where it can be improved because it seems to slurp up the whole results file without iterating over it with something like numpy.memmap. At this time, we don't have the resources to dig into it, but I've assigned it bug #AV-5098.
Thanks,
Aaron
________________________________
From: discuss <discuss-bounces_at_lists.opencpi.org> on behalf of David Banks <dbanks_at_geontech.com>
Sent: Thursday, January 17, 2019 12:00:47 PM
To: discuss_at_lists.opencpi.org
Subject: [Discuss OpenCPI] data_src.test verification using up 24GB RAM and failing
On my system with 24GB of RAM, data_src.test (from release_1.4)
verification fails for case00.02 with the following python error:
Executing case case00.02 using worker data_src.hdl...
Execution succeeded, time was 00:01:07 (67 seconds).
Verifying case case00.02 for worker data_src.hdl using script on output
file: case00.02.data_src.hdl.out.out
PASS: output file length >= 1 samples for 'num_samples' property value
= -1
Traceback (most recent call last):
File "../../verify.py", line 187, in <module>
main()
File "../../verify.py", line 184, in main
test_odata_file_binary_contents_are_as_expected()
File "../../verify.py", line 115, in
test_odata_file_binary_contents_are_as_expected
data = np.remainder(np.arange(len(odata)), 2**DATA_BIT_WIDTH_p)
*MemoryError*
* Verification for port out: FAILED*
make: *** [run] Error 1
The first two cases succeed and pass verification. I monitored my system
resources while it was running case00.02 and saw that the python3 process
used up ~100% of my system's 24GB of memory.
--
David Banks
dbanks_at_geontech.com
Geon Technologies, LLC
Received on Fri Jan 18 2019 - 11:59:49 CST