setBlockSize#
Purpose#
Set maximum size of memory block to load.
Format#
- setBlockSize(block_size)#
- Parameters:
block_size (scalar or string) –
scalar: fixed number of rows to use
string: string specifier for chunk size. options can be:
”10%” [10% of total system RAM]
”500K” [500 Kilobytes]
”10M” [10 Megabytes]
”100M” [100 Megabytes]
”1G” [1 Gigabyte]
Examples#
// Set maximum amount of data to load at a time to be 10 Kilobytes
setBlockSize("10K");
// Estimate model parameters, never loading more
// than 10 KB of 'mydata.dat' at a time
call olsmt("mydata.dat", "Y ~ X1 + X2");
Remarks#
setBlockSize() controls the maximum number of rows to read at a time for
functions which can process datasets in chunks, such as olsmt() and dstatmt().
setBlockSize() is not threadsafe. To control the size of data blocks
loaded in code which is threaded with threadBegin/threadStat or
threadfor, threadendfor, you must call setBlockSize() before the threads are created.