Error while importing IEOD Data in Ami..

#1
Hi!!
An error is occurring when importing IEOD data into Amibroker from last week. Seniors please help me to sort it out.

AmiBroker version 5.10.1.4900
( cooltool.dll 5.10.1, mfc42.dll 6.6.8064, msvcrt.dll 7.0.7601 )

Microsoft Windows 2000 version 6.1 (Build 7601)
Service Pack 1.0
Common Controls: 6.16

Unhandled exception
Type: CAmiException
Description: CMemoryException in AddQuotationInt()
Address: 00000000

AFL Parser status:
Processing stage: NONE
Formula ID: 0 ()
Action 0 (NONE)

Additional information:

Number of stock loaded: 1754
Currently selected stock: RELCAPITAL
Number of quotes (current stock): 358760

Workspace:
Data source = (default), Data local mode = 1, NumBars = 50000

Preferences:
Data source = (local), Data local mode = 1, NumBars = 1000

Command history:
2900 - Displays ASCII import wizard - suitable for beginner users--Import Wizard

Cache manager stats:
Number of list elements: 349
Number of map elements: 349
Hash table size: 5987

Memory status:
MemoryLoad: 86 %
TotalPhys: 2097151K AvailPhys: 367304K
TotalPageFile: 4194303K AvailPageFile: 2783316K
TotalVirtual: 2097024K AvailVirtual: 259376K

Last Windows message:
HWnd: 0x80618
Msg: 0x0110
wParam: 0x000a05d2
lParam: 0x00000000
 

trash

Well-Known Member
#2
You run out of memory most probably. Your hardware cant handle amount of data. Upgrade your hardware and OS (you run Win 2000!). You also run very old AB version. Is it even a legal one? Anyway upgrade all software to 64bit (OS and AB).
 
#3
I checked the memory of the system and only 14% of memory is used and rest of the hard disk is still free. This problem start occurring from 2-3 days only. Can you suggest me something else??/
 

trash

Well-Known Member
#4
The description says memory exception. Your available memory is also very low. I'm not talking about hard disk I am talking about RAM! If you are not happy then go to AB support!
 
#5
If you try to import bulk data ?,may be the problem.
 

trash

Well-Known Member
#7
Again, your hardware and software are very outdated. You seem to wanna import large data blocks.

32-bit applications in Windows generally have a limit of 2GB addressable space (4GB when running on 64-bit Windows OS). On the other hand if you run 64-bit application on 64-bit Windows OS the current limit is 16 TB (terabytes) = 16000GB.

So it is advised to run 64-bit system and 64-bit software in this case 64-bit AB if working with large data. You also need up-to-date hardware technology. In your case it is long overdue!

Anyway here is quote from AB knowledge base
Decrease the size of in-memory cache, if you are using very large databases (>2GB in disk size)

The "in-memory cache" size defined in Tools->Preferences, "Data" tab controls the number of symbols in the cache and maximum amount of memory consumed by the cache. While larger cache generally speeds up processing because data do not need to be read from disk and written back all the time, you may run out of memory on certain situations when your cache is too large, especially on 32-bit operating system that limits the available virtual memory per process to 2GB. To avoid running out of memory, go to Tools->Preferences, "Data" and decrease the size of in-memory cache. To set it to minimum, enter "11" (eleven) into "in-memory cache (max. symbols)".
IMPORTANT: It is advised NOT to decrease the cache when your databases are relatively small (few hundred MB) as larger cache will speed up the access. Large cache is good thing as long as you do not run out of memory.
IMPORTANT: It is advised NOT to decrease the cache when your databases are relatively small (few hundred MB) as larger cache will speed up the access. Large cache is good thing as long as you do not run out of memory.
http://www.amibroker.com/guide/x_performance.html
 

cloudTrader

Well-Known Member
#9
Try this , it may help .

Go to Tools > Preferences > Data.

There you will find a Column (Max Mega bytes) under Memory Cache .

By default the value in it is 512 . Increase this value to say 640 [512+128].

Then try backfilling the data. If it helps then good .
 

mastermind007

Well-Known Member
#10
Hi!!
An error is occurring when importing IEOD data into Amibroker from last week. Seniors please help me to sort it out.

AmiBroker version 5.10.1.4900
( cooltool.dll 5.10.1, mfc42.dll 6.6.8064, msvcrt.dll 7.0.7601 )

Microsoft Windows 2000 version 6.1 (Build 7601)
Service Pack 1.0
Common Controls: 6.16

Unhandled exception
Type: CAmiException
Description: CMemoryException in AddQuotationInt()
Address: 00000000

AFL Parser status:
Processing stage: NONE
Formula ID: 0 ()
Action 0 (NONE)

Additional information:

Number of stock loaded: 1754
Currently selected stock: RELCAPITAL
Number of quotes (current stock): 358760

Workspace:
Data source = (default), Data local mode = 1, NumBars = 50000

Preferences:
Data source = (local), Data local mode = 1, NumBars = 1000

Command history:
2900 - Displays ASCII import wizard - suitable for beginner users--Import Wizard

Cache manager stats:
Number of list elements: 349
Number of map elements: 349
Hash table size: 5987

Memory status:
MemoryLoad: 86 %
TotalPhys: 2097151K AvailPhys: 367304K
TotalPageFile: 4194303K AvailPageFile: 2783316K
TotalVirtual: 2097024K AvailVirtual: 259376K

Last Windows message:
HWnd: 0x80618
Msg: 0x0110
wParam: 0x000a05d2
lParam: 0x00000000

As others said, it is memory overload exception. Memory load is at 86%.

Last Windows Message reveals that it was attempting to ready a dialog box for displaying and was unable to get necessary memory for the same.

Your machine does have resources to fulfill this requirement so you simply need to update the preferences and can continue in this setup for at least another decade.
 

Similar threads