EOD Download/ Convert from NSE and BSE

pkjha30 · #**311** 19th December 2007, 11:37 PM

Hi all and rajuwaste

EQ and BE scrip segregation was done already. Logic is rather simple. Software will select either EQ or BE as per option. If ALL is selected then it will check for EQ and if available discard BE else take BE. So you may not get any missed scrips just because it is being shifted or both series are available.

Today I was able to complete the one part of algorithm.Now this will take care of your second and third problem.

Since the current algorithm is based on database operation question of selection of directory will not arise as data will go to database.

Also database will automatically order the data as desired.But I had to think of asynchronous operations by user who might be downloading data for different dates and each dataset being unique would result in overlapping and duplication and error in database. That has been sorted out.

The same logic would be applied for other downloads.

The folder selection option may be removed in next version. I have to rework conversion logic to take into account database as well as flat file.

Now the only thing that remains to be tested is portfolio scrips limit. I would try this operation with fairly large number of scrips and see what happens. that is for another day.

Hope you people don't mind the delay as there are many excellent and better utilities are now available in the forum.

pankaj

The delay is because I am very busy with other works.But as promised I will give a new version as quickly as possible.

fawazmohd · #**312** 21st December 2007, 04:59 AM

Hi everyone,

i found this fantastic software thanks to the creator. I would like to know how to convert this data to metastock format. any help would be appreciated.

thanks
fawaz

pkjha30 · #**313** 29th December 2007, 12:48 AM

Quote:

Originally Posted by rajneesh_mailbox

DEAR PANKAJ,
it is just to remind u again that your watchlist does not store more 65-70 stock symbols.more characters are deleted from watchlist.
please look in to the matter. for i want to download all future and my portfolio scripts intraday data daily.since it comes to almost 250 symbols,it is not possible through your utility. plz hlp.
one more thing,since nse is more liquid market plz include this for intraday data.
thanks as always for urs efforts.
rajneesh

HI rajneesh

This is to tell you that I just completed testing of downloading all indices for intraday data. Total number of scrips presently stored in database was 5084. Total download time was approx 20 minutes.After download I found approximately 220630 records for 28.12.2007.

It was not freezing the computer and cpu utilisation was less.

However, sensex consists of 30 scrips and main other important list is BSE500. rest are sectoral indices.

I am sure most of the other scrips might not even be traded. Software would have ignored such stocks where data being downloaded some error conditions.

I feel that it is better to keep a limit of say 500.

Another thing is that sometime bse site shows error which is due to their scripts(ASP). This can only be set to skip as no data is downloaded. I such a situation one can try to download another time.

As for NSE it might take some time.

I will now consolidate all changes and tie up loose ends before next version is out.

(For all members also to comment)

Also just wanted to ask if automatic downloads are needed. That is to say if software is running at specific time it will start download and convert the files. But for that internet connection should be working and also I need to check if data is successfully downloaded. So if unattended download is required then please let me know.

pankaj

pkjha30 · #**314** 29th December 2007, 12:51 AM

Hi rajuwaste

corrections and additions are almost complete.All your concerns seems to have been addressed by use of database.Now all records are stored in database and desired output will be given as ascii.

Expect final version soon.

Pankaj

pkjha30 · #**315** 29th December 2007, 12:56 AM

Quote:

Originally Posted by fawazmohd

Hi everyone,

i found this fantastic software thanks to the creator. I would like to know how to convert this data to metastock format. any help would be appreciated.

thanks
fawaz

Hi fawaz

please read thread from the beginning to really understand this. But in simple language you can click convert option on the Menu bar at the top which will show converter page. Check your choices and click on convert. It will give output in ascii format. Defaults are well suited for metastock. but do go through choices carefully. Once you make it , it will be remembered. But if you change at a later date them it will damage the output file unless you rebuild the data. All downloaded data is backed up in backup folder so you don't have to re download it. Just copy all files to respective data folder and convert again.

Once you have converted to ascii file, open metastock and use data import option to import all converted files into metastock .

There is a commercial dll file which directly updated metastock folders without opening it. But that is quite costly. This being freeware it is beyond its scope.

For that purpose you can use satya's softwares which gives such a functionality.

pankaj

rajesh29 · #**316** 13th January 2008, 09:34 AM

pkjha30
Thank you very much for your kind effort.

kkseal · #**317** 13th January 2008, 02:14 PM

Hi Pk,

One thing is still not clear to me Will this s/w download data for ALL NSE stocks or just a few selected ones ( in a watchlist) ?

Regards,
Kalyan.

RANJITSINGH66 · #**318** 13th January 2008, 07:18 PM

dear pkjha30
I have downloaded your software and using it for last few days .I found it very simple to use.it is a great software.thanx and regards.
RANJITSINGH66

abcdgetright · #**319** 15th January 2008, 11:36 PM

Hi
I'm trying to download bse eod stocks using BSE watchlist. is there any limitations to this option. What i mean to asking you is after 70 stocks downloaded, then in the watchlist the program is not taking any scripid to finish remaining scripids to download.

regards...

pkjha30 · #**320** 16th January 2008, 12:21 AM

Quote:

Originally Posted by abcdgetright

Hi
I'm trying to download bse eod stocks using BSE watchlist. is there any limitations to this option. What i mean to asking you is after 70 stocks downloaded, then in the watchlist the program is not taking any scripid to finish remaining scripids to download.

regards...

With current version some limitation in watchlist is there.

But it downloads eod bhav copy of BSE (first radio button option) which contains all scrips. BSE Bhavcopy is available only from April 2004 or 2005. So if one is interested in downloading historical records of BSE (say upto 10 years) then one needs to go by watchlist.

This limitation is removed in new version which will come out shortly.

Pankaj

Similar Threads for: EOD Download/ Convert from NSE and BSE
Thread	Thread Starter	Forum	Replies	Last Post
Download EOD & Historical Data From Here ....	debdas	Data Feeds	139	17th November 2008 07:59 PM
Convert Yahoo .CSV file to Metastock format	saritguha	MetaStock	14	15th May 2008 08:38 PM
How to get realtime data and convert it to metastock format	alexonias	Data Feeds	21	15th April 2008 11:48 AM
How to convert NSE indices CSV files to MS format	saritguha	End of Day	2	21st March 2006 12:34 PM
data download	a_n_i_l	Software	9	25th May 2005 09:17 AM