Traderji.com - Discussion forum for Stocks Commodities & Forex


NSE Bhavcopy Downloader and Convertor

Discuss NSE Bhavcopy Downloader and Convertor at the Software within the Traderji.com - Discussion forum for Stocks Commodities & Forex; Hello, Here is a small utility that will download and convert NSE Equity Bhavcopy. The ...


Go Back   Traderji.com - Discussion forum for Stocks Commodities & Forex > TOOLS & RESOURCES > Software

Software Charting, trading & technical analysis software, trading system development and backtesting.


Reply
 
Thread Tools
  #1  
Old 21st March 2006, 07:53 PM
Member
 
Join Date: Aug 2005
Posts: 270
Thanks: 2
Thanked 93 Times in 42 Posts
saji oommen will become famous soon enoughsaji oommen will become famous soon enough
Default NSE Bhavcopy Downloader and Convertor

Hello,

Here is a small utility that will download and convert NSE Equity Bhavcopy. The codes were written in Visual Basic. I use windows XP professional SP2 OS. This utility has some advantages and certain limitations which I will mention below. I am uploading the utility with its source code so that group members can can use it and use source code to make any changes.

Advantages:-

1. Will download NSE bhavcopy from NSE directly when the selected date is clicked. What the utility does is that when a Bhavcopy is downloaded it is immediately stored in the MS data access base as per the coding instructions.
2. Generating the required output can be in ascending or descending form. I included the descending form because certain TA softwares will require data in that form. For example – Best Charts. In the generate option buton you can select all the scrips or the selected ones. Just click on the scrips. A search facility is also included to find scrip’s name or symbol easily. Currently you cannot generate output simultaneously in both ascending and descending forms. This problem can be solved easily since my programmer friend has already done it but in SQL Server 2000.
The button delete old generated file was included because to ensure that any corruption to output data generated earlier will not affect the new output.
3. The settings button is used to specify the output folder where you want data to be generated. Any number of folders in any directory can be specified. Example- E:\CSV data or D:\NSE Data etc or in any directory.
4. The file extension is csv. So simply type csv in the file extension blank space and press the apply button below
5. The projection data was a function I had requested for the following purpose. For example while analyzing scrip say in Amibroker you get a buy signal. But you feel the buy will be a good one only if the Moving averages cross over or say RSI has cut its MA. While analyzing the scrip the MAs or RSI may not have crossed its MA. So you would like to know at what price these cross over will happen. So in the projection data you can enter all the imaginary or projected price fields and volume to generate a possible scenario. A safety future has been included so that the existing down loaded data is not corrupted. So next day when you download the bhavcopy the projected data fields are automatically overwritten. I think the safety future will give a warning message box if you try to alter downloaded data. There is a delete facility for projected data entered. I am sorry to say now days I do not use this function much.


Disadvantages

1. Since the utility uses MS Access for data storage there are certain limitations. In MS Access there is a limit to the capacity to store data. Currently my data storage in MS Access of NSE data from year 2000 to current date amounts to 220 MB. I still use the utility. I have been told usually MS Access supports storage up to a maximum of 75-100 MB. Presently the utility is working bit slower and takes a little more time to generate the output may be because I generate data for all the scrips from year 2000. But if only a few scrips and dates are selected it runs very fast. I also feel it runs very fast on powerful computers. I use a laptop with Celeron chip with 256 MB memory.
2. But recently we tried the utility with Microsoft SQL server2000 instead of MS Access and it is really fast with unlimited data storage capacity. For example the utility will generate both the ascending and descending output data simultaneously in 2 or 3 seconds and the downloading of bhavcopy will take another 1-2 seconds. So in 5 seconds you will have the data output from year 2000 to the current date in both ascending and desending forms of all the scrips in NSE. SQL server when installed will always be quietly running in the background without using additional system resources. There is a free version of SQL server 2005 named express edition which can be downloaded from Microsoft site. This server supports data storage capacity up to 4 GB.

So I request you to try SQL server also. But there will be a problem while sharing with the group because the codes have to be written in SQL which requires the services of a programmer with good knowledge of SQL and database applications. And also the group members will have to use SQL server. Well it is only a suggestion. I suppose we will have to stick with MS Access. May be try to find out a way to increase MS Access storge capacity and to make it work faster. If you need data for 3-5 years this utility will more than suffice.

3. Another disadvantage of the utility is while it was being created we had included under the equity table in the MS Acess data base the list of scrips and its other fields including the NSE ID code number unique to a scrip. Go to the installation folder double click on MS Data access file named stock quotes. There you will find a table named equity. Double click on it and you will find price and other field details of scrips.
4. So say while output data of ACC is being generated the programme will cross check ACC symbol with its NSE ID code number in the symbol macro column of equity table to ensure that no wrong symbol data is generated. Although this is a good security check it has certain drawbacks.
5. When new scrip is being traded at NSC its ouput will not be generated until the details of the scrip is included in the MS Access equity table. The search facility also will not list the new scrip. By altering the code little bit the programme can be instructed to generate output on symbol basis. So it will generate all scrips in the bhavcopy downloaded. This can be easily done by any VB programmer. Or anybody can cut and paste the details of new scrip from bhavcopy or the list of scrips traded being provided by NSE to the MS Access equity table. Do not forget to save the changes. And also do not leave any blank lines in between data.
6. The utility has no merge facility. For example Tisco has changed name to Tatasteel. The utility will generate both Tisco and Tatasteel. This is OK if you are using Amibroker or any other TA software which has a merge facility. I feel this function ought to be included in the Data convertor itself since many of the Free TA programmes do not have merge facility. And this is certainly possible.
7. The output file generated is a single file for each scrip consisting of data for dates selected. Say for example for ACC the output is a single file which will consist of data from year 2000 to the current date. Probably the utility will work even faster if output is generated for a single day. But then what happens if older generated data gets corrupted. Taking backups regularly may not be easy for all members. May be you can work out a solution.


8. Never use the utility with the check mark on the button delete old files if the specified output folders are empty. So when reinstalling or using it for first time remove the tick other wise it will give runtime error message.

Installation procedures is separately mentioned in the Exe. folder which is attached.

Down LoadLink

http://rapidshare.de/files/15994041/...oader.zip.html

Group members may try the utility by downloading and generating data for its speed and other functions. Any suggestions or ideas are very much welcome. If we all pool together our resources we can create a great utility.

Regards,

Saji Oommen



Reply With Quote
Sponsored Links
  #2  
Old 22nd March 2009, 01:07 AM
Member
 
Join Date: Mar 2009
Posts: 1
Thanks: 0
Thanked 0 Times in 0 Posts
mustang is on a distinguished road
Default Re: NSE Bhavcopy Downloader and Convertor

Hi Saji

Do you still have the utility to download and convert NSE bhavcopy ? I noticed that your post is very old. Can you share the latest version please. The download link mentioned in your post is not working now.

regards
Reply With Quote
  #3  
Old 30th August 2011, 11:38 PM
Member
 
Join Date: Mar 2010
Posts: 2
Thanks: 1
Thanked 2 Times in 1 Post
ats.sa.satyamshah is on a distinguished road
Default Re: NSE Bhavcopy Downloader and Convertor

HI Saji,

Can u post latest code or copy? Please post. Thanks a lot.

Regards,

S@M


Reply With Quote
Reply

Bookmarks


Advertise Here


Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off


Similar Threads for: NSE Bhavcopy Downloader and Convertor
Thread Thread Starter Forum Replies Last Post
Bhavcopy of Commodities hiteshagarwal_lp Commodities 23 25th September 2012 01:19 PM
nse bhavcopy to MetaStock chartzone MetaStock 2 29th July 2008 07:29 PM
BSE Bhavcopy mbkhatri End of Day 7 6th March 2008 01:33 PM
BSE Daily Bhavcopy Debraj Data Feeds 4 14th November 2007 10:10 PM


All times are GMT +5.5. The time now is 02:33 AM.

Indemnity, Disclaimer & Disclosure Notice:
By visiting Traderji.com you automatically indicate that you agree to our Forum Rules, Indemnity, Disclaimer & Disclosure Notice and General Content Disclaimer Notice and indemnify Traderji.com, its associates and related parties of all claims howsoever resulting from the usage of the forum/site.
Disclaimer: Trading or investing in stocks & commodities is a high risk activity. Any action you choose to take in the markets is totally your own responsibility. You are recommended to make appropriate enquiries and seek appropriate advise before sending money, incurring any expenses, acting on recommendations or entering into any commitment in relation to any advertisement published here. Traderji.com does not vouch for any claims made by the advertisers of products and services. Traderji.com will not be held liable for any consequences in the event such claims are not honoured by the advertisers. Traderji.com will not be liable for any, direct or indirect, consequential or incidental damages or loss arising out of the use of any information by anybody mentioned anywhere on this site.
Disclosure: The information in this forum is neither an offer to sell nor solicitation to buy any of the securities mentioned herein. The writers may or may not be trading in the securities mentioned.
All names or products mentioned are trademarks or registered trademarks of their respective owners.
General Content Disclaimer Notice:
In light of our policy of encouraging candid, open exchanges of views and the rapid distribution of information originating from many sources, Traderji.com cannot determine the accuracy or legality of any information that may be uploaded to the forum. Opinions, advice and all other information expressed by participants in discussions are those of the author. You rely on such information at your own risk. You are urged to seek professional advice for specific, individual situations and not rely solely on advice or opinions given in the discussions. Since Traderji.com is an open and free discussion forum, any comments made by members of this forum in their posts reflect their own views and not of the owner or administrator of Traderji.com. Thus the owner/administrator indemnify themselves of all claims whatsoever and will not be liable or responsible for any members comments/views in this forum Traderji.com. Although we constantly delete all irrelevant content and/or SPAM, if you should find any objectionable or offensive posts made by members of this forum which you would like to bring to our notice for removal then please Contact Us.
 


Copyright © www.Traderji.com 2001 - , All rights reserved.

Recommended Websites - www.TradersEdgeIndia.com - www.TradingPicks.com - www.MasterOfTrading.com

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245