StockD - Another NSE EOD Data Downloader

trump

Well-Known Member
#22
did as you suggested, but same issue, debug file is blank
lets wait for others to give feedback

json file copied from text editor and am pasting as code, hv a look

Code:
{"BASELINK": {"base_URL": "https://www.nseindia.com", "stock_TYPE": "NSE Archives"}, "SETTINGS": {"eqCheck": {"type": "checkbox", "value": "true"}, "eqDir": {"type": "directory", "value": "E:\\StockD EOD downloader\\Equity"}, "fuCheck": {"type": "checkbox", "value": "false"}, "fuDir": {"type": "directory", "value": "./Futures"}, "fuPrefix": {"type": "checkbox", "value": "false"}, "inCheck": {"type": "checkbox", "value": "true"}, "inKeepOthersCheck": {"type": "checkbox", "value": "false"}, "inDir": {"type": "directory", "value": "E:\\StockD EOD downloader\\Indices"}, "allCheck": {"type": "checkbox", "value": "false"}, "allIncludeFUCheck": {"type": "checkbox", "value": "false"}, "allDir": {"type": "directory", "value": "./EOD"}, "advSkipWeekend": {"type": "checkbox", "value": "true"}}, "LINKS": {"eqBhav": {"link": "https://www.nseindia.com/api/reports?archives=%5B%7B%22name%22%3A%22CM%20-%20Bhavcopy(csv)%22%2C%22type%22%3A%22archives%22%2C%22category%22%3A%22capital-market%22%2C%22section%22%3A%22equities%22%7D%5D&date={0:%d}-{0:%b}-{0:%Y}&type=equities&mode=single"}, "fuBhav": {"link": "https://www.nseindia.com/api/reports?archives=%5B%7B%22name%22%3A%22F%26O%20-%20Bhavcopy(csv)%22%2C%22type%22%3A%22archives%22%2C%22category%22%3A%22derivatives%22%2C%22section%22%3A%22equity%22%7D%5D&date={0:%d}-{0:%b}-{0:%Y}&type=equity&mode=single"}, "indall": {"link": "https://www.nseindia.com/api/reports?archives=%5B%7B%22name%22%3A%22Daily%20Snapshot%22%2C%22type%22%3A%22archives%22%2C%22category%22%3A%22capital-market%22%2C%22section%22%3A%22indices%22%7D%5D&date={0:%d}-{0:%b}-{0:%Y}&type=indices&mode=single"}, "version": {"link": "https://docs.google.com/document/export?format=txt&id=1B_QqPYNQvTPN817DkDxESOv9AgjxUnhTCPP7rXFZxr4&token=AC4w5Vg1I7eEt3MFysH9EMgsVKxd1bCb4w%3A1593185289693"}}, "INDICES": {"NIFTY": {"type": "checkbox", "value": "true"}, "JUNIOR": {"type": "checkbox", "value": "false"}, "BANKNIFTY": {"type": "checkbox", "value": "true"}, "NSE100": {"type": "checkbox", "value": "false"}, "NSEMIDCAP": {"type": "checkbox", "value": "false"}, "NSEIT": {"type": "checkbox", "value": "false"}, "NSE500": {"type": "checkbox", "value": "false"}, "NSEDEFTY": {"type": "checkbox", "value": "false"}, "MIDCAP50": {"type": "checkbox", "value": "false"}, "NSEESG": {"type": "checkbox", "value": "false"}, "NSESHARIAH": {"type": "checkbox", "value": "false"}, "SHARIAH500": {"type": "checkbox", "value": "false"}, "NSEINFRA": {"type": "checkbox", "value": "false"}, "NSEREALTY": {"type": "checkbox", "value": "false"}, "NSEENERGY": {"type": "checkbox", "value": "false"}, "NSEFMCG": {"type": "checkbox", "value": "false"}, "NSEMNC": {"type": "checkbox", "value": "false"}, "NSEPHARMA": {"type": "checkbox", "value": "false"}, "NSEPSE": {"type": "checkbox", "value": "false"}, "NSEPSUBANK": {"type": "checkbox", "value": "false"}, "NSESERVICE": {"type": "checkbox", "value": "false"}, "NSEAUTO": {"type": "checkbox", "value": "false"}, "NSEFINANCE": {"type": "checkbox", "value": "false"}, "NSEMETAL": {"type": "checkbox", "value": "false"}, "VIX": {"type": "checkbox", "value": "true"}, "NSE100LIQ15": {"type": "checkbox", "value": "false"}, "NSEDIVOPPS50": {"type": "checkbox", "value": "false"}, "NSEMEDIA": {"type": "checkbox", "value": "false"}, "NSECOMMODITIES": {"type": "checkbox", "value": "false"}, "NSECONSUMPTION": {"type": "checkbox", "value": "false"}, "NSEGSEC10": {"type": "checkbox", "value": "false"}, "NSEGSECBM": {"type": "checkbox", "value": "false"}, "NSEGSECBMCLEAN": {"type": "checkbox", "value": "false"}}, "index_map": {"CNX NIFTY": "NIFTY", "NIFTY 50": "NIFTY", "CNX NIFTY JUNIOR": "JUNIOR", "NIFTY NEXT 50": "JUNIOR", "CNX BANK": "BANKNIFTY", "BANK NIFTY": "BANKNIFTY", "NIFTY BANK": "BANKNIFTY", "CNX 100": "NSE100", "NIFTY 100": "NSE100", "CNX MIDCAP": "NSEMIDCAP", "NIFTY MIDCAP 100": "NSEMIDCAP", "CNX IT": "NSEIT", "NIFTY IT": "NSEIT", "CNX 500": "NSE500", "NIFTY 500": "NSE500", "CNX DEFTY": "NSEDEFTY", "NIFTY50 USD": "NSEDEFTY", "NIFTY MIDCAP 50": "MIDCAP50", "S&P ESG INDIA INDEX": "NSEESG", "CNX NIFTY SHARIAH": "NSESHARIAH", "NIFTY50 SHARIAH": "NSESHARIAH", "CNX 500 SHARIAH": "SHARIAH500", "NIFTY500 SHARIAH": "SHARIAH500", "CNX INFRA": "NSEINFRA", "NIFTY INFRA": "NSEINFRA", "CNX INFRASTRUCTURE": "NSEINFRA", "NIFTY INFRASTRUCTURE": "NSEINFRA", "CNX REALITY": "NSEREALTY", "NIFTY REALITY": "NSEREALTY", "CNX ENERGY": "NSEENERGY", "NIFTY ENERGY": "NSEENERGY", "CNX FMCG": "NSEFMCG", "NIFTY FMCG": "NSEFMCG", "CNX MNC": "NSEMNC", "NIFTY MNC": "NSEMNC", "CNX PHARMA": "NSEPHARMA", "NIFTY PHARMA": "NSEPHARMA", "CNX PSE": "NSEPSE", "NIFTY PSE": "NSEPSE", "CNX PSU BANK": "NSEPSUBANK", "NIFTY PSU BANK": "NSEPSUBANK", "CNX SERVICE": "NSESERVICE", "NIFTY SERV SECTOR": "NSESERVICE", "NIFTY SERVICES SECTOR": "NSESERVICE", "CNX AUTO": "NSEAUTO", "NIFTY AUTO": "NSEAUTO", "CNX FINANCE": "NSEFINANCE", "NIFTY FINANCE": "NSEFINANCE", "NIFTY FINANCIAL SERVICES": "NSEFINANCE", "CNX METAL": "NSEMETAL", "NIFTY METAL": "NSEMETAL", "INDIA VIX": "VIX", "LIX15": "NSE100LIQ15", "NIFTY100 LIQUID 15": "NSE100LIQ15", "CNX DIVIDEND OPPORTUNITIES": "NSEDIVOPPS50", "NIFTY DIVIDEND OPPORTUNITIES 50": "NSEDIVOPPS50", "CNX MEDIA": "NSEMEDIA", "NIFTY MEDIA": "NSEMEDIA", "CNX COMMODITIES": "NSECOMMODITIES", "NIFTY COMMODITIES": "NSECOMMODITIES", "CNX CONSUMPTION": "NSECONSUMPTION", "NIFTY CONSUMPTION": "NSECONSUMPTION", "NIFTY 8-13 YR G-SEC": "NSEGSEC10", "NIFTY 10 YR BENCHMARK G-SEC": "NSEGSECBM", "NIFTY 10 YR BENCHMARK G-SEC (CLEAN PRICE)": "NSEGSECBMCLEAN"}}
 

Attachments

#23
Just analyzed it, no problems in the configuration so far....
A bit puzzled with the issue

The last thing I can think of is --
Maybe try putting the exe in a folder whose name doesn't contain any spaces?
Spaces in path names on windows cause weird errors sometimes, I am not very optimistic about results, but worth a try
Also do not copy the generate_config.json in the new folder, let StockD use the default profile and create default folder structure if you try in a folder without spaces
 
Last edited:

trump

Well-Known Member
#24
Just analyzed it, no problems in the configuration so far....
A bit puzzled with the issue

The last thing I can think of is --
Maybe try putting the exe in a folder whose name doesn't contain any spaces?
Spaces in path names on windows cause weird errors sometimes, I am not very optimistic about results, but worth a try
Also do not copy the generate_config.json in the new folder, let StockD use the default profile and create default folder structure if you try in a folder without spaces
tried without success
 
#25
tried without success
I have created a verbose logging enabled exe on the github release page. The only difference between this one and the previous exe is that it has extensive logging and this version will save log inside stockd_debuglog.txt

If you could post/attach the log generated by this version, it'll be extremely helpful for me to analyse which lines of code are causing the problem
https://github.com/virresh/StockD/releases/download/4.3/StockD_Windows_debug.exe
 
#27
Hai Bro/s
Can we download MCX data too on this downloader?
This downloader can be used for Metastock ?
MCX is not yet supported. I'll add it in the future versions if someone can explain the fields required
(Most preferred way would be in an issue at http://github.com/virresh/StockD/issues/, but if someone explains it on Traderji then I'll handle the issue creation etc)

The output is a text file that can be imported into Metastock via downloader without any modifications
 

raty

New Member
#28
Not yet.
But if someone is willing to explain what data exactly is needed, I will add support for options data as well.
Hi Virresj ji,

thanks for considering to add options.
please consider the below:
1. the symbol data as per nse (options) is of the format optidx/optstk symbol expiry (dd-mmm-yyyy) strike ce/pe

2. data can be extracted as symbol strike ce/pe (expiry as m1/m2/m3 or w1/w2/w3 for nifty banknifty)

3. so symbol from the csv file OPTIDXBANKNIFTY27-AUG-2020CE23800 will be as BANKNIFTY23800CE-M1 (as 27-aug-2020 is the m1 expiry) and data column for current date, open, high, low, close, volume, openinterest, expiry date to be extracted from csv.

4. for index the last week of the month to be as monthly expiry options ( as the monthly m1 and weekly w1 option data will be same) or can duplicate as w1 and m1.
 

kaly422000

Well-Known Member
#29
the software as it is ok enough. let it pass 31 august to check that it is working as old nse site will be closed . option and other data can be added there after as i think. pls also if nseeodfixed can be continued after 31st august ,just a request
 

trump

Well-Known Member
#30
Dear Virresh,
have sent the error log file to your inbox, kindly check it out and let me know the issues. thank you