Question on ... Custom trading software dev & data feed

#1
Hello friends,

I am developing a minor analysis platform more suited for individual investors with JAVA. Till now this is used for US market and pulls data, allows some analysis as well as prints reports etc. I am now customizing it for India market and I have few basic questions.

1. In US maket, all stock symbols have a universal ticker symbol irrespective of exchange, where as BSE and NSE have their own symbols and their own symbol changes. So, as there is no unique way to identify this, how do you incorporate it in your design an how do you automate successive name/symbol changes/updates?

2. Here I am paying 220$/yr (CIPRO database) and getting last 10-15 years of fundamental data and historic data. I can query this data thru software and load it in my server as well, and these data is almost error proof. Is there something similar in India?

Anybody working on his own software? Or even building his own historic/fundamental databse? So they would understand my frustration and search of the unique key...

thanks and all comments are welcome,
Deepak.
 

SavantGarde

Well-Known Member
#2
Hi Deepak,

While It Is True That NSE & BSE Have Their Respective Symbolsets... It Is Important To Understand.....

a) Most...Almost All Of NSE Is Listed On BSE
b) The Ones From BSE That Aren't Listed On NSE Is For A Primary Reason Of Not Meeting Listing Norms Of NSE

Suggestion: To Use NSE Database

Going Forward We May Have Single Ticker Symbol Like You Have In U.S.... Considering There Are Few More Exchanges In The Pipeline

EOD Database Is Available Free From Respective Exchanges.

Historical Fundamental Database Should Also Be Available For Free.

Personally, It Is Convenient To Have Only NSE Database... Considering My Trading Activity Is In Derivatives Segment Only.

Considering I Have No Programming Skills, Had A Software Professionally Developed On VS FoxPro Platform.... So Far It Has Served Me Well, Although Have A Few Changes In Mind...Which Probably Will Get Incorporated In The Next Revision 5.0

There Are Lots Of Whizkids In The Forum Developing Something Or The Other All The Time....You May Find It Interesting To Browse Through Various Sections.


Happy & Safer Investing

SavantGarde

P.S.: Since I Read Your Introduction...Might As Well Tell You That I Hold 400 AAPL @ 32.16.... It Was At A Time... No Funds Were Willing To Commit Money To AAPL & They All Dismissed It As A One Product Wonder.


Hello friends,

I am developing a minor analysis platform more suited for individual investors with JAVA. Till now this is used for US market and pulls data, allows some analysis as well as prints reports etc. I am now customizing it for India market and I have few basic questions.

1. In US maket, all stock symbols have a universal ticker symbol irrespective of exchange, where as BSE and NSE have their own symbols and their own symbol changes. So, as there is no unique way to identify this, how do you incorporate it in your design an how do you automate successive name/symbol changes/updates?

2. Here I am paying 220$/yr (CIPRO database) and getting last 10-15 years of fundamental data and historic data. I can query this data thru software and load it in my server as well, and these data is almost error proof. Is there something similar in India?

Anybody working on his own software? Or even building his own historic/fundamental databse? So they would understand my frustration and search of the unique key...

thanks and all comments are welcome,
Deepak.
 
#3
Re: JAVA Tech Whizkids ... Custom trading software dev & data feed

Hi SavantGarde,

I was initially thinking about the NSE, but NSE has only 1300~1700 symbols, & I didn't want the lost opportunity issue. So going for both. Also the second reason is I am scrapping the multitudes of web sites for fundamental data and some of these take BSE id only OR their own ids, like moneycontrol id. This makes my job difficult.

Till we have few vendors offering queriable database (talked to the the two most popular ones, capitaline & the other one is prowess?), both are for single user direct user interaction, not something that can be SQL queriable thru software. Mine is for personal use but down the line plan for public consumption.

The other issue is how do you keep your data up-to-date with the so many things happening thru the corp-action and company symbol/name/isin changes? Even BSE & NSE have some company names wrong!!! I am thinking about a auto updation script, but not going anywhere on which data point to get and the logic as well. Are there few standard/stable links that user can pull historic data, & split/bonus data periodically so that I can build a script to do so?

I have read your replies and have a hunch that you are much more than what you get the credit for!!! The AAPL just shows that. I have gone in on and off with AAPL but could not hold it due to noise. My biggest ones are UNH from 2003 thru 2007 and the India Funds IFN/IIF/MINDX.

Appreciate the humble response.

Anybody else pulling his hair over the data source issue and schema issue???
Can anybody share their database schema (just schema only, not the data :) )

--Deepak
 

SavantGarde

Well-Known Member
#4
Re: JAVA Tech Whizkids ... Custom trading software dev & data feed

Hi Deepak,

Hi SavantGarde,

I was initially thinking about the NSE, but NSE has only 1300~1700 symbols, & I didn't want the lost opportunity issue. So going for both. Also the second reason is I am scrapping the multitudes of web sites for fundamental data and some of these take BSE id only OR their own ids, like moneycontrol id. This makes my job difficult.

NSE Has 2800+ Symbols & If I Come Across Anything Regarding Fundamental Data Will Let You Know.

Till we have few vendors offering queriable database (talked to the the two most popular ones, capitaline & the other one is prowess?), both are for single user direct user interaction, not something that can be SQL queriable thru software. Mine is for personal use but down the line plan for public consumption.
If Thinking Of Building One... Check stockfetcher.com, There Charting & Data Is Built With Flex

The other issue is how do you keep your data up-to-date with the so many things happening thru the corp-action and company symbol/name/isin changes? Even BSE & NSE have some company names wrong!!! I am thinking about a auto updation script, but not going anywhere on which data point to get and the logic as well. Are there few standard/stable links that user can pull historic data, & split/bonus data periodically so that I can build a script to do so?
My Data Is Updated From NSE BHavcopy In .dbf, Split & Bonus Is Updated Manually

I have read your replies and have a hunch that you are much more than what you get the credit for!!! The AAPL just shows that. I have gone in on and off with AAPL but could not hold it due to noise. My biggest ones are UNH from 2003 thru 2007 and the India Funds IFN/IIF/MINDX.
Haven't Made TJ As Second Home Looking For Any Sort Of Credit...
It Was Just On The Belief... That Solution To Most Problems Are Usually Simple & Almost At The Tip Our Nose...While Much Of The Time & Resources Are Spent Searching Far & Wide

Usually A Simple Solution Is Not Adopted Easily Especially If It Is Free, Therefore Have Had To Spend Many Years Trying To Prove The Same.

Also With Reading Between The Lines of Dissemination Spewing Constantly From Various Business Channels... At The Moment, They Are Trying Hard To To Convince Us That Double Dip Is Almost Inevitable....Then They Have Idiots Like Nouriel Roubini Come & Paint A Grimmer Picture Of What Is To Follow....Then The So Called Experts On Financials, Meredith Whitney Who Has Started Her Enterprise To Lend Some Credence...Presently She Is Only Voicing Sentiments Of The Highest Bidder....Considering She Has Gained Some Credence From Predictions While At Oppenheimer....Even Alan Greenspan Is Guilty Of Lending His Voice For Money..... This Can Turn Into An Unending Monolgue......

By The Way What An Operation It Was With GM Filing For Bankruptcy
& Here They Are Back With IPO...Within 8 Months......... Job Well Executed....:)


Appreciate the humble response.
Thank You For Your Kind Words....!!!

Anybody else pulling his hair over the data source issue and schema issue???
Can anybody share their database schema (just schema only, not the data :) )
Afraid...Can't Be Of Much Help In This Area...Perhaps Some Whizkid Will Jump In & Offer Something Useful.

Happy & Safer Investing

SavantGarde
 

Similar threads