Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"I cannot believe what a difference it makes trading with ProphetX!" - Comment from Bruce in Los Angeles
"The people at Nirvana have very nice things to say about your company and I can see why! Price and service is a potent combination." - Comment from Ed
"There is no doubt that IQFeed is the best data provider. I am very satisfied with your services. And IQFeed is the only one that I would recommend to my friends. Now, most of them are using your product in China." - Comment from Zhezhe
"After all the anxiety I had with my previous data provider it is a relief not to have to worry about data speed and integrity." - Comment from Eamonn
"Version 4.0.0.2 has been working well for me and I appreciate that it is now a much tighter client to work with. I feel I can go to press with my own application and rely on a stable platform" - Comment from David in IA.
"My broker in Davenport suggested I give you a try as he uses your service and says its the best." - Comment from Bill via RT Chat
"Just a quick one to say I'm very impressed so far :) The documentation for developers is excellent and I've quickly managed to get an app written to do historical downloads. The system is very robust and pretty quick considering the extent of data that's available. The support guys have been very helpful too, in combination with the forums it's been plain sailing so far!" - Comment from Adam
"Its working FABULOUSLY for me!! Holy cow...there has been so much I've been missing lately, and with this feed and Linnsoft software...I'm in the game now." - Comment from Chris R.
"I was with ******* for 4 years at $230 a month, this is a huge savings for me, GOD BLESS YOU PEOPLE," - Comment from T.S. via Email
"I use IQ Feed, Great stuff as far as data analysis information, storage and retrieval is concerned." - Comment from Public Forum
Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »Archive (2017 and earlier) »IQFeed 3rd Party Software Support »What is the best method to maintain a database of ticks for a collection of stocks?
Author Topic: What is the best method to maintain a database of ticks for a collection of stocks? (2 messages, Page 1 of 1)

smt52
-Interested User-
Posts: 31
Joined: Feb 23, 2009


Posted: Feb 23, 2009 08:48 AM          Msg. 1 of 2
Hi,

I'd like to maintain a historical database of tick data for stocks.

Can anybody suggest a method?

I would be open to any method that might require programming, such as a Ninja Trader solution.

I would also be open to any pre-packaged software that will take over the task of populating a database with tick data, in realtime, 365 days a year, 24 hours per day (actually, within trading hours).

Shane.

rbrodt
-Interested User-
Posts: 4
Joined: Oct 23, 2008

What color is an orange?


Posted: Mar 6, 2009 09:07 AM          Msg. 2 of 2
Since tick data is typically accessed sequentially (from start to end) instead of randomly (picking out a tick from the middle of at trading session) it makes sense to use a directory and file structure. One directory per trading instrument, and one file per trading session. To conserve space, we use a flyweight design pattern storing only the price and size offsets from an initial absolute price/size. So the tick file uses a "long" record that contains a timestamp, the LAST price and size, and volume, then subsequent ticks use a "short" record that contains a time offset from the previous record (in seconds), price offset (in "ticks" depending on the instrument) and a size offset. If the offsets are too large to fit into a "short" record, we write another "long" record. A day's worth of tick data is typically about 1Mb - small enough to be managed comfortably.
 

 

Time: Tue May 7, 2024 12:03 PM CFBB v1.2.0 12 ms.
© AderSoftware 2002-2003