Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"If you are serious about your trading I would not rely on IB data for serious daytrading. Took me a while to justify the cost of IQ Feed and in the end, it's just a 2 point stop on ES. Better safe than sorry" - Comment from Public Forum
"I was on the phone with a friend who uses CQG and right after the Fed announcement, CQG was as much as 30 seconds behind DTN.IQ. Some quotes were off by as much as 15-18 cents. Your feed never missed a beat." - Comment from Roger
"Just a thank you for the very helpful and prompt assistance and services. You provided me with noticeably superior service in my setup compared to a couple of other options I had looked at." - Comment from John
"Thank you so much - awesome feed, awesome service!" - Comment from Greg via Email
"Version 4.0.0.2 has been working well for me and I appreciate that it is now a much tighter client to work with. I feel I can go to press with my own application and rely on a stable platform" - Comment from David in IA.
"Thanks for all of your help. Great customer service deserves to be recognized which one the reasons I've been a customer of DTN for over 10 years!" - Comment from Stuart
"I will tell others who want to go into trading that DTN ProphetX is an invaluable tool, I don't think anyone can trade without it..." - Comment from Luther
"You are much better than lawyers or the phone company because you answer the phone when I call! I just love your customer service." - Comment from Isreal
"IQFeed version 4 is a real screamer compared to anything else I have seen." - Comment from Tom
"With HUGE volume on AAPL and RIMM for 2 days, everyone in a trading room was whining about freezes, crashes and lag with *******, RealTick, TS and Cyber. InvestorRT with IQFeed was rock solid. I mean SOLID!" - Comment from Public IRC Chat
Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »Product Support »IQFeed Datafeed Wish List »How to synchronize ticks between history & watchlist without msec or any sequential id?
Author Topic: How to synchronize ticks between history & watchlist without msec or any sequential id? (4 messages, Page 1 of 1)

sasha
-Interested User-
Posts: 54
Joined: Jul 21, 2004


Posted: Aug 15, 2004 08:17 PM          Msg. 1 of 4
On TCPIP, it seems impossible to synchronize an intra-day tick history request and watchlist request.

Consider the problem of starting a new intra-day trade tick chart for symbol X after market open. It needs to display today's old ticks and subscribe to all new ticks.

This isn't a problem if you are subscribed before market open and have no crashes or network failures, etc...

Without IQFeed providing at least milliseconds on the Watchlist Update message, its impossible to know where the Watchlist tick messages begin and the Historical tick messages end.

Even then, with milliseconds its still a guess as there may or may not be duplicates at the historical->watchlist juncture.

Better still a proper sequential daily tick identifier on each message is required including the seconds and milliseconds.

The sequential daily tick identifier, starting at 0 for each day, sequentially orders all trades and quotes - either trades and quotes together (in the case of a single trade and quote stream or seperate trade and quote streams) or trades and quotes individually.

Each Watchlist tick (trade and quote) gets a sequential/unique id or counter for the day:
Q,0,MSFT,...HH:MM:SS:ZZZt,....
Q,1,MSFT,...HH:MM:SS:ZZZb,....
Q,2,MSFT,...HH:MM:SS:ZZZa,....

This sequential tick identifier is only a change to the message and doesn't change the API.

Another alternative could be to change the Watchlist API to optionally send historical/today's ticks in addition to updates so it sends all historical ticks and appends a snap/batch complete message before it sends updates for example. But I'm assuming changing the API is a lot more work.


In the problem case listed above, it would be more efficient to only send previous/today's trade ticks and not the previous/today's quotes when building the chart.

In other problem cases like recovery or specialized analytics for example I need to recover previous/today's quotes in addition to trades. But this is still useless without milliseconds and a sequential tick identifier! (at least in the current API the historical tick request will send trade and quote ticks in the same stream - I'm guessing in the order they arrived)

Maybe you could think about splitting historical trade and quote tick requests so they are optional in each request - either Trade or Quote or both. This way you could save on bandwidth at least for the problem case listed above. Then if you request trade or quotes seperately, using the sequential tick identifier you can still match them and order them correctly.

You could also apply this trade or quote or both optionality to the watchlist request. Using the sequential tick identifier we could piece them both back together if for example we want to save them to db for example or enable quotes and ticks half way through the day.


...But in the mean time, to get around this problem with the current API, I guess I have to subscribe to 500, 1300 or 15000+ symbols before market and subsequently waste many megabytes per minute of bandwidth and resources of the DTN servers. And then hope that my app, IQFeed, the PC, or the Internet don't crash.

Jay mentioned DTN are going to add seconds and hopefully milliseconds in the future.

sasha
-Interested User-
Posts: 54
Joined: Jul 21, 2004


Posted: Aug 17, 2004 09:12 PM          Msg. 2 of 4
Any comments or tips from DTN if this is wacked out, makes any sense and/or maybe how I can solve this please?

Unless we can work around this problem then I think its a worthy topic for discussion before the next release.

DTN_Tim_Russell
-IQ Server Developer-
Posts: 41
Joined: May 3, 2004

DTN Market Access, LLC.


Posted: Aug 18, 2004 09:47 AM          Msg. 3 of 4
Sasha,

We plan on adding the exchange's Tick Identifier to the historical data and the data feed. It's my understanding that this value is guaranteed to be greater than the last for each new tick.

We also plan on adding second resolution. With the tick identifier, though, I don't really see a need for millisecond resolution here. The exchanges don't transmit time with millisecond precision, and, taking propagation times between the exchanges and the end user into account, any millisecond value would be totally arbitrary and based only on system times here.

Tim Russell
Software Engineer
DTN IQ & FinWin

sasha
-Interested User-
Posts: 54
Joined: Jul 21, 2004


Posted: Aug 18, 2004 01:07 PM          Msg. 4 of 4
Great to hear Tim!

This will be very useful. Thank you.
 

 

Time: Mon August 8, 2022 2:44 AM CFBB v1.2.0 16 ms.
© AderSoftware 2002-2003