Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"After all the anxiety I had with my previous data provider it is a relief not to have to worry about data speed and integrity." - Comment from Eamonn
"Excellent datafeed !!!" - Comment from Arely
"I cannot believe what a difference it makes trading with ProphetX!" - Comment from Bruce in Los Angeles
"I've never had DTN go out on me since switching. ******* would go down a couple times every month when I was using them." - Comment from Bryce in AL.
"Thank you so much - awesome feed, awesome service!" - Comment from Greg via Email
"Everything is working amazing now. I'm already impressed with the true-tick feed of IQFeed and it's ability to support my 480 symbol layout." - Comment from Tyler via Email
"I just wanted to tell you what a fine job you have been doing. While *******, from what I hear, has been down and out, off and on, IQ feed has held like a champ this week." - Comment from Shirin
"Awesome response, as usual. It is a sincere and refreshing pleasure to do business with DTN, compared to your competition." - Comment from Ryan
"DTN has never given me problems. It is incredibly stable. In fact I've occasionally lost the data feed from Interactive Brokers, but still been able to trade because I'm getting good data from DTN." - Comment from Leighton
"I've been using Neoticker RT with IQFeed for two months, and I'm very happy with both of the products (I've had IQFeed for two years with very few complaints). The service from both companies is exceptional." - Comment from Public Forum
Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »Archive (2017 and earlier) »Data and Content Support »Data difference between real time & historical
Author Topic: Data difference between real time & historical (7 messages, Page 1 of 1)

cunparis
-Interested User-
Posts: 29
Joined: Jan 1, 2009


Posted: Sep 8, 2010 12:54 AM          Msg. 1 of 7
I've noticed that when I reload historical data, it can be very different than the data I've collected real time. This became apparent to me while using bid/ask data because a small difference in the data can make a big difference in the charts/indicators.

This morning I exported Euro overnight data and then I reloaded it. I'm using Market Delta & IQFeed for this. What I find when I compare the two is that there are extra trades in the real time data. Often they are very much invalid such as an extremely large size. This has a huge impact on any indicators using volume, especially those using the delta of bid/ask transactions.

I'm attaching an example.

This isn't an isolated case, it happens consistently all the time in the markets I follow (Euro, Crude, Dax, Bund). When I look at the differences, they start shortly after I last reloaded the historical data.

This example is from overnight. When the markets are open, there are even more differences. So much so that the bid/ask data is useless.

I am hoping there is a way to correct this problem so that I can use the footprint & delta indicators.

Thanks for your attention in this matter.



File Attached: data diff 1.png (downloaded 1744 times)

cunparis
-Interested User-
Posts: 29
Joined: Jan 1, 2009


Posted: Sep 8, 2010 01:33 AM          Msg. 2 of 7
Continuing my investigation, I now compare my data with tradestation (attached).

Tradestation has the "extra" trades in its time & sales. However they're marked as "below bid" and "filtered from chart". TS reports these trades at 1.2700.

I see a couple possibilities:

1 - IQFeed sends these trades real time as "below bid" and Market Delta interprets them as "at bid" (a mistake in my opinion).

2 - IQFeed sends these trades real time as "at bid" and Market Delta doesn't know anything.

Can someone from IQFeed tell me which is the case?

In both cases, it seems these trades are not present in the historical data.



File Attached: data diff 2 with tradestation.png (downloaded 1535 times)

cunparis
-Interested User-
Posts: 29
Joined: Jan 1, 2009


Posted: Sep 8, 2010 07:45 AM          Msg. 3 of 7
I found out that Market Delta will interpret a trade below bid as being at the bid. And a trade above the ask as being at the ask.

So it seems IQFeed is sending the correct data real time and then filtering these trades out for the historical data. Hopefully someone from IQFeed can confirm.

Stan S
-DTN Guru-
Posts: 256
Joined: Apr 13, 2006


Posted: Sep 8, 2010 11:17 AM          Msg. 4 of 7
Hi cunparis,

I am loooking into the difference. My first thought is they are trades removed by the exchange. But I want to confim that. I will let you know what I find out.

Stan S

What we do today, determines how people remember us forever.
Be the positive force in someone life.

Stan S
-DTN Guru-
Posts: 256
Joined: Apr 13, 2006


Posted: Sep 8, 2010 12:39 PM          Msg. 5 of 7
Hi Cunparis,

I just heard back from our Market Integrity dept.
They are implied trades that are recorded as the current value at the time of the trade message. These implied trade messages do not get stored in IQ history, however, that is why you are not seeing it when you recall the data.

Stan S

What we do today, determines how people remember us forever.
Be the positive force in someone life.

cunparis
-Interested User-
Posts: 29
Joined: Jan 1, 2009


Posted: Sep 8, 2010 12:58 PM          Msg. 6 of 7
Thanks for the quick response. I've never heard of this, can you explain more what it's about?

It sounds like it's up to the software to accept or ignore them. I know Tradestation ignores them for the charting. I'm hoping MarketDelta / Investor RT will do the same as it completely wrecks any volume analysis.

Stan S
-DTN Guru-
Posts: 256
Joined: Apr 13, 2006


Posted: Sep 8, 2010 01:47 PM          Msg. 7 of 7
Implied trades are part of the "Non qualifying last trades" Here is a defenition I got from Market Interity

Implied is a trade condition. Below is an explanation of how implied trades come about.

Implied IN spread orders derive from existing outright orders in individual legs. Implied OUT outright orders are derived from a combination of an existing spread order and an existing outright order in one of the individual underlying legs. Implied functionality fills in “holes” in the market. In other words, it allows both spreads and outright futures traders to participate in a specific contract where there would otherwise have been little or no available bids and asks. Such implied quotes are critical to building volume in new electronic markets like the NYMEX energy contracts.

Stan S

What we do today, determines how people remember us forever.
Be the positive force in someone life.
 

 

Time: Sun May 19, 2024 3:28 AM CFBB v1.2.0 10 ms.
© AderSoftware 2002-2003