Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"If you are serious about your trading I would not rely on IB data for serious daytrading. Took me a while to justify the cost of IQ Feed and in the end, it's just a 2 point stop on ES. Better safe than sorry" - Comment from Public Forum
"I've been using IQFeed 4 in a multi-threaded situation for the last week or two on 2600 symbols or so with 100 simultaneous daily charts, and I have had 100% responsiveness." - Comment from Scott
"This beats the pants off CQG, I am definitely switching to the ProphetX 3.0!" - Comment from Stephen
"I just wanted to let you know how fast and easy I found it to integrate IQFeed into our existing Java code using your JNI client. In my experience, such things almost never go so smoothly - great job!" - Comment from Nate
"I've never had DTN go out on me since switching. ******* would go down a couple times every month when I was using them." - Comment from Bryce in AL.
"Very impressed with the quality of your feed - ******* is a real donkey in comparison." - Comment from A.C. via Email
"Version 4.0.0.2 has been working well for me and I appreciate that it is now a much tighter client to work with. I feel I can go to press with my own application and rely on a stable platform" - Comment from David in IA.
"Thanks for the great product and support. During this week of high volume trading, my QuoteTracker + IQ Feed setup never missed a beat. Also, thanks for your swiftness in responding to data issues. I was on ******* for a few years before I made the switch over early this year, and wish I had done it a long time ago." - Comment from Ken
"After all the anxiety I had with my previous data provider it is a relief not to have to worry about data speed and integrity." - Comment from Eamonn
"Excellent datafeed !!!" - Comment from Arely
Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »IQFeed Developer »IQFeed Developer Support »Downloading Historical Intraday Future Ticks
Author Topic: Downloading Historical Intraday Future Ticks (4 messages, Page 1 of 1)

madman
-Interested User-
Posts: 2
Joined: Jul 16, 2020


Posted: Jul 16, 2020 11:37 PM          Msg. 1 of 4
Hey everyone,

I'm trying to download historical intraday CME futures tick data, but I'm running into issues when downloading the ticks.

I issue a request to download 1 day of data (July 1st), like so:
"HTT,@ESU20,20200701 000000,20200702 000000,,,,1\r\n"

Then I receive streaming tick data -- the data streams for a while, but hangs after I receive about 18,000 messages (or until about 02:17:00 on July 1st in the data stream).

Some questions:
1- is my request format correct?
2- should I be issuing smaller requests? (e.g: 15 minute chunks?)
3- any other tips or best practices when doing these downloads?

Cheers,
madman

DTN_Gary_Stephen
-DTN Evangelist-
Posts: 141
Joined: Jul 3, 2019


Posted: Jul 17, 2020 10:58 AM          Msg. 2 of 4
Hello, this is Gary with IQFeed API Support.

Your request is fine. You can request as much data as you want. It sounds like the data is queueing, which happens when IQFeed cannot send data that has been requested. In other words, IQFeed is sending data faster than your code is processing it, and the receive buffer is filling up. To monitor this, open Diagnostics/Client Stats tab, and observe the "KB Queued" column for the Lookup port during a request. You'll probably find that it starts low and slowly increases as data comes in.

How do you avoid this? Generally, DTN recommends using three different threads in your app: one to retrieve the data from the API, one to convert the information into the form you want, and a third thread to act on it (draw a chart, put it in a database, whatever your app does). Also: having multiple connections to the IQFeed, and having each connection retrieve part of the desired data, can improve performance.

I hope this helps! Let me know if you have any other questions or issues getting data from the API.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

madman
-Interested User-
Posts: 2
Joined: Jul 16, 2020


Posted: Jul 19, 2020 03:10 PM          Msg. 3 of 4
Hi Gary,

Thanks for the prompt and thorough response!

Good call: I checked the KB Queued column and saw the exact behavior you described. After tweaking my application with your tips, I can know maintain a KB Queued of 0 bytes.

Regards,
Greg

DTN_Gary_Stephen
-DTN Evangelist-
Posts: 141
Joined: Jul 3, 2019


Posted: Jul 20, 2020 07:58 AM          Msg. 4 of 4
Greg,

Excellent! I'm glad I could help.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist
 

 

Time: Tue September 29, 2020 9:28 AM CFBB v1.2.0 31 ms.
© AderSoftware 2002-2003