Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"You are much better than lawyers or the phone company because you answer the phone when I call! I just love your customer service." - Comment from Isreal
"I have been using IQFeed now for a few years in MultiCharts and I have zero complaints. Very, very rare to have any data hiccups or anything at all go wrong." - Comment from Public Forum
"Can I get another account from you? I am tired of ******* going down so often" - Comment from George
"If you want customer service that answers the phone, your best bet is IQFeed. I cannot stop praising them or their technical support. They are always there for you, and they are quick. I have used ****** too but the best value is IQFeed." - Comment from Public Forum
"IQ feed is brilliant. The support is mind-bending. What service!" - Comment from Public Forum Post
"I have to tell you though that using the IQFeed API is about the easiest and cleanest I have seen for some time." - Comment from Jim
"I'm satisfied with IQFeed. It's the most reliable and fastest quote feed I have ever used. Although I'm a resident in China, it's still very fast!" - Comment from Xiaofei
"I cannot believe what a difference it makes trading with ProphetX!" - Comment from Bruce in Los Angeles
"If someone needs the best quality data and backfill beyond what their broker provides at a rate that is the best in the industry, I highly recommend IQFeed." - Comment from Josh via Public Forum
"You have an excellent feed. Very few spikes for Spot Forex." - Comment from Public Forum Post
Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »Archive (2017 and earlier) »IQFeed Developer Support »Market snapshot error on EDS / 5MS command
Author Topic: Market snapshot error on EDS / 5MS command (11 messages, Page 1 of 1)

Larry jag
-Interested User-
Posts: 31
Joined: Dec 28, 2015


Posted: Sep 19, 2019 09:31 PM          Msg. 1 of 11
I am testing out this command:

EDS,2,14,20190919,EDS_TODAY

And recieve this from the server (at 20:27 EDT)

EDS_TODAY,E,Incomplete file from server. 534364/23476219,
EDS_TODAY,!ENDMSG!,
EDS_TODAY,!ENDMSG!,

Not sure why the file is incomplete so late at night. Also, i am seeing TWO !endmsg!

I see the same error with the 5MS command at the same time period:

5MS,2,14,5MS_10_2_14_20190919
5MS_10_2_14_20190919,E,Incomplete file from server. 534364/23391401,
5MS_10_2_14_20190919,!ENDMSG!,
5MS_10_2_14_20190919,!ENDMSG!,

5MS,2,14,5MS_10_2_14_20190919
5MS_10_2_14_20190919,E,Incomplete file from server. 534364/23391401,
5MS_10_2_14_20190919,!ENDMSG!,
5MS_10_2_14_20190919,!ENDMSG!,

DTN_Gary_Stephen
-DTN Guru-
Posts: 394
Joined: Jul 3, 2019


Posted: Sep 20, 2019 10:26 AM          Msg. 2 of 11
Larry,

I will begin looking into this now. I was just able to run that command with no difficulties, so this may be a time-of-day thing.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

Larry jag
-Interested User-
Posts: 31
Joined: Dec 28, 2015


Posted: Sep 20, 2019 02:02 PM          Msg. 3 of 11
Update: I just saw this error in the DAY @ 13:15:46 EDT.

[lastMsg=5MS,2,14,5MS_10_2_14_20190920]

13:15:46.744 [nioEventLoopGroup-2-2] msg=5MS_10_2_14_20190920,E,Incomplete file from server. 534364/23566744,,

Larry jag
-Interested User-
Posts: 31
Joined: Dec 28, 2015


Posted: Sep 23, 2019 11:42 AM          Msg. 4 of 11
Hi Gary. Any updates on this?

Larry jag
-Interested User-
Posts: 31
Joined: Dec 28, 2015


Posted: Sep 30, 2019 09:48 PM          Msg. 5 of 11
Any updates?

DTN_Gary_Stephen
-DTN Guru-
Posts: 394
Joined: Jul 3, 2019


Posted: Oct 1, 2019 04:27 PM          Msg. 6 of 11
Larry,

I haven't been able to reproduce this behavior, and I'm not aware of any other reports of it. What I'd like you to do, if possible, is create a log file. In the Diagnostics app, go to the Logging tab, check Lookup Error in the Lookups section, and Save Changes. If this happens again, go to the same place and click Open Logfile to collect the file. You can send it to me at developer@iqfeed.net for investigation.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

altmany
-Interested User-
Posts: 73
Joined: Jul 30, 2018

IQML - IQFeed-MATLAB connector


Posted: Dec 21, 2019 10:00 AM          Msg. 7 of 11
Another report of this problem: http://forums.dtn.com/index.cfm?page=topic&topicID=5678

I have also gotten an unrelated independent report on this exact same problem for NASDAQ summary data.

It seems to be a problem that multiple people who use multiple different platforms have experienced. Please look into this matter.

Yair Altman
IQML - IQFeed-MATLAB connector
https://UndocumentedMatlab.com/IQML

I am not a DTN employee; my post reflects my personal opinion

John Jones
-Interested User-
Posts: 6
Joined: Dec 20, 2019


Posted: Jan 6, 2020 01:36 PM          Msg. 8 of 11
I logged the error and sent it to developer@iqfeed.net. I am also willing to provide some simple c++ code to demonstrate the issue if necessary. Hopefully this will lead to a diagnosis and solution.

John Jones
-Interested User-
Posts: 6
Joined: Dec 20, 2019


Posted: Jan 6, 2020 04:57 PM          Msg. 9 of 11
This may be a clue: I modified my code to not stop after the NASDAQ Market Summary fails. The application now goes ahead and attempts to download the OPERA Market Summary file. Both resulted in "E,Incomplete file from server. [received]/[expected]. In both cases, the received number was 525628, and the expected number was different.

So perhaps the received number being the same could lead to a cause. Fingers crossed.

DTN_Gary_Stephen
-DTN Guru-
Posts: 394
Joined: Jul 3, 2019


Posted: Jan 7, 2020 02:06 PM          Msg. 10 of 11
All,

We've had a handful of reports of this issue now, and I'm getting an official ticket raised to the development team. My notes about the issue so far:

- This behavior has been very rare. But when it does happen, it can be reproduced.
- So far, only attempts to retrieve the NASDAQ and OPERA exchanges seem to be affected.
- Both 5MS and EDS commands are affected.
- Each time it is reproduced, the number of bits of the failed file is the exactly same (varying slightly by the day it happens and/or exchange). This suggests a corrupt file-type problem as opposed to a connection problem.
- Wine log shows nothing out of the ordinary. All functions appear to work normally until failure point.
- IQFeed log shows an immediate (within 6 seconds) response of 1,E,Incomplete file from server.
- Which means that IQFeed isn't reading through the file, and then reaching a failure point. If so the parts of the file up to the failure point would be in the log.
- Oddly, this Incomplete File From Server message is sent twice, which parallels the report that !END_MSG! appears twice.
- Do not suspect a server issue. In reviewing our logs, affected users connected to a large number of different servers in our load balancing pool.
- I had an affected user (John Jones) see if a basic telnet connection would reproduce the problem. It did. So the issue seems linked to hardware or connection, not the program being run.

If there are any other observations, please add them to this thread. Due to the rarity of the problem, we may not have uncovered everything yet, and any examples will be helpful to have.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

John Jones
-Interested User-
Posts: 6
Joined: Dec 20, 2019


Posted: Jan 7, 2020 03:21 PM          Msg. 11 of 11
In my case, it may be caused by virtualization. I am using Ubuntu 18.04 with a basic installation of wine. I have also tested Windows 10 running in VMWare Workstation 15 Player. Both environments fail with the "Incomplete file from server".

I then attempted the same on a Windows 10 machine (no virtualization) and was not able to reproduce the problem.

Returning to my Ubuntu machine, both "virtual" environments continue to fail. I am happy to help with any other testing you wish me to perform.
 

 

Time: Sun April 28, 2024 10:57 AM CFBB v1.2.0 11 ms.
© AderSoftware 2002-2003