[Vortex] Vortex dropping connections.

[Mark Kane]

Hi,

We're at a critical phase right now and I'm having a problem with vortex dropping the connection between clients. I've had this happen with versions. 1.0.10, 1.0.12 and I've downloaded the latest 1.0 source and built it so I can get some logging information.

Basically, here's what happens. I have two connected machines, one is sending small packets to the other at a rate of several per second. After a short time (sometimes a few seconds, other times a few minutes depending on how I start them) The connection closes for the following reason:

Ignore the actual numbers, they are from different occurrences of the problem.

On the receiving machine, I get a message like the following:

vortex-channel: Received a rpy request for message 89783912 while already waiting to reply to 89783864, storing and unlocking caller for later deliver
vortex-channel: found pending reply=88735336 to be sent on channel=88735288

On the machine sending the data,  I get a log message like the following:

vortex-reader: expected seq no 81067744 for channel wasn't found, received 81067696

The sending machine closes the connection due to this in the following code:

line 432 in vortex_reader.c

if (vortex_channel_get_next_expected_seq_no (channel) != vortex_frame_get_seqno (frame)) 

    _vortex_connection_set_not_connected (connection, "expected seq no number for channel wan't found");.

If I wait until both machines are connected and then initiate the sending sequence, it takes a bit longer to hit this. If I have the sending machine blasting away as soon as the connection is available, it happens more quickly.

Note that I am not doing anything with the data in the receiving machine's channel_frame_received handler, I immediately just call vortex_channel_send_rpyv with a simple text reply.

Also, I'm only sending a simple text string over and over instead of our normal binary packets.

I hope someone can help with this, I'm at the end of my rope and considering writing my own network classes.

Thanks,

- Mark



_________________________________________________________________

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.aspl.es/pipermail/vortex/attachments/20080131/2d223dd7/attachment.htm