[ome-users] Problem with omero *downloads* from web

[Jake Carroll]

Unfortunately, I’ve just confirmed the same bug exists with the same configuration on a different platform. I tried on a fully patched CentOS 7.2 environment and the behaviour is identical. Files truncate and fail at 1.0x GB of download/stream over http/nginx.

Thanks.

-jc


>Date: Tue, 12 Jan 2016 13:51:02 +0000
>From: "Mason, David [dnmason]" <D.N.Mason at liverpool.ac.uk>
>To: "ome-users at lists.openmicroscopy.org.uk"
>	<ome-users at lists.openmicroscopy.org.uk>
>Subject: Re: [ome-users] Problem with omero *downloads* from web
>	client - nginx?
>Message-ID:
>	<F15D297020D9DC45B5F9473909B3655747AAAE6F at CHEXMBX1.livad.liv.ac.uk>
>Content-Type: text/plain; charset="us-ascii"
>
>I can confirm that I also get the same issue in our OMERO.web 5.2.0-ice35-b12 running Nginx + WSGI + gunicorn on Ubuntu 14.04 LTS. Download of a large original data file stalled at 1.01GB.
>
>We rarely download the original data so I'm not surprised to have not noticed since upgrading to 5.2.
>
>Best,
>
>Dave
>
>----------------------------------------------------------------------
>Message: 1
>Date: Mon, 11 Jan 2016 20:26:18 +0000
>From: Jake Carroll <jake.carroll at uq.edu.au>
>To: "ome-users at lists.openmicroscopy.org.uk"
>        <ome-users at lists.openmicroscopy.org.uk>
>Subject: [ome-users] Problem with omero *downloads* from web client -
>        nginx?
>Message-ID: <3521A17B-7735-4497-94CE-935360303C67 at uq.edu.au>
>Content-Type: text/plain; charset="utf-8"
>
>Hi OME crew.
>
>I?m in need of a little bit of your help.
>
>I?ve upgraded to 5.2.1 as of a while ago and things appeared fine on the surface, but now that everyone is back to work from the Christmas break, we?ve found a problem (and we believe it is nginx + gunicorn related).
>
>1. Large downloads simply fail or are truncated to smaller sizes. We keep seeming to hit a magical 1.01 or 1.1GB limit when trying to download large things via the OMERO.web interface. Insight works fine, as it is unrelated to nginx.
>
>2. We?re running the config from the OMERO 5.2.1 documentation, nginx-wise. Nginx + WSGI + gunicorn atop Ubuntu 14.04 LTS. All up to date.
>
>3. I?ve read things about gzip compression having an impact. Tried to turn that off. No difference. I?ve read proxy_max_temp_file_size might have an impact. Fiddled with that - no difference. Fiddled with timeouts on upstream server. No difference.
>
>4. I can?t see anything useful in the error.log or access.log for nginx, nor in the Blitz.log etc.
>
>5. When your users are downloading 30GB+ .ims files out of OMERO regularly, this could present a problem for us, as you can appreciated ;).
>
>Any help would be appreciated - as I?m stumped on this one. This is usually just normal administration 101 ?just tune this? setting sort of thing, which doesn?t present much of a challenge - but this feels like a ghost.
>
>Regards.
>
>-jc
>
>------------------------------
>
>Message: 2
>Date: Tue, 12 Jan 2016 16:17:23 +0000
>From: "Aleksandra Tarkowska (Staff)" <A.Tarkowska at dundee.ac.uk>
>To: OME User Support List <ome-users at lists.openmicroscopy.org.uk>
>Subject: Re: [ome-users] Problem with omero *downloads* from web
>	client - nginx?
>Message-ID: <C595C76B-8E9C-4A0E-884D-92859E50090F at dundee.ac.uk>
>Content-Type: text/plain; charset="us-ascii"
>
>Hi,
>
>Thank you for reporting download problems. I can reproduce it locally and will let you know as soon as I find work around.
>
>Ola
>Software Engineer
>Open Microscopy Environment
>University of Dundee
>
>On 12 Jan 2016, at 13:51, Mason, David [dnmason] <D.N.Mason at liverpool.ac.uk<mailto:D.N.Mason at liverpool.ac.uk>> wrote:
>
>I can confirm that I also get the same issue in our OMERO.web 5.2.0-ice35-b12 running Nginx + WSGI + gunicorn on Ubuntu 14.04 LTS. Download of a large original data file stalled at 1.01GB.
>
>We rarely download the original data so I'm not surprised to have not noticed since upgrading to 5.2.
>
>Best,
>
>Dave
>
>----------------------------------------------------------------------
>Message: 1
>Date: Mon, 11 Jan 2016 20:26:18 +0000
>From: Jake Carroll <jake.carroll at uq.edu.au<mailto:jake.carroll at uq.edu.au>>
>To: "ome-users at lists.openmicroscopy.org.uk<mailto:ome-users at lists.openmicroscopy.org.uk>"
>       <ome-users at lists.openmicroscopy.org.uk<mailto:ome-users at lists.openmicroscopy.org.uk>>
>Subject: [ome-users] Problem with omero *downloads* from web client -
>       nginx?
>Message-ID: <3521A17B-7735-4497-94CE-935360303C67 at uq.edu.au<mailto:3521A17B-7735-4497-94CE-935360303C67 at uq.edu.au>>
>Content-Type: text/plain; charset="utf-8"
>
>Hi OME crew.
>
>I?m in need of a little bit of your help.
>
>I?ve upgraded to 5.2.1 as of a while ago and things appeared fine on the surface, but now that everyone is back to work from the Christmas break, we?ve found a problem (and we believe it is nginx + gunicorn related).
>
>1. Large downloads simply fail or are truncated to smaller sizes. We keep seeming to hit a magical 1.01 or 1.1GB limit when trying to download large things via the OMERO.web interface. Insight works fine, as it is unrelated to nginx.
>
>2. We?re running the config from the OMERO 5.2.1 documentation, nginx-wise. Nginx + WSGI + gunicorn atop Ubuntu 14.04 LTS. All up to date.
>
>3. I?ve read things about gzip compression having an impact. Tried to turn that off. No difference. I?ve read proxy_max_temp_file_size might have an impact. Fiddled with that - no difference. Fiddled with timeouts on upstream server. No difference.
>
>4. I can?t see anything useful in the error.log or access.log for nginx, nor in the Blitz.log etc.
>
>5. When your users are downloading 30GB+ .ims files out of OMERO regularly, this could present a problem for us, as you can appreciated ;).
>
>Any help would be appreciated - as I?m stumped on this one. This is usually just normal administration 101 ?just tune this? setting sort of thing, which doesn?t present much of a challenge - but this feels like a ghost.
>
>Regards.
>
>-jc
>_______________________________________________
>ome-users mailing list
>ome-users at lists.openmicroscopy.org.uk<mailto:ome-users at lists.openmicroscopy.org.uk>
>http://lists.openmicroscopy.org.uk/mailman/listinfo/ome-users
>
>
>The University of Dundee is a registered Scottish Charity, No: SC015096
>-------------- next part --------------
>An HTML attachment was scrubbed...
>URL: <http://lists.openmicroscopy.org.uk/pipermail/ome-users/attachments/20160112/e950ee4a/attachment-0001.html>
>
>------------------------------
>
>Subject: Digest Footer
>
>_______________________________________________
>ome-users mailing list
>ome-users at lists.openmicroscopy.org.uk
>http://lists.openmicroscopy.org.uk/mailman/listinfo/ome-users
>
>
>------------------------------
>
>End of ome-users Digest, Vol 130, Issue 10
>******************************************