<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-GB" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Hi David,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">I have now repeated the problem, which is independent of using a Virtual Stack.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">The problem happens somewhere between 57GB and 95GB – for example, a 57GB file opens fine, but the 95GB file generates the following error message:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><img width="375" height="189" style="width:3.9062in;height:1.9687in" id="Picture_x0020_2" src="cid:image001.png@01D423FD.78CB8990"></span><span style="mso-fareast-language:EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">This is using the latest netCDF from
<a href="https://www.unidata.ucar.edu/downloads/netcdf/netcdf-java-4/index.jsp">https://www.unidata.ucar.edu/downloads/netcdf/netcdf-java-4/index.jsp</a>
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">How can I provide more information on how to troubleshoot this?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Many thanks!<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">James<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><b><span style="color:#1C2674">James Wainwright<o:p></o:p></span></b></p>
<p class="MsoNormal"><span style="color:#1C2674">Global Applications Specialist - Microscopy Systems<br>
<br>
<o:p></o:p></span></p>
<p class="MsoNormal"><b><span style="color:#1C2674">Tel: </span></b><span style="color:#1C2674">+44 (0) 2890 237 126 ext. 2130<o:p></o:p></span></p>
<p class="MsoNormal"><b><span style="color:#1C2674">Skype: </span></b><span style="color:#1C2674">andor.j.wainwright
<o:p></o:p></span></p>
<p class="MsoNormal"><b><span style="color:#1C2674">Mob: </span></b><span style="color:#1C2674">+44 (0) 7834 710 834<br>
<b>Web:</b> <a href="https://www.andor.com/microscopy-systems">https://www.andor.com/microscopy-systems</a><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif;color:#1F497D"><br>
</span><span style="font-family:"Times New Roman",serif;color:#1F497D"><img border="0" width="128" height="38" style="width:1.3333in;height:.3958in" id="Picture_x0020_1" src="cid:image002.jpg@01D423FD.78CB8990" alt="logo"></span><o:p></o:p></p>
</div>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US">From:</span></b><span lang="EN-US"> David Gault (Staff) [mailto:d.gault@dundee.ac.uk]
<br>
<b>Sent:</b> 23 July 2018 18:54<br>
<b>To:</b> OME User Support List <ome-users@lists.openmicroscopy.org.uk><br>
<b>Cc:</b> row_microscopy_support <row_microscopy_support@andor.com>; WILDE Geraint <g.wilde@andor.com>; WAINWRIGHT James <J.Wainwright@andor.com><br>
<b>Subject:</b> -|EXT|- Re: [ome-users] Ticket ID: 001-00-019862__Issue importing large Multi-point scans into Fiji___Doesn't occur on smaller datasets<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Hi James, <o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">In the Bio-Formats importer options there is a section labelled "Memory management”, from this if you select the option “Use Virtual Stack” then it will load each frame as required rather than reading the entire file at once.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">With Thanks,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">David Gault<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">On 23 Jul 2018, at 15:15, WAINWRIGHT James <<a href="mailto:J.Wainwright@ANDOR.COM">J.Wainwright@ANDOR.COM</a>> wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">Just to add that these are IMS files and that we have “patched” FIJI with the latest netCDF file with the jar from here:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><a href="https://www.unidata.ucar.edu/downloads/netcdf/netcdf-java-4/index.jsp"><span style="color:#954F72">https://www.unidata.ucar.edu/downloads/netcdf/netcdf-java-4/index.jsp</span></a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">James<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"><b><span style="color:#1C2674">James Wainwright</span></b><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:#1C2674">Global Applications Specialist - Microscopy Systems<br>
<br>
<br>
</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><b><span style="color:#1C2674">Tel: <span class="apple-converted-space"> </span></span></b><span style="color:#1C2674">+44 (0) 2890 237 126 ext. 2130</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><b><span style="color:#1C2674">Skype: <span class="apple-converted-space"> </span></span></b><span style="color:#1C2674">andor.j.wainwright</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><b><span style="color:#1C2674">Mob: <span class="apple-converted-space"> </span></span></b><span style="color:#1C2674">+44 (0) 7834 710 834<br>
<b>Web:</b> <span class="apple-converted-space"> </span><a href="https://www.andor.com/microscopy-systems">https://www.andor.com/microscopy-systems</a></span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif;color:#1F497D"><br>
</span><span style="font-family:"Times New Roman",serif;color:#1F497D"><image002.jpg></span><o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<div>
<p class="MsoNormal"><b><span lang="EN-US">From:</span></b><span class="apple-converted-space"><span lang="EN-US"> </span></span><span lang="EN-US">row_microscopy_support<span class="apple-converted-space"> </span><br>
<b>Sent:</b><span class="apple-converted-space"> </span>23 July 2018 15:05<br>
<b>To:</b><span class="apple-converted-space"> </span><a href="mailto:ome-users@lists.openmicroscopy.org.uk"><span style="color:#954F72">ome-users@lists.openmicroscopy.org.uk</span></a><br>
<b>Cc:</b><span class="apple-converted-space"> </span>row_microscopy_support <<a href="mailto:row_microscopy_support@andor.com"><span style="color:#954F72">row_microscopy_support@andor.com</span></a>>; WILDE Geraint <<a href="mailto:g.wilde@andor.com"><span style="color:#954F72">g.wilde@andor.com</span></a>>;
WAINWRIGHT James <<a href="mailto:J.Wainwright@andor.com"><span style="color:#954F72">J.Wainwright@andor.com</span></a>><br>
<b>Subject:</b><span class="apple-converted-space"> </span>Ticket ID: 001-00-019862__Issue importing large Multi-point scans into Fiji___Doesn't occur on smaller datasets</span><o:p></o:p></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Hi,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">We have a customer in Australia that is acquiring large Multi-point datasets. Can be upwards of 500GB data sets each time.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">They capture full Frame, no Binning (1024x1024 pixels), dual channel ( 2 simultaneous cameras acquiring) and 60-100 Z planes on multiple X/Y positions in an overnight (timelapse) protocol. These files can be upwards of 80Gb per XY position.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">The problem they have is when they try and import these large data sets to FIJI it fails, however if they perform a similar experiment, only smaller in size there is no issue.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">After asking the customer to perform a couple of tests for us, this is what they discovered:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">“<b><i>Definitely looks to be a file size issue. Tried the smaller 1.5Gb files yesterday and it worked fine. Did a longer experiment (same experimental setup just with more z-slices and more time points so the file was around 60Gb and
these are failing. The only other difference was that the small files that worked had been captured using two channel sequential while the large files that don’t work were captured with dual channel simultaneous capture.”</i></b><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Any advice/workaround you can supply for handling these larger datasets would be appreciated.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Best,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><b>Phil Mullan</b><br>
Product Support Engineer (Microscopy Systems)<br>
Europe, Middle East & Africa<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><b>Tel:<span class="apple-converted-space"> </span></b>+44 (0) 28 9023 7126<span class="apple-converted-space"> </span><b>Ext.<span class="apple-converted-space"> </span></b>2732<br>
<b>Fax:<span class="apple-converted-space"> </span></b>+44 (0) 28 9031 0792<span class="apple-converted-space"> </span><br>
<b>Web:</b> <span class="apple-converted-space"> </span><a href="http://www.andor.com/" target="_blank">andor.com/support</a><span class="apple-converted-space"> </span><br>
<br>
<image003.jpg><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif">___________________________________________________________________________<br>
This e-mail is confidential and is for the addressee only. Please refer to<span class="apple-converted-space"> </span><br>
</span><a href="http://www.oxinst.com/email-statement"><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif;color:#954F72">www.oxinst.com/email-statement</span></a><span class="apple-converted-space"><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif"> </span></span><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif">for
regulatory information. _______________________________________________<br>
ome-users mailing list<br>
</span><a href="mailto:ome-users@lists.openmicroscopy.org.uk"><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif;color:#954F72">ome-users@lists.openmicroscopy.org.uk</span></a><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif"><br>
</span><a href="http://lists.openmicroscopy.org.uk/mailman/listinfo/ome-users"><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif;color:#954F72">http://lists.openmicroscopy.org.uk/mailman/listinfo/ome-users</span></a><o:p></o:p></p>
</div>
</blockquote>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal"><br>
<span style="font-size:10.0pt">The University of Dundee is a registered Scottish Charity, No: SC015096</span>
<o:p></o:p></p>
</div>
___________________________________________________________________________<br>
This e-mail is confidential and is for the addressee only. Please refer to <br>
<a href="http://www.oxinst.com/email-statement">www.oxinst.com/email-statement</a> for regulatory information.
</body>
</html>