<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
Hi James,
<div class=""><br class="">
</div>
<div class="">In the Bio-Formats importer options there is a section labelled "Memory management”, from this if you select the option “Use Virtual Stack” then it will load each frame as required rather than reading the entire file at once.</div>
<div class=""><br class="">
</div>
<div class="">With Thanks,</div>
<div class="">David Gault</div>
<div class=""><br class="">
<div>
<blockquote type="cite" class="">
<div class="">On 23 Jul 2018, at 15:15, WAINWRIGHT James <<a href="mailto:J.Wainwright@ANDOR.COM" class="">J.Wainwright@ANDOR.COM</a>> wrote:</div>
<br class="Apple-interchange-newline">
<div class="">
<div class="WordSection1" style="page: WordSection1; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;">
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
Just to add that these are IMS files and that we have “patched” FIJI with the latest netCDF file with the jar from here:<o:p class=""></o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<a href="https://www.unidata.ucar.edu/downloads/netcdf/netcdf-java-4/index.jsp" style="color: rgb(149, 79, 114); text-decoration: underline;" class="">https://www.unidata.ucar.edu/downloads/netcdf/netcdf-java-4/index.jsp</a><o:p class=""></o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
James<o:p class=""></o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
<div class="">
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<b class=""><span style="color: rgb(28, 38, 116);" class="">James Wainwright<o:p class=""></o:p></span></b></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span style="color: rgb(28, 38, 116);" class="">Global Applications Specialist - Microscopy Systems<br class="">
<br class="">
<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<b class=""><span style="color: rgb(28, 38, 116);" class="">Tel: <span class="Apple-converted-space"> </span></span></b><span style="color: rgb(28, 38, 116);" class="">+44 (0) 2890 237 126 ext. 2130<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<b class=""><span style="color: rgb(28, 38, 116);" class="">Skype: <span class="Apple-converted-space"> </span></span></b><span style="color: rgb(28, 38, 116);" class="">andor.j.wainwright<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<b class=""><span style="color: rgb(28, 38, 116);" class="">Mob: <span class="Apple-converted-space"> </span></span></b><span style="color: rgb(28, 38, 116);" class="">+44 (0) 7834 710 834<br class="">
<b class="">Web:</b> <span class="Apple-converted-space"> </span><a href="https://www.andor.com/microscopy-systems" style="color: rgb(149, 79, 114); text-decoration: underline;" class=""><span style="color: blue;" class="">https://www.andor.com/microscopy-systems</span></a><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span style="font-family: Arial, sans-serif; color: rgb(31, 73, 125);" class=""><br class="">
</span><span style="font-family: 'Times New Roman', serif; color: rgb(31, 73, 125);" class=""><image002.jpg></span><span class=""><o:p class=""></o:p></span></div>
</div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
<div class="">
<div style="border-style: solid none none; border-top-color: rgb(225, 225, 225); border-top-width: 1pt; padding: 3pt 0cm 0cm;" class="">
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<b class=""><span lang="EN-US" class="">From:</span></b><span lang="EN-US" class=""><span class="Apple-converted-space"> </span>row_microscopy_support<span class="Apple-converted-space"> </span><br class="">
<b class="">Sent:</b><span class="Apple-converted-space"> </span>23 July 2018 15:05<br class="">
<b class="">To:</b><span class="Apple-converted-space"> </span><a href="mailto:ome-users@lists.openmicroscopy.org.uk" style="color: rgb(149, 79, 114); text-decoration: underline;" class="">ome-users@lists.openmicroscopy.org.uk</a><br class="">
<b class="">Cc:</b><span class="Apple-converted-space"> </span>row_microscopy_support <<a href="mailto:row_microscopy_support@andor.com" style="color: rgb(149, 79, 114); text-decoration: underline;" class="">row_microscopy_support@andor.com</a>>; WILDE Geraint
<<a href="mailto:g.wilde@andor.com" style="color: rgb(149, 79, 114); text-decoration: underline;" class="">g.wilde@andor.com</a>>; WAINWRIGHT James <<a href="mailto:J.Wainwright@andor.com" style="color: rgb(149, 79, 114); text-decoration: underline;" class="">J.Wainwright@andor.com</a>><br class="">
<b class="">Subject:</b><span class="Apple-converted-space"> </span>Ticket ID: 001-00-019862__Issue importing large Multi-point scans into Fiji___Doesn't occur on smaller datasets<o:p class=""></o:p></span></div>
</div>
</div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
Hi,<o:p class=""></o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
We have a customer in Australia that is acquiring large Multi-point datasets. Can be upwards of 500GB data sets each time.<o:p class=""></o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
They capture full Frame, no Binning (1024x1024 pixels), dual channel ( 2 simultaneous cameras acquiring) and 60-100 Z planes on multiple X/Y positions in an overnight (timelapse) protocol. These files can be upwards of 80Gb per XY position.<o:p class=""></o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
The problem they have is when they try and import these large data sets to FIJI it fails, however if they perform a similar experiment, only smaller in size there is no issue.<o:p class=""></o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
After asking the customer to perform a couple of tests for us, this is what they discovered:<o:p class=""></o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
“<b class=""><i class="">Definitely looks to be a file size issue. Tried the smaller 1.5Gb files yesterday and it worked fine. Did a longer experiment (same experimental setup just with more z-slices and more time points so the file was around 60Gb and these
are failing. The only other difference was that the small files that worked had been captured using two channel sequential while the large files that don’t work were captured with dual channel simultaneous capture.”<o:p class=""></o:p></i></b></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
Any advice/workaround you can supply for handling these larger datasets would be appreciated.<o:p class=""></o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span class="">Best,<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span class=""> </span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<b class="">Phil Mullan</b><span class=""><br class="">
Product Support Engineer (Microscopy Systems)<br class="">
Europe, Middle East & Africa<o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<b class=""><span class="">Tel:<span class="Apple-converted-space"> </span></span></b><span class="">+44 (0) 28 9023 7126<span class="Apple-converted-space"> </span><b class="">Ext.<span class="Apple-converted-space"> </span></b>2732<br class="">
<b class="">Fax:<span class="Apple-converted-space"> </span></b>+44 (0) 28 9031 0792<span class="Apple-converted-space"> </span><br class="">
<b class="">Web:</b> <span class="Apple-converted-space"> </span><a href="http://www.andor.com/" target="_blank" style="color: rgb(149, 79, 114); text-decoration: underline;" class=""><span style="color: blue;" class="">andor.com/support</span></a><span class="Apple-converted-space"> </span><br class="">
<br class="">
<span id="cid:image003.jpg@01D42297.F0671300"><image003.jpg></span><o:p class=""></o:p></span></div>
<div style="margin: 0cm 0cm 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
</div>
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">___________________________________________________________________________</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">This
e-mail is confidential and is for the addressee only. Please refer to<span class="Apple-converted-space"> </span></span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<a href="http://www.oxinst.com/email-statement" style="color: rgb(149, 79, 114); text-decoration: underline; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">www.oxinst.com/email-statement</a><span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class=""><span class="Apple-converted-space"> </span>for
regulatory information. _______________________________________________</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<span style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; float: none; display: inline !important;" class="">ome-users
mailing list</span><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<a href="mailto:ome-users@lists.openmicroscopy.org.uk" style="color: rgb(149, 79, 114); text-decoration: underline; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">ome-users@lists.openmicroscopy.org.uk</a><br style="font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
<a href="http://lists.openmicroscopy.org.uk/mailman/listinfo/ome-users" style="color: rgb(149, 79, 114); text-decoration: underline; font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">http://lists.openmicroscopy.org.uk/mailman/listinfo/ome-users</a></div>
</blockquote>
</div>
<br class="">
</div>
<br>
<span style="font-size:10pt;">The University of Dundee is a registered Scottish Charity, No: SC015096</span>
</body>
</html>