<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri",sans-serif;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">I tried changing tile size. The error still comes up. The conversions that are failing all stop writing the TIFF files when the size of the output file hits 1,429,209,088 bytes, consistently, regardless of the size of the input file,
on both .svs and .vsi files. It does seem to be a restriction in the size of the file that the TIFF writer can write.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> ome-users <ome-users-bounces@lists.openmicroscopy.org.uk>
<b>On Behalf Of </b>Tarbox, Lawrence<br>
<b>Sent:</b> Tuesday, November 6, 2018 11:22 AM<br>
<b>To:</b> David Gault (Staff) <d.gault@dundee.ac.uk>; OME User Support List <ome-users@lists.openmicroscopy.org.uk><br>
<b>Subject:</b> Re: [ome-users] Error when converting large .svs or .vsi images<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">These errors came up while using a compression codec. Here is the command that I was using:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-family:"Courier New"">/home/ltarbox/bftools/bfconvert -no-upgrade -overwrite -compression JPEG \<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New""> "${FILES[MOAB_JOBARRAYINDEX-1]}" \<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:"Courier New""> /home/ltarbox/CIR-scans/out/WSI-${MOAB_JOBARRAYINDEX}_S%s.ome.tif<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Are you thinking that switching from JPEG to JPEG-2000 or LZW would work better?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">The original .svs images use JPEG compression (I think) with a tile size of 256x256<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">The original .vsi images use JPEG compression with a tile size of 512x512.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I was somewhat hoping that if I requested -compression JPEG bfconvert would simply copy the already-JPEG-compressed tiles from the original images into the .ome.tif images. But I’m game to try a different compression scheme.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> David Gault (Staff) <<a href="mailto:d.gault@dundee.ac.uk">d.gault@dundee.ac.uk</a>>
<br>
<b>Sent:</b> Tuesday, November 6, 2018 9:14 AM<br>
<b>To:</b> OME User Support List <<a href="mailto:ome-users@lists.openmicroscopy.org.uk">ome-users@lists.openmicroscopy.org.uk</a>>; Tarbox, Lawrence <<a href="mailto:LRTarbox@uams.edu">LRTarbox@uams.edu</a>><br>
<b>Subject:</b> Re: [ome-users] Error when converting large .svs or .vsi images<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Hi Lawrence, <o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">It does look like it is related to the file size of the converted file. Setting a compression codec should reduce the required size and might allow for easier conversion. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">For example using:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">bfconvert -compression JPEG-2000 /path/to/originalFile.svs /path/to/convertedFile.ome.tiff<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">bfconvert -compression LZW /path/to/originalFile.svs /path/to/convertedFile.ome.tiff<o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">With Thanks,<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">David Gault<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal">On 5 Nov 2018, at 20:19, Tarbox, Lawrence <<a href="mailto:LRTarbox@uams.edu">LRTarbox@uams.edu</a>> wrote:<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">I am using 5.9.2, from 3 Sept 2018.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">The file sizes that are not converting range from 1.7 GB to 4.2 GB. The .svs images that were smaller than about 1.3 GB converted without problem.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<div>
<p class="MsoNormal"><b>From:</b><span class="apple-converted-space"> </span>ome-users <<a href="mailto:ome-users-bounces@lists.openmicroscopy.org.uk">ome-users-bounces@lists.openmicroscopy.org.uk</a>><span class="apple-converted-space"> </span><b>On Behalf
Of<span class="apple-converted-space"> </span></b>David Gault (Staff)<br>
<b>Sent:</b><span class="apple-converted-space"> </span>Monday, November 5, 2018 7:10 AM<br>
<b>To:</b><span class="apple-converted-space"> </span>OME User Support List <<a href="mailto:ome-users@lists.openmicroscopy.org.uk">ome-users@lists.openmicroscopy.org.uk</a>><br>
<b>Subject:</b><span class="apple-converted-space"> </span>Re: [ome-users] Error when converting large .svs or .vsi images<o:p></o:p></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Hi Lawrence,<span class="apple-converted-space"> </span><o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">That error looks as though the buffer has been unable to successfully increase its limit for some reason.<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">What size are the original files you are trying to convert? Also what version of Bio-Formats are you currently using?<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">With Thanks,<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">David Gault<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal">On 2 Nov 2018, at 15:21, Tarbox, Lawrence <<a href="mailto:LRTarbox@uams.edu"><span style="color:purple">LRTarbox@uams.edu</span></a>> wrote:<o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal">In converting large .svs or .vsi images, I get the following error:<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">/home/ltarbox/CIR-scans<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">54680.svs<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">SVSReader initializing 54680.svs<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Reading IFDs<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Populating metadata<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Populating OME metadata<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">[Aperio SVS] -> /home/ltarbox/CIR-scans/out/WSI-2_S%s.ome.tif [OME-TIFF]<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Switching to BigTIFF (by file size)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Tile size = 256 x 256<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Exception in thread "main" java.lang.IllegalArgumentException<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at java.nio.Buffer.limit(Buffer.java:275)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.common.NIOFileHandle.buffer(NIOFileHandle.java:636)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.common.NIOFileHandle.writeSetup(NIOFileHandle.java:642)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.common.NIOFileHandle.write(NIOFileHandle.java:505)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.common.NIOFileHandle.write(NIOFileHandle.java:499)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.common.NIOFileHandle.write(NIOFileHandle.java:487)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.common.RandomAccessOutputStream.write(RandomAccessOutputStream.java:217)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.formats.tiff.TiffSaver.writeIFDStrips(TiffSaver.java:987)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.formats.tiff.TiffSaver.writeImageIFD(TiffSaver.java:451)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.formats.tiff.TiffSaver.writeImage(TiffSaver.java:401)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.formats.tiff.TiffSaver.writeImage(TiffSaver.java:277)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.formats.out.TiffWriter.saveBytes(TiffWriter.java:275)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.formats.out.OMETiffWriter.saveBytes(OMETiffWriter.java:218)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.formats.tools.ImageConverter.convertTilePlane(ImageConverter.java:748)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.formats.tools.ImageConverter.convertPlane(ImageConverter.java:634)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.formats.tools.ImageConverter.testConvert(ImageConverter.java:563)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> at loci.formats.tools.ImageConverter.main(ImageConverter.java:884)<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Smaller images convert fine.<span class="apple-converted-space"> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">I tripled the memory size (to 40 GB), but it stll fails<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Ideas?<o:p></o:p></p>
</div>
</div>
<div style="border:none;border-bottom:solid windowtext 1.0pt;padding:0in 0in 1.0pt 0in">
<div>
<div>
<p class="MsoNormal"><span style="color:#4472C4"> </span><o:p></o:p></p>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><i><span style="color:#4472C4">Lawrence Tarbox, Ph.D., Dept. of Biomedical Informatics, Univ. of Arkansas for Medical Sciences</span></i><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><i><span style="color:#4472C4"><a href="mailto:LTarbox@uams.edu"><span style="color:#954F72">mailto:LTarbox@uams.edu</span></a><span class="apple-converted-space"> </span>+1.314.681-2752</span></i><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="3" width="100%" align="center">
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif">Confidentiality Notice: This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and may contain confidential and privileged information.
Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message.<br>
_______________________________________________<br>
ome-users mailing list<br>
</span><a href="mailto:ome-users@lists.openmicroscopy.org.uk"><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif;color:#954F72">ome-users@lists.openmicroscopy.org.uk</span></a><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif"><br>
</span><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.openmicroscopy.org.uk_mailman_listinfo_ome-2Dusers&d=DwMFAg&c=27AKQ-AFTMvLXtgZ7shZqsfSXu-Fwzpqk4BoASshREk&r=7PfGBb2SHdaGpGKqCizhwg&m=r40EMcblVZoAtg0jtYbiDCk9hOS9PhHfHWfyTgcvMjE&s=AaJ76JDcXs17ypTw9JmpTKnUrJxLimF9uMYHNayZeuw&e="><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif;color:#954F72">http://lists.openmicroscopy.org.uk/mailman/listinfo/ome-users</span></a><o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><br>
<span style="font-size:10.0pt">The University of Dundee is a registered Scottish Charity, No: SC015096</span><o:p></o:p></p>
</div>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif">_______________________________________________<br>
ome-users mailing list<br>
</span><a href="mailto:ome-users@lists.openmicroscopy.org.uk"><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif;color:purple">ome-users@lists.openmicroscopy.org.uk</span></a><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif"><br>
</span><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.openmicroscopy.org.uk_mailman_listinfo_ome-2Dusers&d=DwMFAg&c=27AKQ-AFTMvLXtgZ7shZqsfSXu-Fwzpqk4BoASshREk&r=FQmnf-oLIEICrzyIHywOlUOTxJWIZf3tvJ8LUzIG0qM&m=3m3AIgFE_QbUasB7kt9_RCytADWjS30QJ6Al7TrUAQA&s=kfZIGmhU35jS7P0cZDCo9Svf9RFFIpFrGtbxDCbc37Y&e="><span style="font-size:9.0pt;font-family:"Helvetica",sans-serif;color:purple">http://lists.openmicroscopy.org.uk/mailman/listinfo/ome-users</span></a><o:p></o:p></p>
</div>
</blockquote>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<p class="MsoNormal"><br>
<span style="font-size:10.0pt">The University of Dundee is a registered Scottish Charity, No: SC015096</span>
<o:p></o:p></p>
</div>
</body>
</html>