<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif;">
<div>
<div>Dear Julio,</div>
<div><br>
</div>
<div>Thanks for starting this thread! My own setup monitoring an institutional OMERO server is pretty basic.</div>
<div><br>
</div>
<div>I run a Check_MK deployment installed via the “OMD” [1] distribution, included in CentOS/RH epel repository. </div>
<div><br>
</div>
<div>This I use to monitor:</div>
<div><br>
</div>
<div> System stats: CPU % usage, RAM % usage, % disk free, network etc</div>
<div> Existence (and age) of files, primarily for PostgreSQL nightly pg_dump backups. (e.g. alert if the backup file is >25hrs old) </div>
<div> OMERO (and system) log file parsing: A set of regular expressions match (or ignore), and alert accordingly. (e.g. Alert if anything appears in OMERO.server/var/log/master.err, or `ERR` appears in Blitz-0.log) [2]</div>
<div> <span class="Apple-tab-span" style="white-space:pre"> </span></div>
<div>I have alert thresholds configured, and it will email a distribution list and alert into a slack channel, once a threshold is reached (for a set configurable amount of time).</div>
<div><br>
</div>
<div>Check_MK has a concept of “local” checks, with which you can write a script and deploy on the host you wish to monitor that produces some output which Check_MK then parses, to be able to monitor anything you can query on the linux command line.</div>
<div><br>
</div>
<div>I previously used a python script like this to monitor the number of users connected to OMERO via parsing the output of `bin/omero sessions who`, but this was relying on the `guest` account, and the OME team (quite rightly) stopped the ability of the `guest`
user accessing `sessions who` output. I’ve been told I could supply OMERO account credentials to the python script, and have it connect with that account, so if I get that deployed, I’ll pop the script up on github along with the rest of the production server
config [3]. </div>
<div><br>
</div>
<div>[1] <a href="http://mathias-kettner.com/checkmk_install_with_omd.html">http://mathias-kettner.com/checkmk_install_with_omd.html</a></div>
<div>[2] <a href="https://github.com/openmicroscopy/prod-playbooks/blob/2018-01/ome-demoserver.yml#L266-L288">https://github.com/openmicroscopy/prod-playbooks/blob/2018-01/ome-demoserver.yml#L266-L288</a></div>
<div>
<div>[3] <a href="https://github.com/openmicroscopy/prod-playbooks/">https://github.com/openmicroscopy/prod-playbooks/<span class="Apple-tab-span" style="white-space:pre">
</span></a></div>
<div><br>
</div>
<div>As for data about groups/users – I’ve not tried this. Certainly you could write a Check_MK local check to parse the OMERO.cli output, if the OMERO.cli provides that data, like I did for “users logged in to OMERO”, but I would imagine it’d be too computationally
costly to run this command frequently, e.g. once per minute, like check_mk does. One could run the OMERO.cli command with cron.daily, and parse the result with a monitoring system like Check_MK. </div>
<div><br>
</div>
<div>I could imagine storage usage like that would be useful to include in an API within OMERO somewhere in the future, for parsing with tools like this.</div>
<div><br>
</div>
<div>I’m sure we’d all be interested to hear what everyone else is doing.</div>
<div><br>
</div>
<div>
<div>All the best,</div>
<div><br>
</div>
<div>Kenny</div>
<div><br>
</div>
<div>--</div>
<div><br>
</div>
<div>
<div style="font-family: Calibri; font-size: medium;"><span style="font-size: 12px; font-style: italic; font-weight: bold; font-family: Arial;">Kenneth Gillen</span></div>
</div>
<div>
<div style="font-size: medium;"><span style="font-size: 12px;"><font style="font-family: Tahoma;">
<div><span style="font-family: Arial;">OME System Administrator</span></div>
<span style="font-family: Calibri;"><br style="font-family: Arial;">
</span></font><span lang="en-GB" style="font-family: Tahoma;">
<div style="margin: 0pt; font-family: Arial;"><font color="black">Wellcome Trust Centre for Gene Regulation & Expression</font></div>
<div style="margin: 0pt; font-family: Arial;"><font color="black">School of Life Sciences</font></div>
<div style="margin: 0pt; font-family: Arial;"><font color="black">CTIR 2</font></div>
<div style="margin: 0pt; font-family: Arial;"><font color="black">University of Dundee</font></div>
<div style="margin: 0pt; font-family: Arial;"><font color="black">Dow Street</font></div>
<div style="margin: 0pt;"><font style="font-family: Arial;"><font color="black">Dundee DD1 5EH<br>
United Kingdom<br>
</font></font><span lang="en-GB" style="font-family: Arial;"><font color="black"><br>
Tel: +44 (0) 1382 388797<br>
<br>
</font></span></div>
<div><span lang="en-GB" style="font-family: Arial;"><a href="http://www.twitter.com/openmicroscopy" style="font-family: Tahoma;">http://www.twitter.com/openmicroscopy</a></span></div>
</span></span></div>
</div>
</div>
</div>
</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>ome-users <<a href="mailto:ome-users-bounces@lists.openmicroscopy.org.uk">ome-users-bounces@lists.openmicroscopy.org.uk</a>> on behalf of Julio MATEOS_LANGERAK <<a href="mailto:julio.mateos-langerak@igh.cnrs.fr">julio.mateos-langerak@igh.cnrs.fr</a>><br>
<span style="font-weight:bold">Reply-To: </span>OME User Support List <<a href="mailto:ome-users@lists.openmicroscopy.org.uk">ome-users@lists.openmicroscopy.org.uk</a>><br>
<span style="font-weight:bold">Date: </span>Monday, 22 January 2018 15:30<br>
<span style="font-weight:bold">To: </span>OME User Support List <<a href="mailto:ome-users@lists.openmicroscopy.org.uk">ome-users@lists.openmicroscopy.org.uk</a>><br>
<span style="font-weight:bold">Subject: </span>[ome-users] Monitoring OMERO activity and storage<br>
</div>
<div><br>
</div>
<div>
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
Dear all,
<div class=""><br class="">
</div>
<div class="">I’d like to collect any information / experience that would help us to monitor over time our OMERO server activity. The idea is:</div>
<div class=""><br class="">
</div>
<div class="">- to follow activity over time to be able to trace possible problems and the causes. We’d like to monitor nr of users connected, CPU/network activity, etc</div>
<div class="">- to establish a storage management plan, we’d like to automate the quota per user/group over time,…</div>
<div class=""><br class="">
</div>
<div class="">Any ideas, scripts, etc are welcome.</div>
<div class=""><br class="">
</div>
<div class="">Cheers, Julio</div>
<br class="">
<br class="">
<div class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
<span class="Apple-style-span" style="border-collapse: separate; font-family: Helvetica; border-spacing: 0px;">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
<span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant-ligatures: normal; font-variant-position: normal; font-variant-caps: normal; font-variant-numeric: normal; font-variant-alternates: normal; font-variant-east-asian: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: 0px;"><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant-ligatures: normal; font-variant-position: normal; font-variant-caps: normal; font-variant-numeric: normal; font-variant-alternates: normal; font-variant-east-asian: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: 0px;">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
<span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant-ligatures: normal; font-variant-position: normal; font-variant-caps: normal; font-variant-numeric: normal; font-variant-alternates: normal; font-variant-east-asian: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: 0px;">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
<span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant-ligatures: normal; font-variant-position: normal; font-variant-caps: normal; font-variant-numeric: normal; font-variant-alternates: normal; font-variant-east-asian: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: 0px;">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
<span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant-ligatures: normal; font-variant-position: normal; font-variant-caps: normal; font-variant-numeric: normal; font-variant-alternates: normal; font-variant-east-asian: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: 0px;">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
<span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-style: normal; font-variant-ligatures: normal; font-variant-position: normal; font-variant-caps: normal; font-variant-numeric: normal; font-variant-alternates: normal; font-variant-east-asian: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: 0px;">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">
<span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-ligatures: normal; font-variant-position: normal; font-variant-caps: normal; font-variant-numeric: normal; font-variant-alternates: normal; font-variant-east-asian: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; border-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-stroke-width: 0px;">
<div class=""><font class="Apple-style-span" size="3"><span class="Apple-style-span" style="font-size: 13px;"><font class="Apple-style-span" face="Verdana"><br class="Apple-interchange-newline">
__________________________________________</font></span></font></div>
<div class=""><span class="Apple-style-span" style="font-size: 13px;"><b class=""><font class="Apple-style-span" face="Verdana"><i class="">Julio Mateos Langerak, PhD.</i></font></b></span></div>
<div class=""><span style="font-family: Verdana; font-size: 13px;" class="">Arnaud de Villeneuve Campus Imaging Facility</span></div>
<div class=""><font class="Apple-style-span" size="3"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><font class="Apple-style-span" face="Verdana">Montpellier
RIO Imaging</font></span></span></span></span></span></span></font></div>
<div class=""><span style="font-family: Verdana; font-size: 13px;" class="">Institut de Génétique Humaine-CNRS</span></div>
<div class=""><font class="Apple-style-span" size="3"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><font class="Apple-style-span" face="Verdana">141,
rue de la Cardonille</font></span></span></span></span></span></span></font></div>
<div class=""><font class="Apple-style-span" size="3"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><font class="Apple-style-span" face="Verdana">F-34396</font></span></span></span></span></span></span></font><font class="Apple-style-span" size="3"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><font class="Apple-style-span" face="Verdana"> Montpellier</font></span></span></span></span></span></span></font><font class="Apple-style-span" size="3"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-converted-space"><font class="Apple-style-span" face="Verdana"> </font></span><font class="Apple-style-span" face="Verdana">(France)</font></span></span></span></span></span></span></font></div>
<div class=""><font class="Apple-style-span" size="3"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 12px;">
<div class=""><font class="Apple-style-span" size="3"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><font class="Apple-style-span" face="Verdana">e-mail:
<a href="mailto:Julio.Mateos-Langerak@igh.cnrs.fr" class="">Julio.Mateos-Langerak@igh.cnrs.fr</a></font></span></span></span></span></span></span></font></div>
<div class=""><span style="font-family: Verdana; font-size: 13px;" class="">phone: +33.4.34.35.99.90</span></div>
</span></span></span></span></span></span></span></font></div>
<div class=""><font class="Apple-style-span" size="3"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 13px;"><font class="Apple-style-span" face="Verdana">fax:
+33.4.34.35.99.01</font></span></span></span></span></span></span></font></div>
<div class=""><span style="font-family: Verdana; font-size: 13px;" class="">__________________________________________</span></div>
<div class=""><font class="Apple-style-span" size="3"><span class="Apple-style-span" style="font-size: 13px;"><span class="Apple-style-span" style="font-size: 12px;">
<div class=""><font class="Apple-style-span" size="3"><span class="Apple-style-span" style="font-size: 13px;"><font class="Apple-style-span" face="Verdana"><br class="">
</font></span></font></div>
</span></span></font></div>
</span><br class="Apple-interchange-newline">
</div>
</span></div>
</span></div>
</span></div>
</span><br class="Apple-interchange-newline">
</div>
</span><br class="Apple-interchange-newline">
</span><br class="Apple-interchange-newline">
</div>
</span></div>
</div>
<br class="">
</div>
</div>
</span><br>
<span style="font-size:10pt;">The University of Dundee is a registered Scottish Charity, No: SC015096</span>
</body>
</html>