SEMS – SEMS https://sems.bio.informatik.uni-rostock.de Model Management & Standards for Computational Biology Wed, 24 Jan 2018 14:54:30 +0000 en-US hourly 1 https://wordpress.org/?v=4.9.2 Outro -a.k.a- Where can I find $Stuff!? https://sems.bio.informatik.uni-rostock.de/2018/01/outro/ Tue, 23 Jan 2018 14:53:20 +0000 https://sems.bio.informatik.uni-rostock.de/?p=1864 Ok guys, $Stuff is now distributed around different servers, domains, services, people… Here are some links for external users to find the resources:

SEMS web page

The wordpress site has been serialised to static web content and is now available through sems.bio.informatik.uni-rostock.de. All sems.uni-rostock.de/.* links should send proper HTTP redirects, so your browser will automatically guide you to the new location.

Trac

Everything trac-related is now available through GitHub. There are plenty of repositories at github.com/SemsProject, the trac-wikis and tickets are converted to GitHub pages at semsproject.github.io/.
The webserver should be configured to properly redirect individual projects, wikis, tickets etc… Thus, bookmarks and scripts should be working fine.

Compilation Products

During SEMS’ life time we created quite some binaries. People and pipelines are relying on their availability. However, they also needed to move and are now available here:

Again, webservers are configured to redirect people and pipelines automagically!

Maven

We continue developing our tools and we will provide them through Maven. As described above, our Maven repository has moved to mvn.bio.informatik.uni-rostock.de.
But even better: we’re now distributing our tools through Maven central! No need to integrate a third party repository anymore :)
However, we switched the group id. It is now de.uni-rostock.sbi – so update your POMs. But don’t worry, you don’t need to update all the package names, the classes are still packaged as de.unirostock.sems.*. Find our artifacts published under de.uni-rostock.sbi at Maven Central.
Maven central will only contain new artifacts. The repository at mvn.bio.informatik.uni-rostock.de will still deliver previous artifacts, and mirror Maven central for the new artifacts. Thus, feel free to keep our third party repository integrated in your workflows.

Tools

Online tools, demos and prototypes have moved as well:

By the way, did you recognize that we also deployed proper SSL certificates for all services? :)

Cool, but how…

..did I just do it? Maybe it’s interesting for one or the other, or maybe you need to archive/migrate your $stuff as well? Therefore a quick overview on how I’m handling different things.

WordPress

This website used to be a WordPress instance. It has been serialised to static HTML pages using HTTrack and a bit manual fine-tuning – see also Archiving a Website.

Services that can handle HTTP redirects

Services that just handle default HTTP traffic now reply with a permanent redirect (HTTP/1.1 301 Moved Permanently). That’s realised using tiny Nginx vhosts. For example, bin.sems.uni-rostock.de can now be found at https://bin.bio.informatik.uni-rostock.de/, and the following definition makes sure people are forwarded to the proper location:

1
2
3
4
5
server {
        server_name bin.sems.uni-rostock.de;
        listen 80 ;
        rewrite ^/(.*)$ https://bin.bio.informatik.uni-rostock.de/$1 permanent;
}

Thus, a request on http://bin.sems.uni-rostock.de/CombineArchiveWeb/CombineArchiveWeb-0.4.9.war will be forwarded to https://bin.bio.informatik.uni-rostock.de/CombineArchiveWeb/CombineArchiveWeb-0.4.9.war. Try it yourself:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
usr@srv $ curl -LI http://bin.sems.uni-rostock.de/CombineArchiveWeb/CombineArchiveWeb-0.4.9.war
HTTP/1.1 301 Moved Permanently
Server: nginx/1.13.8
Date: Wed, 24 Jan 2018 12:40:44 GMT
Content-Type: text/html
Content-Length: 185
Connection: keep-alive
Location: https://bin.bio.informatik.uni-rostock.de/CombineArchiveWeb/CombineArchiveWeb-0.4.9.war

HTTP/2 200
server: nginx/1.13.8
date: Wed, 24 Jan 2018 12:40:44 GMT
content-length: 47174359
last-modified: Thu, 08 Oct 2015 16:01:12 GMT
etag: "2cfd2d7-52199f8defcec"
accept-ranges: bytes
strict-transport-security: max-age=31536000
Services that can’t handle 301

The above is probably the preferred approach, as people/browsers/search-engines won’t recognize anything and the old URLs will smoothly disappear (they won’t be copied anymore etc).
However, not every tool/pipeline is able to work with 301 redirects… For example, the BiVeS web application accepts POST requests. Tools that send a POST to bives.sems.uni-rostock.de may also receive a 301 that BiVeS moved to bives.bio.informatik.uni-rostock.de, and they may look at the new URL if you’re lucky, but they (most certainly) won’t resent the POST data to the new location. Thus, all tools that integrate BiVeS will not work anymore… :(
Thus, I’m not responding with a 301, but the request will just be proxied to the new location. For example, the Nginx configuration for BiVeS looks like this:

1
2
3
4
5
6
7
8
server {
        server_name bives.sems.uni-rostock.de;
        listen 80 ;
        location / {
                proxy_pass https://bives.bio.informatik.uni-rostock.de;
        }

}

This, however, is a bit sub-optimal as users won’t realised that BiVeS has moved…
That means I need to make sure this URL stays up and running!

Source code and wikis and tickets and stuff

Our git and trac stuff was migrated to GitHub (https://github.com/SemsProject/) and GitHub Pages (https://semsproject.github.io/). That has been made possible by Martin Peters, who developed a https://github.com/FreakyBytes/TracMigrator.

Monitoring

I’m a big fan of monitoring. Thus I started the migration with monitoring of web content using check_links. For example, I wrote a check to see if the page behind https://sems.bio.informatik.uni-rostock.de/projects/bives/ still contains the phrase highlighted reaction network. So a went around the many different sites and tools to define almost 100 different checks. This way, my monitoring solution would notify me as soon as a page/tool is not properly migrated and I can be sure that the HTTP redirects for all the URLs forward to the correct final locations (also with proper content negotiation for COMODI etc).
These checks are now properly integrated in my monitoring infrastructure, so that I can continuously be sure that links (in papers for example) stay valid.

Help from the whale

In the process of migration I encapsulated almost everything in Docker containers. This way it’s easier to handle the (legacy) content and a future migration will hopefully be much quicker.

But where is…?

Did we forget something? Is some tool not working properly anymore?
If you experience any problems please drop me an email.

]]>
The SEMS project came to an end https://sems.bio.informatik.uni-rostock.de/2017/10/the-sems-project-came-to-an-end/ Thu, 19 Oct 2017 07:21:12 +0000 https://sems.bio.informatik.uni-rostock.de/?p=1844 As you may have guessed from this website’s quiet news section: The SEMS project came to an end. Tom was bravely holding the fort, spending the last few cents of our budget in July 2017. But do not worry, not all is lost!

SEMS peeps will continue their fights for improved management of computational models on various fronts:

  • Dagmar temporarily tries the real life outside academia.
  • Fabienne continues to do her PhD in Business Informatics.
  • Mariam remains in Rostock, but moved on to revolutionise machine learning.
  • Vasundra moved to Trondheim to work on causal statements and ontologies.
  • Martin and Tom managed to land a new project at the SBI in Rostock to continue work on the versioning front in collaboration with groups from Munich and Heidelberg.
  • Ron works towards finishing his PhD in a denbi project in cooperation with Heidelberg.

To keep our results and project code available in the future, we are moving most of our stuff to Github: semsproject.github.io/. Martin will try to keep most of the tools, prototypes, and demos alive, but probably under different domains. For example, the BiVeS web application already moved to bives.bio.informatik.uni-rostock.de and the Combine Archive Web tool is available from cat.bio.informatik.uni-rostock.de. We try to properly redirect browsers and tools to the new locations, but let us know if anything goes wrong.

If you have doubts/questions/miss us do not hesitate to drop SEMS people an e-mail. We’ll be more than happy to hear from you.

Also check our Outro.

]]>
A container for the CombineArchive Web interface https://sems.bio.informatik.uni-rostock.de/2016/06/a-container-for-the-combinearchive-web-interface/ Fri, 10 Jun 2016 07:35:59 +0000 https://sems.bio.informatik.uni-rostock.de/?p=1654 Following the BiVeS-WebApp example, the CombineArchive Web interface jumps onto the Docker hype as well! It is now also available as a container from the Docker hub and we will automatically create new versions of the image with every release of the application.

To run the application just call the following command:

1
docker run -it --rm -p 1234:8080 binfalse/webcat:latest

This will bind your host’s port 1234 to the interface of the CombineArchive Web application in the container and you’ll be able to access the web interface at http://localhost:1234. There are a few options to run and configure the container, just have a look at the binfalse/webcat Docker Hub repository.

Thus, setting up the web interface was never easier nor cleaner. Plus: You will increase the privacy of your users and may get better performance from your web servers. :)

Let us know if you have problems with the setup.

]]>
BiVeS-WebApp as a Docker image https://sems.bio.informatik.uni-rostock.de/2016/05/bives-webapp-as-a-docker-image/ https://sems.bio.informatik.uni-rostock.de/2016/05/bives-webapp-as-a-docker-image/#comments Tue, 31 May 2016 21:07:46 +0000 https://sems.bio.informatik.uni-rostock.de/?p=1628 Today we compiled the BiVeS web application into a Docker image. Using Docker it is very simple to run the application on your desktop, your server, your cloud…

The Docker image is available from the Docker Hub as binfalse/bives-webapp. To pull the latest version of the BiVeS web application just call

1
docker pull binfalse/bives-webapp

Running the tool is almost as simple pulling it:

1
docker run -it --rm -p 1234:8080 binfalse/bives-webapp

This call will bind the container’s web server to your machine’s port 1234. Thus, if you open your web browser and go to http://localhost:1234 you will already start talking to BiVeS!
To verify that BiVeS is working correctly, you can try to compare two files using the following curl command:

1
2
3
4
5
6
7
8
9
10
11
12
13
curl -d '{
  "files":
  [
    "http://budhat.sems.uni-rostock.de/download?downloadModel=24",
    "http://budhat.sems.uni-rostock.de/download?downloadModel=25"
  ],
  "commands":
  [
    "SBML",
    "reactionsDot",
    "reportHtml"
  ]
}' http://localhost:1234

Replace http://localhost:1234 with the settings of your environment if you didn’t run the above command lines on your local machine.

We updated our maven configuration to automagically create and publish new docker image with every release of the BiVeS web application.

]]>
https://sems.bio.informatik.uni-rostock.de/2016/05/bives-webapp-as-a-docker-image/feed/ 1
New paper on Functional Curation https://sems.bio.informatik.uni-rostock.de/2016/02/functional-curation-of-computational-models/ Sat, 13 Feb 2016 14:47:39 +0000 https://sems.bio.informatik.uni-rostock.de/?p=1536 Martin Scharm’s paper about the Cardiac Electrophysiology Web Lab, work done during his research stay at the University of Oxford, is published in the current issue of the Biophysical Journal! Hooray :)

We have created an online resource for the characterization and comparison of electrophysiological cell models in a wide range of experimental scenarios. The details of the mathematical model (quantitative assumptions and hypotheses formulated as ordinary differential equations) are separated from the experimental protocol being simulated. Each model and protocol is then encoded in computer-readable formats. A simulation tool runs virtual experiments on models encoded in CellML, and a website (https://chaste.cs.ox.ac.uk/WebLab) provides a friendly interface, allowing users to store and compare results.

Read more at: http://www.cell.com/biophysj/references/S0006-3495%2815%2904753-0

]]>
WebCAT exports Research Objects https://sems.bio.informatik.uni-rostock.de/2015/09/webcat-exports-research-objects/ Sun, 13 Sep 2015 21:24:54 +0000 https://sems.bio.informatik.uni-rostock.de/?p=1385 Export RO

Export RO from WebCAT

We are happy to announce that the CombineArchive WebInterface is now able to export Research Objects!

You just need to click the [Export RO] button, as shown in the image.
That’s been made possible with the help of CaRo and the CaRoWeb tools.

]]>
CaRoWeb: now including ?remote= and redirect=checkout https://sems.bio.informatik.uni-rostock.de/2015/09/caroweb-now-including-remote-and-redirectcheckout/ Fri, 11 Sep 2015 21:21:07 +0000 https://sems.bio.informatik.uni-rostock.de/?p=1367 We just updated the CaRoWeb interface. This update brings two brand-new options to the conversion requestions:

?remote= downloads containers from other web servers

In addition to the famous HTTP-POST-conversion you can now supply a link to a container that’s to be converted, e.g.:

1
curl 'http://SERVER/caro?remote=http://scripts.sems.uni-rostock.de/getshowcase.php'

the value supplied to the ?remote= gets interpreted as a link to a container (COMBINE archive or Research object) on a remote server. It will be downloaded and the conversion will be triggered. Thus, you do not need to download a COMBINE archive yourself, but you can point to an archive on the Internet! :)
That means, if you want to convert the archive behind http://scripts.sems.uni-rostock.de/getshowcase.php you can simply curl for:

1
$ curl http://caro.sems.uni-rostock.de/caro/caro/?remote=http://scripts.sems.uni-rostock.de/getshowcase.php

?redirect=checkout immediately delivers the container

We understand that people do not always want to parse needless JSON code. Thus, if you add ?redirect=checkout to your query you’ll get redirected to the actual container!

Without redirect:

1
2
$ curl http://caro.sems.uni-rostock.de/caro/caro/?remote=http://scripts.sems.uni-rostock.de/getshowcase.php
{"errors":[],"notifications":[],"checkout":"CombineArchiveShowCase.omex4242711464206811849-converted-2015-09-11-23-15-PM+0200.ro","warnings":[]}

you need to parse the JSON to retrieve the container from http://caro.sems.uni-rostock.de/checkout/CombineArchiveShowCase.omex4508850515417520827-converted-2015-09-11-23-17-PM+0200.ro

Using the latest version of the web interface you just need to append redirect=checkout and you’ll get the container:

1
2
$ curl -L http://caro.sems.uni-rostock.de/caro/caro/?remote=http://scripts.sems.uni-rostock.de/getshowcase.php&redirect=checkout
# here comes the container :)

Give it a try and open the link: http://caro.sems.uni-rostock.de/caro/caro/?remote=http://scripts.sems.uni-rostock.de/getshowcase.php&redirect=checkout

Read more about CaRoWeb and its options at the project page!

]]>
SEMS’ Gallery https://sems.bio.informatik.uni-rostock.de/2015/06/sems-gallery/ Sat, 27 Jun 2015 18:24:57 +0000 https://sems.bio.informatik.uni-rostock.de/?p=1223 Yeah! SEMS now has a gallery :)

At gallery.sems.uni-rostock.de you’ll find images, logos, and figures that we created. If you click on an image you’ll get more information about it.
The number of images is currently fairly small, but will hopefully be increasing in the future.

]]>
Martin visits the group of Carole Goble in Manchester https://sems.bio.informatik.uni-rostock.de/2015/06/martin-visits-the-group-of-carole-goble-in-manchester/ Tue, 02 Jun 2015 19:15:37 +0000 https://sems.bio.informatik.uni-rostock.de/?p=1166 logo-university-of-manchester
Martin Scharm is currently in Manchester to visit the group of Carole Goble. His stay is funded by the HERMES research funding program at the University of Rostock. Martins goals for the coming 8 weeks are to establish a closer collaboration with Manchester and to develop a grant proposal together with Mrs. Goble’s group.

Martin has already been there for two weeks and also gave a talk last week at a research seminar (slides).

]]>
BiVeS in PMR2 https://sems.bio.informatik.uni-rostock.de/2015/05/bives-in-pmr2/ Mon, 25 May 2015 23:33:19 +0000 https://sems.bio.informatik.uni-rostock.de/?p=1118 BiVeS as integrated in PMR2

BiVeS as integrated in PMR2

One of our main goals at HARMONY 2015 was to improve the version control of PMR2, as we described earlier. During HARMONY, Tommy Yu, main developer of PMR2, and Martin Scharm already achieved preliminary results.

Today Tommy sent us the first version of BiVeS integrated into the CellML model repository:

go here: http://staging.physiomeproject.org/workspace/beeler_reuter_1977/file/cb090c96a2ce627457b14def4910ac39219b8340/beeler_reuter_1977.cellml

Then click the ‘Compare …’ button. Do the same with: http://staging.physiomeproject.org/w/tommy/beeler_reuter_1977_uncertexample/file/d26c870944e07f00950fd671a8eb73663e96672c/beeler_reuter_1977.cellml

Now both files should be selected, just pick one as source and the other as target, hit ‘Compare Source with Target’ and watch magic happens courtesy of Martin’s BiVeS WS tool.

Tommy is using the BiVeS web service which he had deployed to one of his servers. This is still a feature in testing (running on staging servers), but will hopefully soon be available on the main repository.

Tommy, you did an excellent job! :)

]]>