Difference between revisions of "Category:NCBO Virtual Appliance"

From NCBO Wiki
Jump to navigation Jump to search
(→‎Virtual Appliance Basics: adding even more basic info, referencing the FAQ)
(12 intermediate revisions by 3 users not shown)
Line 5: Line 5:
  
 
== Virtual Appliance Basics ==
 
== Virtual Appliance Basics ==
 +
 +
The NCBO Virtual Appliance is a copy of the NCBO software that you can run on your own Linux system. You have to install it following the instructions below, and upload your own ontologies (and/or copies of ours, if they are public).
  
 
The NCBO Virtual Appliance image contains a pre-installed, pre-configured version of commonly-used open source NCBO software running on a Linux operating system.  
 
The NCBO Virtual Appliance image contains a pre-installed, pre-configured version of commonly-used open source NCBO software running on a Linux operating system.  
  
It is available as a VMWare Virtual Appliance OVF as well as Amazon AWS AMI and can be obtained by contacting support@bioontology.org.
+
It is available as a VMWare Virtual Appliance OVF, as well as an Amazon Web Service AMI, and can be obtained by contacting us following the instructions under '''Getting Started''' below.
  
The following software is included on the image as of v2.2:
+
The following software is included on the image as of v2.4:
 
* Ontologies API (REST service)
 
* Ontologies API (REST service)
 
* Annotator
 
* Annotator
Line 16: Line 18:
 
* BioPortal Web User Interface (including ontology visualization, widgets, biomixer, and Annotator UI)
 
* BioPortal Web User Interface (including ontology visualization, widgets, biomixer, and Annotator UI)
  
Please see below for how-to documentation for managing the software and running data population for Annotator.
+
Please see below for how-to documentation for managing the software and running data population for Annotator.
 +
 
 +
You may also want to visit the [[Virtual Appliance FAQ]] for additional information on the Virtual Appliance, as well as the other pages in this category (bottom of the page).
  
 
== Getting Started ==
 
== Getting Started ==
 
=== VMWare Virtual Appliance ===
 
=== VMWare Virtual Appliance ===
* To obtain the VMWare Virtual Appliance, contact [mailto:support@bioontology.org NCBO Support] and include your BioPortal account username. You can create a BioPortal account at: http://bit.ly/bioportal-account
+
* To obtain the VMWare Virtual Appliance, contact [mailto:support@bioontology.org NCBO Support] to initiate your request. You'll then be asked privately for your BioPortal account username. organizational goals, and reason for preferring the local installation. (If you don't have a BioPortal account, you can create one at: http://bit.ly/bioportal-account.) The overall transaction can take a few working days, depending on resource availability.
 
* The download is provided as a zip archive containing several files. One of these is an Open Virtualization Format (OVF) file that may need to be [http://www.bioontology.org/wiki/index.php/Virtual_Appliance_FAQ#How_can_I_use_the_OVF_image_with_my_virtualization_software.3F_.28VMWare.2C_VirtualBox.2C_KVM.2C_Xen.2C_etc.29 converted to work in your virtualization environment].
 
* The download is provided as a zip archive containing several files. One of these is an Open Virtualization Format (OVF) file that may need to be [http://www.bioontology.org/wiki/index.php/Virtual_Appliance_FAQ#How_can_I_use_the_OVF_image_with_my_virtualization_software.3F_.28VMWare.2C_VirtualBox.2C_KVM.2C_Xen.2C_etc.29 converted to work in your virtualization environment].
 
* You can supply the hostname (machine name) for the virtual machine during the deployment process. Documentation will refer to this hostname as 'example'.
 
* You can supply the hostname (machine name) for the virtual machine during the deployment process. Documentation will refer to this hostname as 'example'.
Line 32: Line 36:
  
 
=== Amazon AWS AMI ===
 
=== Amazon AWS AMI ===
Amazon AMI is available on the [https://aws.amazon.com/marketplace/seller-profile/ref=dtl_pcp_sold_by?ie=UTF8&id=76948a46-8f8a-4a68-9a5c-3e3ff6b82d10 AWS Market Place].  Please contact [mailto:support@bioontology.org NCBO Support] for more information.
+
For users who want to run their BioPortal instance on Amazon Web Services, an Amazon Machine Instance (AMI) is available on the [https://aws.amazon.com/marketplace/seller-profile/ref=dtl_pcp_sold_by?ie=UTF8&id=76948a46-8f8a-4a68-9a5c-3e3ff6b82d10 BioOntology AWS Market Place].  Please contact [mailto:support@bioontology.org NCBO Support] for more information.
 +
 
 
Once the instance is running, enter the public DNS provided by Amazon into your browser to access BioPortal web interface.  The default application administrator is 'admin' and the initial password is the Instance ID.  You can also SSH to the machine using the username 'ec2-user' and your Amazon private key.
 
Once the instance is running, enter the public DNS provided by Amazon into your browser to access BioPortal web interface.  The default application administrator is 'admin' and the initial password is the Instance ID.  You can also SSH to the machine using the username 'ec2-user' and your Amazon private key.
  
 
=== General Instruction ===
 
=== General Instruction ===
* Add an ontology using the BioPortal Admin User here: http://{YourDomainName}/ontologies/new
+
Virtual Appliance Web UI can be accessed at http://{ip_address_of_appliance}.  You can get IP address of the Appliance by using the following command in the terminal 'ip addr show eth0'
 +
* Add an ontology using the BioPortal Admin User here: http://{ip_address_of_appliance}/ontologies/new
 
** The ncbo_cron project is configured to automatically process new ontologies every 5 minutes (see [http://www.bioontology.org/wiki/index.php/Virtual_Appliance_FAQ#When_are_new_ontologies_parsed.3F documentation for enabling the scheduler]). This processing includes:
 
** The ncbo_cron project is configured to automatically process new ontologies every 5 minutes (see [http://www.bioontology.org/wiki/index.php/Virtual_Appliance_FAQ#When_are_new_ontologies_parsed.3F documentation for enabling the scheduler]). This processing includes:
 
*** Parsing any new, unparsed ontologies
 
*** Parsing any new, unparsed ontologies
Line 43: Line 49:
 
*** Processing the ontology for use with the annotator
 
*** Processing the ontology for use with the annotator
 
* REST services are available at the following location:
 
* REST services are available at the following location:
** http://example:8080
+
** http://{ip_address_of_appliance}:8080
** http://example:8080/documentation
+
** http://{ip_address_of_appliance}/documentation
  
 
== System Requirements ==
 
== System Requirements ==
Line 58: Line 64:
 
* Recommended for heavier usage
 
* Recommended for heavier usage
 
** 4 CPU (3 GHz)  
 
** 4 CPU (3 GHz)  
** 8GB RAM  
+
** 8GB RAM (or more depending on the size/number of ontologies)
 
** Hard disk space: 20GB (or more depending on number/size of ontologies)
 
** Hard disk space: 20GB (or more depending on number/size of ontologies)
  
Line 64: Line 70:
 
The NCBO Appliance image was created using the [http://www.vmware.com/appliances/getting-started/learn/ovf.html Open Virtualization Format], which should allow the machine to be used in a variety of environments.
 
The NCBO Appliance image was created using the [http://www.vmware.com/appliances/getting-started/learn/ovf.html Open Virtualization Format], which should allow the machine to be used in a variety of environments.
  
The operating system is CentOS 6.5 64-bit running:
+
The operating system is CentOS 6.6 64-bit running:
 
*Tomcat 6.0.26  
 
*Tomcat 6.0.26  
*Solr 4.7.2
+
*Solr 4.10.4
 
*Java 7
 
*Java 7
 
*MySQL 5.1.x
 
*MySQL 5.1.x
*Rails 2.3.x
+
*Rails 3.2.x
*Ruby 2.0.0p353
+
*Ruby 2.1.5
 
*memcached  
 
*memcached  
*redis 2.6.14
+
*redis 2.8.18
*nginx 1.6.0
+
*nginx 1.6.3
 
*4store
 
*4store
 
*Passenger/Apache
 
*Passenger/Apache
Line 90: Line 96:
 
== Basic System Administration ==
 
== Basic System Administration ==
 
* Most of our administration scripts and build environment assume that you will be running as the root user.
 
* Most of our administration scripts and build environment assume that you will be running as the root user.
* Helper commands:
+
* We assume familiarity with basic CentOS Linux administration
** <code>bpstart</code>: the required services are started on boot automatically, but if they need to be started automatically
+
* 2 text editors are originally installed: nano and vim
 +
* All services required for BioPortal Stack are automatically started on boot.  For troubleshooting purposes you can manually stop/start services:
 +
** <code>bprestart</code>: manually restart services required for BioPortal Stack. 
 +
** <code>bpstart</code>: manually start services
 
** <code>bpstop</code>: manually stop services
 
** <code>bpstop</code>: manually stop services
** <code>bprestart</code>: manually start/stop services
 
 
* Start individual services:
 
* Start individual services:
 
** <code>/sbin/service httpd start</code>
 
** <code>/sbin/service httpd start</code>

Revision as of 22:39, 17 November 2016

NCBO VIRTUAL APPLIANCE v2.4 IS NOW AVAILABLE

The NCBO Virtual Appliance has been updated to use NCBO's new v4.0 software infrastructure, including the use of an RDF triplestore as the primary data storage mechanism. Please read below as much of the Appliance workflow has changed.

For documentation of v1.0 Virtual Appliances, please see our archive.

Virtual Appliance Basics

The NCBO Virtual Appliance is a copy of the NCBO software that you can run on your own Linux system. You have to install it following the instructions below, and upload your own ontologies (and/or copies of ours, if they are public).

The NCBO Virtual Appliance image contains a pre-installed, pre-configured version of commonly-used open source NCBO software running on a Linux operating system.

It is available as a VMWare Virtual Appliance OVF, as well as an Amazon Web Service AMI, and can be obtained by contacting us following the instructions under Getting Started below.

The following software is included on the image as of v2.4:

  • Ontologies API (REST service)
  • Annotator
  • Recommender
  • BioPortal Web User Interface (including ontology visualization, widgets, biomixer, and Annotator UI)

Please see below for how-to documentation for managing the software and running data population for Annotator.

You may also want to visit the Virtual Appliance FAQ for additional information on the Virtual Appliance, as well as the other pages in this category (bottom of the page).

Getting Started

VMWare Virtual Appliance

  • To obtain the VMWare Virtual Appliance, contact NCBO Support to initiate your request. You'll then be asked privately for your BioPortal account username. organizational goals, and reason for preferring the local installation. (If you don't have a BioPortal account, you can create one at: http://bit.ly/bioportal-account.) The overall transaction can take a few working days, depending on resource availability.
  • The download is provided as a zip archive containing several files. One of these is an Open Virtualization Format (OVF) file that may need to be converted to work in your virtualization environment.
  • You can supply the hostname (machine name) for the virtual machine during the deployment process. Documentation will refer to this hostname as 'example'.
  • Change default passwords
    • Operating System
      • Username: root
      • Password: password is prompted on the first boot
    • BioPortal Admin User
      • Username: admin
      • Password: changeme

Amazon AWS AMI

For users who want to run their BioPortal instance on Amazon Web Services, an Amazon Machine Instance (AMI) is available on the BioOntology AWS Market Place. Please contact NCBO Support for more information.

Once the instance is running, enter the public DNS provided by Amazon into your browser to access BioPortal web interface. The default application administrator is 'admin' and the initial password is the Instance ID. You can also SSH to the machine using the username 'ec2-user' and your Amazon private key.

General Instruction

Virtual Appliance Web UI can be accessed at http://{ip_address_of_appliance}. You can get IP address of the Appliance by using the following command in the terminal 'ip addr show eth0'

System Requirements

The following requirements are for the resources that you devote to your Appliance instance, not for the machine running your host environment. For example, if you are using a system with 4GB of RAM, then you will need to devote all of that RAM to your guest Appliance.

Note: these requirements are for basic usage. System requirements will vary greatly depending on the size of the ontologies you work with, the number of ontologies in the system, and the number of concurrent requests that the system needs to respond to. It can also vary depending on how the ontologies are used. For example, the search index can be RAM-intensive but parsing ontologies can be CPU-intensive. You will need to experiment with your Appliance resource settings to find what works for your scenario.

  • Minimum
    • 2 CPU (2 GHz)
    • 4GB RAM
    • Hard disk space: 20GB
  • Recommended for heavier usage
    • 4 CPU (3 GHz)
    • 8GB RAM (or more depending on the size/number of ontologies)
    • Hard disk space: 20GB (or more depending on number/size of ontologies)

Image Format and Operating System Details

The NCBO Appliance image was created using the Open Virtualization Format, which should allow the machine to be used in a variety of environments.

The operating system is CentOS 6.6 64-bit running:

  • Tomcat 6.0.26
  • Solr 4.10.4
  • Java 7
  • MySQL 5.1.x
  • Rails 3.2.x
  • Ruby 2.1.5
  • memcached
  • redis 2.8.18
  • nginx 1.6.3
  • 4store
  • Passenger/Apache


The following applications use these services/runtime environments:

  • Sinatra, Ruby, 4store, redis
    • Ontologies API
    • Annotator
    • Recommender
  • Rails, Ruby, memcached, mysql
    • BioPortal Web User Interface (including ontology visualization, Flex widgets, biomixer, Annotator)
  • Tomcat, Solr
    • Search index

Basic System Administration

  • Most of our administration scripts and build environment assume that you will be running as the root user.
  • We assume familiarity with basic CentOS Linux administration
  • 2 text editors are originally installed: nano and vim
  • All services required for BioPortal Stack are automatically started on boot. For troubleshooting purposes you can manually stop/start services:
    • bprestart: manually restart services required for BioPortal Stack.
    • bpstart: manually start services.
    • bpstop: manually stop services
  • Start individual services:
    • /sbin/service httpd start
    • /sbin/service memcached start
    • /sbin/service tomcat6 start
    • /sbin/service mgrep start
    • /sbin/service 4s-httpd-ontologies_api start
    • /sbin/service unicorn start
  • Stop individual services:
    • /sbin/service httpd stop
    • /sbin/service memcached stop
    • /sbin/service tomcat6 stop
    • /sbin/service mgrep stop
    • /sbin/service 4s-httpd-ontologies_api stop
    • /sbin/service unicorn stop

License

All NCBO software is released with the 2-clause BSD license. Source code is included on the Virtual Appliance.

Subcategories

This category has only the following subcategory.