Skip to end of metadata
Go to start of metadata

This page describes the installation of SCAPE platform in a High Performance Computation centre. The hardware platform is described here.

Nota: This page concludes MS91 - Services for integrating remote working, due in M38.

UVT Data Center services

Based on the requirements of the project partners (BUT, FIZ etc), UVT provides a set of services aimed at providing support for the various sub-projects and activities within SCAPE. The services provided can be classified as:

  • Execution services
  • Customisation services
  • Data storage services
  • IaaS services.
Execution Services

The execution services provided by UVT cover several facilities, including (but not restricted to): Batch Scheduling, MapReduce services, and QosCosGrid Compute API.

The Batch Scheduling service is based on the IBM ® LoadLeveler scheduling system. The service allows the SCAPE partners to use UVT’s computing facilities, featuring more the 40 x86 servers. This service also allows access to specialised resources like GPU computing nodes. The Batch Scheduling service is complemented by the QosCosGrid API developed by Application Department from PSNC. The QCG API allows integration with partners applications.

Besides the two batch oriented services, UVT also provides access to Hadoop resources both as a SCAPE dedicated cluster (7 dedicated HP AMD64 servers) and on demand Hadoop clusters based on the SCAPE Cloud Deployment toolkit.

h7. Customisation Services

On top of providing the aforementioned execution services, UVT also provides support for customising existing services for the requirements of SCAPE Users. Examples include specific runtime configurations, both software and hardware. For instance, off-screen CUDA rendering support was provided specifically to BUT, allowing the execution of OpenGL applications on top of headless GPU systems.

Data Storage Services

The Data Storage Services provide the project partners with storage space on UVT’s infrastructure. The storage services include both GPFS storage (available as FTP/SFTP) and Hadoop HDFS storage.

The HDFS storage service is accessible both directly from Hadoop jobs and also by means of the HDFS FTP Server developed by UVT in the frame of the SCAPE Project. The FTP servers allows remote manipulation of the HDFS filesystem from legacy applications or commodity file transfer utilities. Check project page on Bitbucket for source code and installation instructions.

IaaS Services

As part of the SCAPE Project, UVT provides IaaS hosting services for SCAPE Consortium members. This hosting services include the ability of deploying Virtual Machines on top of the IaaS infrastructure, specifically the Eucalyptus middleware. For instance, FIZ team members use the IaaS hosting facility leveraging on VMs to host Fedora Directory development.

PSNC Data Center services

Based on the scenarios identified by WCPT it was agreed to implement and deploy several services at PSNC for integrating WCPT working environment. The following services are needed to execute specific scenarios at WCPT:

All of the services are currently deployed on the PSNC Development cluster and are the subject of tests at the WCPT working environment. After the testing period and additional improvements that will be necessary to implement, it is envisioned to start production mode environment. The final deployment of all the tools at the Data Center is envisioned to happen in M40.

Labels:
None
Enter labels to add to this page:
Please wait 
Looking for a label? Just start typing.