The aim of this section is to point you in the right direction to get started within the C-SCALE ecosystem.
These pages are targeted to users already onboarded onto the C-SCALE federation. If you want to become a C-SCALE user please check the Call for Use Cases.
Cloud, Data and HTC/HPC services in C-SCALE currently require separate accounts. Please follow instructions below depending on the service that you are going to access.
The user account to access Cloud and Data services is provided by EGI Check-In. Steps to create your Check-In account can be found in the EGI Documentation.
The user account to access HTC/HPC services is provided by SURF Research Access Manager (or SRAM). Log into SRAM with your preferred Identity Provider and upload your public SSH key to your profile page.
After creating your user account the next step is to join the relevant user group. So far we have created a user group per Use Case. Therefore, search for the given name of your Use Case and join the appropriate group.
The information about user groups for Cloud and Data services is available in EGI Operations Portal. Search for "C-SCALE" to find all the available groups:
User groups in the Cloud federation are also known as Virtual organisations (or VOs), and the links above are called VO ID Cards.
Users will have to visit the enrolment URL to request access. Each petition needs to be approved by the corresponding VO manager. The enrolment URL and the VO manager for each user group can be found in each VO Card.
The information about user groups for HTC/HPC services is available in SRAM Collaborative Organisation (or COs)
The available SRAM COs for C-SCALE are the following:
The link above is the Join Request URL that users will have to visit to request access. Each petition needs to be approved by the corresponding CO Admin.
Below is the list of OpenStack Horizon dashboards participating in the Cloud federation in C-SCALE:
When logging into the Horizon dashboard of OpenStack sites select either OpenID Connect or EGI Check-In in the dropdown menu. Then use your EGI Check-In credentials.
Cloud resources can also be deployed with TOSCA templates and the INDIGO PaaS Orchestrator. Check out the status dashboard in case of issues.
If it is your first time using the service please send the following details:
to indigo-paas-support<at>lists.infn.it to configure the service for your Use Case.
Pre-requisites for the cloud site to be configured with PaaS Orchestrator:
os_distro, os_versionindigo-paas tagindigo-paas-support<at>lists.infn.it:Example on how to configure properties and tags on images:
openstack image set --tag indigo-paas <image-id>
openstack image set --property os_distro=ubuntu --property os_version=20.04 <image-id>
Here are the instructions on how to access the HTC/HPC federation in C-SCALE:
sram-[CO short name]-[SRAM username]ssh -YC sram-[CO short name]-[SRAM username]@delena.surfsara.nlssh <username>@vsc5.vsc.ac.at. Where <username> is provided by EODC IT team.To access openEO platform please visit https://portal.terrascope.be, choose sign-in and then select EduGAIN & social logins.
The openEO endpoint you can use is openeo.vito.be, for instance via Python:
import openeo
connection = openeo.connect("https://openeo.vito.be").authenticate_oidc(provider_id="egi")
Access to openEO is also explained in the openEO documentation.
Check the relevant section below to access the documentation for each provider in C-SCALE.
Links to documentation on each Cloud provider:
See the INDIGO PaaS Orchestrator guides.
Links to documentation for HTC/HPC providers:
See documentation about openEO in the following links:
Please use the C-SCALE Helpdesk.
There is also a forum for C-SCALE on GitHub.
Use Cases may request to add or remove computational resources allocated to them by opening a ticket on their respective GitHub repository. All repositories are listed as projects in the C-SCALE GitHub Organisation. Please remember that these are private repositories and you need to request access.
If your Use Case does not have a GitHub repository or you do not have access contact us via GitHub discussions.
Here are the requirements for Use Cases requesting to run Matlab workflows in C-SCALE:
Please note that C-SCALE does not plan to cover the costs associated to Matlab licenses.
Here are the links to the tutorials that C-SCALE has prepared:
Do you have suggestions for new tutorials? Please let us know!
If you run Docker containers on top of Virtual Machines you may encounter unexpected network connectivity issues. If that is the case, please try the steps below:
# check current MTU value
sudo docker network inspect bridge | grep mtu | awk '{print $2}'
# the default 1500 value does not work properly
# edit docker configuration
sudo vi /etc/docker/daemon.json
# ensure this is added
{
"mtu": 1376
}
# then restart docker
sudo systemctl restart docker
We experienced this issue when trying to install a pip dependency using continuumio/miniconda3 container from docker hub.