What does accessing a supercomputer look like?

No video

What does accessing a supercomputer look like?

Рет қаралды 29,457

Жыл бұрын

Are you a beginner interested in using a supercomputer. Then this video is for you!
We run a simple job on LUMI (www.lumi-super...), one of the fastest supercomputers in the world.
You can find more information on how to get started on LUMI on docs.lumi-supe....
Whether you're a business, public authority or academic researcher, EuroHPC JU provides free access to multiple supercomputers in Europe for your computation-intensive jobs. More information on how to apply for access here eurohpc-ju.eur....
We have also made a video on how to apply • How to apply for acces...
------------------
ENCCS is based in Sweden and provides free training and support for accessing and using European supercomputers.
If you are a company or public authority based in Sweden please visit enccs.se or contact us at info@enccs.se. We help you access and use European supercomputers.
Are you located in a European country, or associated country? Contact your local competence centre to get help and advice. For more information on the competence centres please follow this link www.eurocc-acc....
You can read more about the countries associated with Horizon2020 here ec.europa.eu/i...

Пікірлер: 33

@kbhasi Жыл бұрын

Wow. One of the things I had wondered as a child reading non-fiction technology books was how one would access and control a supercomputer. KZfaq recommended this video and a question I never thought I wanted answered has been answered, especially because I already have quite a bit of experience with Linux.

@arindam-karmakar Жыл бұрын

Basically we need to use SSH to remotely access the supercomputer just like accessing any other linux server.

@hvanmegen Жыл бұрын

and you need to know how to submit jobs to slurm :)

@jmrumble Жыл бұрын

As you might have noticed by the view-count, this is highly interesting as short-form content! Can you show one doing something in parallel where the jobs are split? Also, what happens to the data? Can a user upload petabytes of data for a job? It can’t all be stored on the login nodes, can it? Like a CERN dataset or large baseline interferometry data for radio astronomy?

@enccs Жыл бұрын

You're definitely right! We are preparing such videos with parallel jobs, GPU programming examples and Jupyter notebooks. There are multiple options for storage. In the case of LUMI you can see the options here docs.lumi-supercomputer.eu/storage/

@jmrumble Жыл бұрын

@@enccs Awesome! I thought the docs would only be available to registered users for some reason. Are there users who actually book all of the nodes at once? And I saw in the documentation that you can develop software on Lumi - what kinds of software need to be developed on the supercomputer itself?

@Vampirat3 Жыл бұрын

From the U.S. ,Thank you , - and I really admire you guys , your people , and admire your government. I wish we did the same, with the same quality of service. This is so awesome. I will try later , thank you for the info❤

@SDFNI3894YR Жыл бұрын

lovely

@benbalach Жыл бұрын

You can always copy your private key to another computer, no need to regenerate.

@EFazy Жыл бұрын

Why I have to generate keypairs in different machines? Of course, you need to copy the id_rsa to the another machine, and watch out that the copy is secured (SCP for example is good) but if you generate n+1 key, then you have to watch n+1 key. Also, if you using smartcards to store your keys for example. You don't need dedicated smart cards for every computer... Except that, it's a nice video!

@enccs Жыл бұрын

It's true! You can do this as well!

@the_visualist Жыл бұрын

True, but if you loose a device with that key on it you can just remove that key and dont have to replace them on all other machines. As a Sysadmin I use a bunch of different keypairs for different clients, servers, etc. Just generate them, they are for free ;)

@lucientjinasjoe1578 4 ай бұрын

One basically question, if i put 2000 computers combined working together each with 3 giga bites, is it a super computer. Just ank out of curiosity

@guilherme5094 Жыл бұрын

👍

@BrokebackBob Жыл бұрын

Apparently it's not free since you need the project number for billing.

@enccs Жыл бұрын

With every access to a EuroHPC JU supercomputer you have a certain amount of core hours. This is why you need the project number. When the core hours are over in your project you have to apply for access again. And yes, it's free! Learn more about every access here enccs.se/industry-public-administration/

@erbenton07 Жыл бұрын

What languages are available? Can jobs be written in C?

@theuniverse2268 Жыл бұрын

It's a computer with SSH access you can run whatever you want to run. The only difference from a normal server is that you need to schedule your jobs. As you're not directly interacting with the server, but with a login server.

@EFazy Жыл бұрын

@@theuniverse2268 Hopefully not... First of all, the users cannot be root, but more important, the compiler, and the language has to have support parallel computing. Belive me, it's not just an apt/yum install :)

@enccs Жыл бұрын

Yes! C and Fortran are traditionally used a lot in HPC!

@jmrumble Жыл бұрын

Do people use Rust or Go for this?

@paulbraun5657 11 ай бұрын

How amazing! You type some UNIX text based commands in a Terminal window on macOS, then this gives you some text output back, but some of it comes from a remote computer!! No graphics or video. UNIX has existed since 1969. It looks like whatever these jobs were that you were running, it may as well have been done in 1969, or perhaps even 1977. macOS on a personal or single user computer looks light years ahead of this. What were these jobs or tasks you were running? What was the point of them?! I can't see any point to them at all.

@monq02 Жыл бұрын

can an individual not from eu do this too?

@enccs Жыл бұрын

The individual has to be working or studying in an EU country or a Horizon 2020 associated country. You can find the list of the countries here research-and-innovation.ec.europa.eu/statistics/framework-programme-facts-and-figures/horizon-2020-country-profiles_en

@cepi24 Жыл бұрын

Is access to supercomputer free?

@enccs Жыл бұрын

For researchers, companies and public authorities that are based in Europe, yes! They can use EuroHPC JU supercomputers for free. Learn more about which countries are eligible here ec.europa.eu/info/research-and-innovation/statistics/framework-programme-facts-and-figures/horizon-2020-country-profiles_en. In the description you can find our video on how to apply for access.