Kategorier
Interactive HPC Supercomputing UCloud

Adding 16 NVIDIA H100 GPUs to the DeiC Interactive HPC service marks significant milestone in computational research

Denmark has marked a significant milestone in computational research with the addition of 16 NVIDIA H100 GPUs to the DeiC Interactive HPC service, and 16 more are expected by the end of the year. The tender for the acquisition of the GPUs was awarded to Lenovo. This addition signifies a big leap forward for Danish researchers, who can now easily access the new GPUs through UCloud, and positions Denmark at the forefront of AI innovation. We recently had the privilege of talking with Dr. Valerio Rizzo, head of AI & SME at Lenovo’s EMEA (Europe, Middle East and Africa) division, about the AI revolution that is currently taking place and Lenovo’s role in the production of the world’s most powerful hardware for AI. 

Collaboration between Lenovo and NVIDIA

NVIDIA is the company behind the industry-leading graphics processing unit (GPU), H100, currently the most sought-after hardware for AI and used extensively by some of the biggest AI companies in the world, including OpenAI, Microsoft and Google. H100 is generally 2-3 times faster than the previous A100 generation, and an impressive 30 times faster for AI workloads such as large language models (LLM). The recently announced supercomputer, Gefion, by Novo Nordisk Foundation (NNF) and the Export and Investment Fund of Denmark (EIFO) will make use of the same technology. 

In the past, Danish researchers had to either search abroad or pay commercial cloud providers expensive fees to use these powerful machines. However, since January this year the 16 H100 GPUs have been available via the DeiC Interactive HPC service, provided by a consortium of universities consisting of Aarhus University (AU), Aalborg University (AAU) and the University of Southern Denmark (SDU). The H100 GPUs are hosted at the SDU data center and available via the user-friendly platform, UCloud, that powers the DeiC Interactive HPC service…

To read more please go to SDU eScience to read the full story

Kategorier
HPC Interactive HPC Supercomputing Tutorial UCloud UCloud status

No More Waiting for Resources

Streamline your workflow when using DeiC Interactive HPC

Have you ever experienced delays due to high demand for computing resources on UCloud (DeiC Interactive HPC)? The key to faster access and reducing system strain is efficient resource management.

Over-requesting can lead to unnecessary waiting because DeiC Interactive HPC operates by allocating resources to users as the requested resources become available, without the use of priority queues. Consequently, if you select a large machine for a relatively small task, you will need to wait for other tasks requested for these larger but fewer machines to finish, leading to prolonged waiting.

“Users with little or no experience in assessing the amounts of resources needed have a tendency to request more than they actually need.  This causes unnecessary queues and frustration for other users. However, we also see experienced users choosing the large machines simply out of habit instead of starting small, and subsequently migrate to a larger machine only when necessary.”

Jes Elgin, Cloud Engineer at DeiC Interactive HPC

To avoid delays, users need to accurately assess and request only the necessary resources for their task. Starting with conservative estimates can expedite access and improve overall system efficiency.

“Choosing small will always give you a head start as there are more small machines, and you can always upgrade to a large machine if you need it. You don’t have to start over, and you won’t lose any data.”

Jes Elgin, Cloud Engineer at DeiC Interactive HPC

So, choose your machine based on a qualified estimate of resources needed. If unsure start small and seek advice from experienced colleagues or the DeiC Front Office.

For optimal use of interactive HPC and to enhance your research, consult our guide on Interactive HPC Best Practices.

Kategorier
Interactive HPC Supercomputing UCloud

9000 users on DeiC Interactive HPC

DeiC Interactive HPC has achieved another remarkable feat: it now has more than 9000 users! The graph shows the rapid and steady growth of the user base, which has tripled in just two years. More about this new milestone here

Kategorier
Interactive HPC Quantum computing Supercomputing UCloud

DeiC Interactive HPC offers integration of advanced Quantum Computing Applications

Recently two advanced quantum computing applications were deployed on DeiC Interactive HPC: the NVIDIA CUDA Quantum Platform and the NVIDIA cuQuantum Appliance.

These applications show the continuous commitment to offer cutting-edge technologies to the Interactive HPC users.

“With these new applications, DeiC Interactive HPC is at the forefront of bringing quantum computing into practical, real-world use,” says Emiliano Molinaro, leader of research support at the SDU eScience Center. “The platform is now uniquely equipped to support the development of quantum algorithms and simulations, offering unprecedented level of computational power and flexibility.”

We hope that DeiC Interactive HPC’s deployment of these NVIDIA applications will be useful for a wide array of users, from academic researchers to industry professionals, seeking to explore the uncharted territories of quantum computing. It represents not only an enhancement of DeiC Interactive HPC’s offerings but also a significant contribution to the Danish quantum computing ecosystem.

Check out the full story on the SDU eScience website.

Kategorier
Conference DeiC Event HPC Interactive HPC Supercomputing Teaching UCloud

Video use case: DeiC Interactive strengthens teaching in digital methods

Historian Adela Subotkova teaches history students at the University of Aarhus in digital methods. For her, DeiC Interactive has become an essential tool that has significantly facilitated and improved teaching.

Visit deic.dk to view video use case from the 2023 DeiC Conference

Kategorier
DeiC HPC Interactive HPC Supercomputing UCloud UCloud status

Another milestone – 8000 users on DeiC Interactive HPC

Interactive HPC hits another milestone: There are now more than 8000 users! This is an increase of 1000 users during less than 3 months!

The activity on the platform has been sky-high during the past few weeks – possibly amplified by the many researchers who praised the platform and inspired others at the DeiC conference on the 7-8th of November.

Check out the story and read more about why the platform is so succesful at SDU eScience.

Kategorier
Conference DeiC Event HPC Interactive HPC Research Supercomputing UCloud

Video use case: HPC enlightens researchers in social sciences and humanities about human behavior

Sociologist Rolf Lyneborg Lund has trained an image AI using DeiCInteractive, which can help us understand how people perceive the concepts of “good” and “bad” neighbourhoods.

Visit deic.dk to view video use case from the 2023 DeiC Conference

Kategorier
UCloud UCloud status

Dec 4th. planned upgrade of the DeiC Interactive HPC infrastructure

On Monday, December 4th, we are performing a major upgrade to UCloud’s infrastructure. This means that the system will be down for most of the day. Go to the SDU eScience Center news page for more information on the update.

Kategorier
DeiC Interactive HPC Supercomputing UCloud

Supercomputing for computational linguistics and (social) media data

Supercomputing has long been associated with areas such as physics, engineering, and data science. However, researchers in humanities at Aarhus University are increasingly turning to supercomputing allowing them to delve into unexplored territories and discover new insights.
From analysing historical archives to simulating ancient civilizations to analysing social media data, supercomputing offers unique opportunities to generate insights and advance knowledge in humanities.

In this article series, we highlight three cases with humanities researchers from Aarhus University that illustrate the varied ways in which supercomputing is being used in humanities research.


While many studies are based on historical data, the research of Rebekah Baglini, Associate Professor in Linguistics at Interacting Minds Centre, Aarhus University is an excellent example of supercomputing applied to recent data in the humanities.   

She employs supercomputing in her current projects involving the collection, processing, and annotation of large-scale media data from traditional and social media sources. By examining this diverse range of data, Rebekah Baglini investigates causal inference and causal reasoning from a linguistic perspective. Her research involves the application of semantic model theory and computational methods to uncover insights in linguistics.

“I aim to develop computationally assisted methods to identify trends in the discursive and informational landscape around topics concerning media dynamics, public health and science communication, crisis and risk messaging, as well as the emergence of mis- and dis-information”. 

Rebekah Baglini, Associate Professor in Linguistics, Aarhus University

In addition to her linguistic investigations, Rebekah Baglini also strives to enhance the existing computational language models for multilingual natural language processing (NLP), with a particular focus on under-resourced languages.   

Humanities researchers should know the affordances of High-Performance Computing  

Rebekah’s pursuits demonstrate the continuous progress of digital humanities and the ongoing efforts to enhance existing language models, ultimately leading to a deeper understanding in the field of humanities.   

“My earlier work involved smaller language corpora and didn’t require HPC resources. However, as my projects grew in scale, involving large corpus creation, the relevance of supercomputing increased. I recognise that not all projects require HPC. However, it is useful for researchers to gain training in the affordances of HPC, parallel compute, and large models so they know what’s possible, and can potentially take on projects of larger scale or make use of state-of-the-art resources for data processing, modelling, and simulation.”  

Rebekah Baglini, Associate Professor in Linguistics, Aarhus University

This explains why NLP and Computational Linguistics have become integral to Rebekah Baglini’s teaching, enabling her to offer students practical exposure to working with extensive datasets and large language models, fostering hands-on learning opportunities. She emphasises that there is a significant learning curve when delving into the realm of supercomputing. 

“There has definitely been a learning curve involved in the transition from locally maintained clusters to the cloud based Interactive HPC platform, particularly because it is also a somewhat new service without comprehensive documentation, and my affiliation with Center for Humanities Computing at Aarhus University has been a valuable resource as there is a great deal of collective experience and knowledge to draw on in the community”.  

Rebekah Baglini, Associate Professor in Linguistics, Aarhus University

Rebekah has used the DeiC Interactive HPC system for storing and analysing news and social media in the national research project HOPE that monitored Scandinavian user behaviour during Covid-19.

Today she uses the system in her own AUFF Starting Grant Project CROSS: Causal Reasoning and Online Science Scepticism to train language models to identify and analyse emerging narratives that undermine or counteract verified messaging on scientific findings and public health recommendations.


You have just read the third and final case in our series on Interactive HPC usage in humanities.
Through these compelling cases it becomes evident that supercomputing in humanities research is transforming traditional approaches, empowering researchers to uncover new insights and deepen our understanding of the field.  It opens doors to interdisciplinary collaborations and expands the possibilities for data analysis and modelling, ultimately shaping the future of digital humanities. 

Check out the other two cases featuring Katrine Frøkjær Baunvig and the case of creating a Grundtvig-artificial intelligence using HPC and Iza Romanowska and the case of Utilizing agent-based models in archaeological data.

Kategorier
DeiC Interactive HPC Supercomputing UCloud UCloud status

Interactive HPC reaches 7000 users

What an accomplishment after less than 3 years of running the DeiC Interactive HPC service – there are now more than 7000 users on UCloud!

And not only that – we are seeing an increase in the number of active users per quarter.

Graph: the number of users on UCloud. UCloud has been used as the basis of the national HPC service, DeiC Interactive HPC, since November 2020. DeiC Interactive HPC is provided by a consortium of universities consisting of Aalborg University, Aarhus University and the University of Southern Denmark.

With so many users, we are also experiencing an extremely high utilization of the service. Over the last 6 months the average utilization was above 85%, with a peak utilization during working hours of more than 170 % of the total national capacity. 

“The DeiC Interactive HPC has been an incredible success among Danish researchers and students, to the extent that it is now one of the most popular HPC services in Europe, despite being a relatively small infrastructure. This innovative DeiC service has succeeded in democratizing HPC among all research disciplines, including humanities and social sciences. It has also been a very popular platform for teachers at universities, who now use it every year as part of their courses.”

Director of the SDU eScience Center, Prof. Claudio Pica.

“The surge in demand is a testament to the growing importance of interactive HPC in the national research ecosystem. It’s not just about capacity, but about making high-performance computing accessible and relevant to every field of study.”

Professor Kristoffer Laigaard Nielbo, head of Center for Humanities Computing, Aarhus University

“We are incredibly proud of DeiC interactive HPC’s success and we are excited for the future possibilities and perspectives.”

Lars Sørensen, Head of Digitalization, Aalborg University

This year, new hardware will be added to the service to accommodate the growing interest for GPU computing, which are highly requested amongst the DeiC Interactive HPC users. The new machines, which will be added both to the AAU and SDU datacenters, include compute nodes with 4 NVIDIA H100. This will have a significant impact on advancing research in Denmark.

This update was originally posted by the SDU eScience Center.