The DeiC Interactive HPC consortium is thrilled to announce that the service, powered by the UCloud software, has reached another significant milestone: 15,000 users. This achievement underscores the service’s growing popularity and its pivotal role in advancing digital research through user-friendly supercomputing access.
Since its inception, DeiC Interactive HPC has been dedicated to providing researchers with seamless access to high-performance computing (HPC) resources. The service’s intuitive interface and capabilities have revolutionized the way researchers approach complex computational tasks, making HPC accessible to a broader audience.
DeiC Interactive HPC’s success is a testament to the collaborative efforts of the consortium that operates the service. Together, we have created an environment where researchers from diverse fields can leverage cutting-edge technology to drive innovation and discovery.
As DeiC Interactive HPC and UCloud continues to grow, we remain committed to enhancing the service’s features and expanding its reach. The goal is to empower even more researchers with the tools they need to tackle some of the most pressing scientific challenges of our time.
By Jasper Riis-Hansen and Line Ejby Sørensen, Center for Humanities Computing (CHC), Aarhus University
DeiC Interactive HPC – UCloud plays a central role in the Danish Foundation Models (DFM) project, which forms part of the Danish government’s strategic initiative for artificial intelligence.
Danish Foundation Models (DFM) is supported by the Ministry of Digital Affairs as part of the national AI strategy, which aims to ensure that Denmark has access to advanced and tailored language models. These models are intended for use across a wide range of sectors, including healthcare, public administration, education, and private enterprise.
A shared digital environment
The DFM project brings together Danish universities, research institutions, and industry partners in a joint effort to establish new standards for ethically responsible and inclusive AI language technologies.
The project is a collaboration between Aarhus University, the University of Copenhagen, the University of Southern Denmark, and the Alexandra Institute. DeiC Interactive HPC – UCloud plays a vital role in this work by providing high data security, scalable computing power, and, not least, an accessible, secure, national cloud platform that enables collaboration among project partners.
“UCloud forms the foundation for an important step in research digitalisation, as the platform provides easy access to computing power, enabling scalable data analysis and modelling, while also offering a secure environment for handling sensitive data. The platform also facilitates collaboration across institutions and allows us to manage data access as needed. This is particularly relevant in the DFM project, which includes many partners participating at different levels.” Postdoc Kenneth Enevoldsen
Data security and computing power
Because AI models are often trained on sensitive data, it is crucial that data processing complies with both GDPR and Danish security standards. UCloud is ISO27001-certified and specifically designed to meet both Danish and EU requirements for secure data handling.
“In the DFM project, we work with very large amounts of data from a variety of sources – including sensitive data that the models are trained on – and this places high demands on data security. That is why UCloud is such a valuable tool for the project – precisely because of its high level of data security and access to scalable computing power.” Postdoc Kenneth Enevoldsen
Although DFM also makes use of European supercomputers such as LUMI in Finland and Leonardo in Italy, the day-to-day operations of the project are heavily reliant on UCloud. In addition to being a springboard for high-performance computing, UCloud also provides a secure and user-friendly platform with a wide range of accessible applications – all essential for daily research, collaboration, data processing, and innovation across the project’s interdisciplinary team.
Critical infrastructure for Danish AI development
DFM’s principal investigators, Kristoffer Nielbo and Peter Schneider-Kamp, emphasise that the robust digital research environment provided by DeiC Interactive HPC – UCloud constitutes critical infrastructure. It streamlines workflows, enhances collaboration, and accelerates the development of both language and AI technologies.
“Without UCloud, the DFM project would have had to develop this type of digital infrastructure itself – with significant time and financial costs. The platform’s role in the project clearly demonstrates how robust, collaborative digital research environments are essential to Denmark’s AI strategies.”
FACTS: Danish Foundation Models (DFM)
Danish Foundation Models (DFM) is a collaborative project involving Aarhus University, the University of Copenhagen, the University of Southern Denmark, and the Alexandra Institute.
The project is supported by the Ministry of Digital Affairs with a grant of DKK 30.7 million and aims to develop advanced language models with open access and transparent development processes.
The models are specifically tailored to Danish and other Scandinavian languages and cultures and are intended for use across sectors such as healthcare, public administration, education, and business.
DFM seeks to establish a new standard for ethically responsible, inclusive, and transparent AI language technology – for the benefit of both Danish society and the research community.
A new feature has been launched on the innovative UCloud platform, designed to provide a seamless and efficient learning experience for both educators and students. If you are teaching a course at a Danish University and would like to have a setup ready to use for students with all the necessary tools pre-installed and easy access to lectures and teaching materials, the new UCloud course feature is perfect for you.
Cloud-Based Learning: A virtual “lab” for your class
UCloud leverages the power of cloud computing to offer a robust and scalable environment for courses. The new UCloud course feature means that you can focus on teaching while UCloud handles the infrastructure, ensuring a smooth and uninterrupted learning experience.
Whether you are teaching data science, machine learning, natural language processing or any other subject, UCloud supports a wide range of tools and applications. This flexibility allows you to integrate your preferred software and resources effortlessly.
“A course on UCloud is essentially like having a lab for the class. Everything needed is already installed and the students can easily choose the appropriate resources in terms of teaching materials and installation libraries,” says Dr. Federica Lo Verso, Computational Scientist at the SDU eScience Center and part of the Research Support Team.
Once the course is on UCloud, it can be found in the App Store in the section “Courses” under “Browse by category”.
An example of a “Course” selection is the one below which contains a course from AU. All the relevant software packages, notebooks, scripts etc. for the course are already ‘wrapped’ into the app, which allows students to access the full material quickly and seamlessly without having to install any software themselves.
For the full story about hosting courses on UCloud:
Join us for two free online workshops this December to explore how these tools can transform your work. Discover AI Applications on DeiC Interactive HPC – UCloud
Workshop 1: Introduction to AI Tools on DeiC Interactive HPC – UCloud
Date: December 10th
Time: 12:30–14:00
This beginner-friendly session will introduce you the basics of AI tools with a focus on transcription and text annotation. Learn how to use these tools to streamline tasks like analyzing text and creating datasets.
Highlights:
Intro to fundamental AI tools
Hands-on demonstrations
Live Q&A
Whether you’re familiar with DeiC Interactive HPC -UCloud or exploring DeiC Interactive HPC -UCloud for the first time, this workshop will provide practical skills to get started.
Workshop 2: Advanced AI Tool Development on DeiC Interactive HPC – UCloud
Date: December 11th
Time: 12:30–14:00
For experienced users ready to go deeper! Discover advanced tools like Nvidia Nemo and Triton to design and develop custom AI solutions.
Highlights:
Advanced AI application design
Tool showcases
Live Q&A
This workshop will focus on more advanced AI tools, offering researchers insights into designing and developing their own AI solutions. It will showcase the Nvidia apps, Nemo and Triton, available on DeiC Interactive HPC/UCloud, both specifically designed to support these efforts.
DeiC Interactive HPC provides researchers at Danish universities with access to a variety of AI applications on UCloud that enable them to accelerate their research through powerful and secure computational tools.
During two online workshops on December 10th and 11th, the DeiC Interactive HPC Consortium will introduce both new and experienced users to DeiC Interactive HPC/UCloud’s AI app portfolio.
The sessions are designed to equip researchers and students with the knowledge and skills needed to effectively harness DeiC Interactive HPC/UCloud’s AI tools for their research.
Feel free to share with colleagues and peers who might benefit. See you there!
With 10,000 users, DeiC Interactive HPC has established itself as one of Europe’s most popular HPC facilities, thanks to an unprecedented democratisation of access to advanced computing resources. These resources, once reserved for specialised research fields and technically adept specialists, are now accessible to any researcher with a dataset and a vision.
Through a newly developed, simple, and graphical user interface, DeiC Interactive HPC, also known as UCloud, makes it easier than ever to gain interactive access to supercomputing. This approach reduces technical barriers and enhances research collaboration by offering shared, easily accessible virtual environments. As a result, DeiC Interactive HPC supports dynamic and interdisciplinary research, accelerating research processes and promoting innovation in fields ranging from bioinformatics to digital humanities.
Democratising Access to HPC
The trend towards more interactive use of technology, including HPC, reflects efforts to make the STEM field more inclusive and accessible, mirroring broader societal changes towards diversity and inclusion in technology and science. DeiC Interactive HPC’s user-friendly approach has attracted a broad spectrum of users, including those from nearly all Danish universities and individuals with varying levels of technical expertise, notably many students.
“We are proud to highlight the growing diversity among DeiC Interactive HPC users, a development that further distinguishes DeiC Interactive HPC from traditional HPC systems. We see continuous growth in user numbers and are now celebrating surpassing 10,000 users across a very broad spectrum of research disciplines, which is impressive in the HPC field. Of these users, 50% are students, reflecting DeiC Interactive HPC’s success in attracting new users and serving as a bridge to larger European HPC facilities,” says Professor Kristoffer Nielbo, representing Aarhus University in the DeiC Interactive HPC Consortium.
Research AreasStudents
By simplifying access to supercomputers, DeiC Interactive HPC democratises powerful data processing resources, enabling a wider range of researchers and academics to conduct innovative research without the steep learning curve traditionally associated with HPC. This inclusivity fosters scientific collaboration and creativity, enriching the HPC community with a diversity of perspectives and ideas.
“We continuously work to improve DeiC Interactive HPC with a democratic approach, using user feedback to ensure our focus is in the right place. This is also reflected in our new update – UCloud version 2 – which aims to increase efficiency and improve the user experience for researchers. It is part of our DNA as an interactive HPC facility to always keep the user in mind and develop apps and user interfaces based on user needs. Therefore, we encourage our users to reach out to us with their wishes and ideas,” says Professor Claudio Pica, representing the University of Southern Denmark in the DeiC Interactive HPC Consortium.
Did You Know
– that DeiC Interactive HPC provides resources for developing large AI language models through initiatives such as Danish Foundation Models (DFM) and the new Danish Language Model Consortium?
– that nearly 80 apps are available via UCloud’s App Store, including the Chat-GPT-like app, Chat-UI, and transcription tools Transcriber and Whisper Transcription?
– that 25% of users on Interactive HPC come from the Social Sciences & Humanities, a unique figure as HPC traditionally caters almost exclusively to Natural Science, Health/Life Science, and Engineering?
An All Danish and Highly Secure System
Despite its internationally sounding name, UCloud, DeiC Interactive HPC is part of the Danish HPC landscape, funded by Danish universities and the Ministry of Education and Research. The increased focus on developing a new generation of highly user-friendly applications means that researchers and other university staff can now use intuitive applications for transcribing sensitive data via DeiC Interactive HPC.
“DeiC Interactive HPC has already developed applications based on the same transcription technology found online and made them available in a secure environment through the UCloud platform. These transcription applications are just the beginning of a series of targeted secure applications that do not require prior experience, and we are always open to user input and ideas that arise from their unique needs but often prove beneficial to many,” says Lars Sørensen, Head of Digitalisation, representing Aalborg University and CLAAUDIA in the DeiC Interactive HPC Consortium.
By making advanced data processing more accessible to researchers from various disciplines, DeiC Interactive HPC helps break down the technical barriers that previously limited access to these resources. With an increasing number of students and new users from diverse backgrounds combined with continuous engagement in user-centred innovation, DeiC Interactive HPC not only supports the academic community but also plays a crucial role in promoting a more inclusive and productive research environment.
New usersUniversities
For further information and high resolution graphics, contact: Kristoffer Nielbo, Director of Center for Humanities Computing, Aarhus University, 26832608 kln@cas.au.dk
About DeiC Interactive HPC (UCloud)
UCloud offers access to advanced tools such as quantum simulation apps and H100 GPUs as well as applications aimed at data analysis and visualisation.
In data analysis, Python and Jupyter notebooks are particularly prominent, catering to the interactive, ad hoc, and data-centric workflows common in the field. These tools are highly valued for their user-friendliness in handling rapidly changing software environments and offer rich user interfaces, a significant advantage compared to traditional HPC setups, which can be more complex or less flexible.
Furthermore, the integration of tools such as Conda for managing software packages, Jupyter notebooks, Rstudio, Coder, and Dask for parallel computing significantly enhances the usability of HPC resources for interactive and on-demand data processing needs. These tools help bridge the gap between the hardware of complex HPC systems and the user-friendly software environments that data scientists require.
DeiC Interactive HPC is excited to roll out the new User Interface on the UCloud platform, designed to simplify processes and enhance the user experience. The updated interface, serving 10,000 users (and growing), signifies the dedication to delivering an easy-to-use interface that provides researchers with access to advanced interactive computing power, along with comprehensive data analysis and visualisation tools.
“The launch of this new user interface marks a significant overhaul. Our team has meticulously redesigned every aspect, from its overall look-and-feel to the functionality of each page. Our primary objective has been to create an enhanced platform for users. We’re excited to see how researchers will benefit from the improved efficiency and usability when engaging with the platform,” says Dan Sebastian Thrane, Special Consultant at the eScience Center, University of Southern Denmark (SDU), and leader of the cloud team, which has been responsible for the development and implementation of the UI update.
Key changes of the new user interface include:
Restructured dashboard layout to prioritize important information.
Redesigned application catalogue with improved discoverability features.
Improved space utilization with keyboard control, infinite scroll and better performance.
File management now includes drag-select, drag-and-drop, and copy-paste for quicker access, along with a location bar for easy navigation.
New two-level sidebar navigation replaces the top navigation bar, making it easier to find and access sub-pages within specific categories.
Streamlined resource allocations integrate sub-projects, simplifying creation and management. The interface has been redesigned for improved organization and efficiency.
Job submission enhancements allow users to switch between different app flavors and receive notifications for job status changes.
The updated interface reflects extensive research and meticulous examination of every aspect of the user interface, with the goal of addressing common pain points and improving both the overall layout and user experience. Designed with a focus on simplicity, efficiency, and consistency, the new interface aims to empower users while maintaining the core workflow on UCloud. This ensures that researchers can seamlessly manage their data and run applications as they normally would.
All these enhancements mark a significant step forward in optimising the digital infrastructure and is available by May 14th 2024. For further details about the new user-interface, changes to accounting and a brand-new application catalog, visit UCloud.
Denmark has marked a significant milestone in computational research with the addition of 16 NVIDIA H100 GPUs to the DeiC Interactive HPC service, and 16 more are expected by the end of the year. The tender for the acquisition of the GPUs was awarded to Lenovo. This addition signifies a big leap forward for Danish researchers, who can now easily access the new GPUs through UCloud, and positions Denmark at the forefront of AI innovation. We recently had the privilege of talking with Dr. Valerio Rizzo, head of AI & SME at Lenovo’s EMEA (Europe, Middle East and Africa) division, about the AI revolution that is currently taking place and Lenovo’s role in the production of the world’s most powerful hardware for AI.
Collaboration between Lenovo and NVIDIA
NVIDIA is the company behind the industry-leading graphics processing unit (GPU), H100, currently the most sought-after hardware for AI and used extensively by some of the biggest AI companies in the world, including OpenAI, Microsoft and Google. H100 is generally 2-3 times faster than the previous A100 generation, and an impressive 30 times faster for AI workloads such as large language models (LLM). The recently announced supercomputer, Gefion, by Novo Nordisk Foundation (NNF) and the Export and Investment Fund of Denmark (EIFO) will make use of the same technology.
In the past, Danish researchers had to either search abroad or pay commercial cloud providers expensive fees to use these powerful machines. However, since January this year the 16 H100 GPUs have been available via the DeiC Interactive HPC service, provided by a consortium of universities consisting of Aarhus University (AU), Aalborg University (AAU) and the University of Southern Denmark (SDU). The H100 GPUs are hosted at the SDU data center and available via the user-friendly platform, UCloud, that powers the DeiC Interactive HPC service…
Streamline your workflow when using DeiC Interactive HPC
Have you ever experienced delays due to high demand for computing resources on UCloud (DeiC Interactive HPC)? The key to faster access and reducing system strain is efficient resource management.
Over-requesting can lead to unnecessary waiting because DeiC Interactive HPC operates by allocating resources to users as the requested resources become available, without the use of priority queues. Consequently, if you select a large machine for a relatively small task, you will need to wait for other tasks requested for these larger but fewer machines to finish, leading to prolonged waiting.
“Users with little or no experience in assessing the amounts of resources needed have a tendency to request more than they actually need. This causes unnecessary queues and frustration for other users. However, we also see experienced users choosing the large machines simply out of habit instead of starting small, and subsequently migrate to a larger machine only when necessary.”
Jes Elgin, Cloud Engineer at DeiC Interactive HPC
To avoid delays, users need to accurately assess and request only the necessary resources for their task. Starting with conservative estimates can expedite access and improve overall system efficiency.
“Choosing small will always give you a head start as there are more small machines, and you can always upgrade to a large machine if you need it. You don’t have to start over, and you won’t lose any data.”
Jes Elgin, Cloud Engineer at DeiC Interactive HPC
**TIP!** Did you know that the likelihood of obtaining a machine right away is higher the less resources you request?
So, choose your machine based on a qualified estimate of resources needed. If unsure start small and seek advice from experienced colleagues or the DeiC Front Office.
DeiC Interactive HPC has achieved another remarkable feat: it now has more than 9000 users! The graph shows the rapid and steady growth of the user base, which has tripled in just two years. More about this new milestone here
A few days ago, Center for Humanities Computing at Aarhus Universitet had the pleasure of inviting Interactive HPC Consortium colleagues from CLAAUDIA, Aalborg Universitet and the SDU eScience Center to a workshop day at the wonderful Moesgaard Museum.
“We have these collaborative workshops every six months to stay informed and improve the Interactive HPC service, but also to stay connected with what we consider to be close colleagues from the other two universities. Meeting up in person adds an essential layer to this cross-university collaboration, positively impacting the operation and development of the DeiC Interactive HPC facility. Through these gatherings, innovations are cultivated collectively among partners, each contributing their unique perspective. Given the consistently productive outcomes of these workshops resulting in several working groups that tackle delegated tasks in the coming months, we are considering expanding to a two-day workshop next time to facilitate more in-depth discussions and collaboration,” says Kristoffer Nielbo, Director of Center for Humanities Computing.
This recent workshop hosted no fewer than 25 people who convened to discuss the general status, infrastructure, education, and branding of DeiC Interactive HPC. The day concluded perfectly with a visit to the exhibitions at Moesgaard Museum and its grounds. Everyone looks forward to the next Interactive HPC workshop hosted by CLAAUDIA in wonderful Aalborg.
