Sociologist Rolf Lyneborg Lund has trained an image AI using DeiCInteractive, which can help us understand how people perceive the concepts of “good” and “bad” neighbourhoods.
Visit deic.dk to view video use case from the 2023 DeiC Conference
Author: line
AI companies around the world are scrambling to get their hands on the latest and most powerful NVIDIA GPU called H100. The biggest costumers include OpenAI, Microsoft and Google. Now, 16 NVIDIA H100 GPUs have landed at SDU, ready to be integrated into the DeiC Interactive HPC system. With the arrival of 4 servers with 4 H100 GPUs each at SDU, Danish researchers will be able to access the same hardware coveted by some of the biggest tech companies in the world.
Image: NVIDIA Hopper H100 GPU. Credit: NVIDIA
On Monday, December 4th, we are performing a major upgrade to UCloud’s infrastructure. This means that the system will be down for most of the day. Go to the SDU eScience Center news page for more information on the update.
Supercomputing has long been associated with areas such as physics, engineering, and data science. However, researchers in humanities at Aarhus University are increasingly turning to supercomputing allowing them to delve into unexplored territories and discover new insights.
From analysing historical archives to simulating ancient civilizations to analysing social media data, supercomputing offers unique opportunities to generate insights and advance knowledge in humanities.
In this article series, we highlight three cases with humanities researchers from Aarhus University that illustrate the varied ways in which supercomputing is being used in humanities research.
While many studies are based on historical data, the research of Rebekah Baglini, Associate Professor in Linguistics at Interacting Minds Centre, Aarhus University is an excellent example of supercomputing applied to recent data in the humanities.
She employs supercomputing in her current projects involving the collection, processing, and annotation of large-scale media data from traditional and social media sources. By examining this diverse range of data, Rebekah Baglini investigates causal inference and causal reasoning from a linguistic perspective. Her research involves the application of semantic model theory and computational methods to uncover insights in linguistics.
“I aim to develop computationally assisted methods to identify trends in the discursive and informational landscape around topics concerning media dynamics, public health and science communication, crisis and risk messaging, as well as the emergence of mis- and dis-information”.
Rebekah Baglini, Associate Professor in Linguistics, Aarhus University
In addition to her linguistic investigations, Rebekah Baglini also strives to enhance the existing computational language models for multilingual natural language processing (NLP), with a particular focus on under-resourced languages.
Humanities researchers should know the affordances of High-Performance Computing
Rebekah’s pursuits demonstrate the continuous progress of digital humanities and the ongoing efforts to enhance existing language models, ultimately leading to a deeper understanding in the field of humanities.
“My earlier work involved smaller language corpora and didn’t require HPC resources. However, as my projects grew in scale, involving large corpus creation, the relevance of supercomputing increased. I recognise that not all projects require HPC. However, it is useful for researchers to gain training in the affordances of HPC, parallel compute, and large models so they know what’s possible, and can potentially take on projects of larger scale or make use of state-of-the-art resources for data processing, modelling, and simulation.”
Rebekah Baglini, Associate Professor in Linguistics, Aarhus University
This explains why NLP and Computational Linguistics have become integral to Rebekah Baglini’s teaching, enabling her to offer students practical exposure to working with extensive datasets and large language models, fostering hands-on learning opportunities. She emphasises that there is a significant learning curve when delving into the realm of supercomputing.
“There has definitely been a learning curve involved in the transition from locally maintained clusters to the cloud based Interactive HPC platform, particularly because it is also a somewhat new service without comprehensive documentation, and my affiliation with Center for Humanities Computing at Aarhus University has been a valuable resource as there is a great deal of collective experience and knowledge to draw on in the community”.
Rebekah Baglini, Associate Professor in Linguistics, Aarhus University
Rebekah has used the DeiC Interactive HPC system for storing and analysing news and social media in the national research project HOPE that monitored Scandinavian user behaviour during Covid-19.
Today she uses the system in her own AUFF Starting Grant Project CROSS: Causal Reasoning and Online Science Scepticism to train language models to identify and analyse emerging narratives that undermine or counteract verified messaging on scientific findings and public health recommendations.
You have just read the third and final case in our series on Interactive HPC usage in humanities.
Through these compelling cases it becomes evident that supercomputing in humanities research is transforming traditional approaches, empowering researchers to uncover new insights and deepen our understanding of the field. It opens doors to interdisciplinary collaborations and expands the possibilities for data analysis and modelling, ultimately shaping the future of digital humanities.
Check out the other two cases featuring Katrine Frøkjær Baunvig and the case of creating a Grundtvig-artificial intelligence using HPC and Iza Romanowska and the case of Utilizing agent-based models in archaeological data.
What an accomplishment after less than 3 years of running the DeiC Interactive HPC service – there are now more than 7000 users on UCloud!
And not only that – we are seeing an increase in the number of active users per quarter.
Graph: the number of users on UCloud. UCloud has been used as the basis of the national HPC service, DeiC Interactive HPC, since November 2020. DeiC Interactive HPC is provided by a consortium of universities consisting of Aalborg University, Aarhus University and the University of Southern Denmark.
With so many users, we are also experiencing an extremely high utilization of the service. Over the last 6 months the average utilization was above 85%, with a peak utilization during working hours of more than 170 % of the total national capacity.
“The DeiC Interactive HPC has been an incredible success among Danish researchers and students, to the extent that it is now one of the most popular HPC services in Europe, despite being a relatively small infrastructure. This innovative DeiC service has succeeded in democratizing HPC among all research disciplines, including humanities and social sciences. It has also been a very popular platform for teachers at universities, who now use it every year as part of their courses.”
Director of the SDU eScience Center, Prof. Claudio Pica.
“The surge in demand is a testament to the growing importance of interactive HPC in the national research ecosystem. It’s not just about capacity, but about making high-performance computing accessible and relevant to every field of study.”
Professor Kristoffer Laigaard Nielbo, head of Center for Humanities Computing, Aarhus University
“We are incredibly proud of DeiC interactive HPC’s success and we are excited for the future possibilities and perspectives.”
Lars Sørensen, Head of Digitalization, Aalborg University
This year, new hardware will be added to the service to accommodate the growing interest for GPU computing, which are highly requested amongst the DeiC Interactive HPC users. The new machines, which will be added both to the AAU and SDU datacenters, include compute nodes with 4 NVIDIA H100. This will have a significant impact on advancing research in Denmark.
This update was originally posted by the SDU eScience Center.
Supercomputing has long been associated with areas such as physics, engineering, and data science. However, researchers in humanities at Aarhus University are increasingly turning to supercomputing allowing them to delve into unexplored territories and discover new insights.
From analysing historical archives to simulating ancient civilizations to analysing social media data, supercomputing offers unique opportunities to generate insights and advance knowledge in humanities.
In this article series, we highlight three cases with humanities researchers from Aarhus University that illustrate the varied ways in which supercomputing is being used in humanities research.
Iza Romanowska is assistant professor at Aarhus University working at the Aarhus Insitute of Advanced Studies where she studies complex ancient societies.
To overcome the challenges of limited data from these ancient societies, researchers have started utilizing Agent-based model (ABM) sometimes enabled by supercomputing. ABMs are computational models that simulate the behaviour and interactions of individual entities, known as agents, within a specified environment or system. Each agent in the model is typically programmed with a set of rules or algorithms that control its behaviour, decision-making processes, and interactions with other agents and the environment.
ABM is a valuable tool in archaeology that allows us to simulate and analyse the behaviours and interactions of individuals or groups in past societies, and the use of ABM allows comparison of the model against real archaeological data.
Assistant Professor Iza Romanowska
In one of Iza Romanowska’s studies, agent-based modelling (ABM) made it possible for her and her colleagues to explore the Roman economy in the context of long-distance trade, using ceramic tableware to understand the distribution patterns and buying strategies of traders in the Eastern Mediterranean between 200 BC and AD 300.
The potential of supercomputing in humanities becomes particularly evident when studying such societies with only limited data as experienced by archaeologists and historians. Iza Romanowska explains that the availability of data is limited in her field compared to other disciplines, stating that while social scientists studying more contemporary populations have access to abundant amounts of data such as the number of traders, transactions, and values, “we have none of this information.” Therefore, the use of HPC has been essential for her research.
ABM as methodological tool necessitates running the simulation many times, and by many, I mean eight hundred thousand times, and that is possible with a laptop… if one plans to be doing their Ph.D. for 500 years. Supercomputing is bigger, faster, better without any qualitative change in terms of the research.
Assistant Professor Iza Romanowska
Using a high-performance computer like the DeiC Interactive HPC system enhances the scalability and speed of ABMs, allowing researchers to gain deeper insights into the behavior and outcomes of complex systems. The DeiC Interactive HPC facility hosts out-of-the-box tools, like NetLogo, for working with ABM. Researchers can also use ABM frameworks for Python or R in one of the many development apps like JupyterLab or Coder.
Supercomputing and coding as research tools advance humanities research
While humanities data in general is plentiful and can be analysed effectively, Iza Romanowska finds that there is a gap in understanding the underlying processes that generate the observed patterns, resulting in underdeveloped explanatory frameworks. Her point is that the lack of formal tools for theory building and testing remains a major disciplinary issue.
“Within humanities including archaeology and history, data analysis is well-established. However, there’s a kind of fundamental disciplinary problem with that we don’t have or use many computational tools for theory building and theory testing. Supercomputing as a tool for the humanities can contribute to fill this gap and strengthen theory building and ultimately it can advance the field of humanities research.”
Assistant Professor Iza Romanowsk
Iza Romanowska believes that more people in humanities should learn to code to take advantage of the possibilities offered by their data. She suggests that supercomputing can be a natural progression from this. While many humanities researchers may not feel like they need supercomputing, perhaps they are simply not asking questions that could benefit from high-performance computing (HPC).
I would especially encourage junior researchers in the humanities to embrace supercomputing. It never hurts to acquire a skill, and many of these tools are becoming so easily available that it’s almost a shame to not use them.
You have just read the second of three cases in our series on Interactive HPC usage in humanities.
Through these compelling cases it becomes evident that supercomputing in humanities research is transforming traditional approaches, empowering researchers to uncover new insights and deepen our understanding of the field. It opens doors to interdisciplinary collaborations and expands the possibilities for data analysis and modelling, ultimately shaping the future of digital humanities.
Stay tuned for our third case featuring Rebekah Baglini representing her field of linguistics and check out the first case featuring Katrine Frøkjær Baunvig and the case of creating a Grundtvig-artificial intelligence using HPC
Categories
Apply for HPC resources
Researchers at a Danish university have various options for gaining access to computing power at both Danish and international HPC facilities. Front office personnell, please inform your users that the fall call H1-2024 is now open for applications for access to the e-ressources.
Information about the call is found on DeiC’s website.
Beyond Tradition
Unveiling the Uses of Supercomputing in Humanities.
Supercomputing has long been associated with areas such as physics, engineering, and data science. However, researchers in humanities at Aarhus University are increasingly turning to supercomputing allowing them to delve into unexplored territories and discover new insights.
From analysing historical archives to simulating ancient civilizations to analysing social media data, supercomputing offers unique opportunities to generate insights and advance knowledge in humanities.
In this article series, we highlight three cases with humanities researchers from Aarhus University that illustrate the varied ways in which supercomputing is being used in humanities research.
Katrine Frøkjær Baunvig, head of the Grundtvig Center at Aarhus University has used supercomputing as a methodological approach, and it has led her to non-trivial conclusions that significantly impact our understanding of of 19th-century nation builder and prominent pastor N.F.S. Grundtvig ‘s vast body of works and his immense influence on Danish culture.
In order to conduct a certain type of text mining, so-called word embeddings, she has created an artificial intelligence of Grundtvig, enabling a comprehensive analysis of his over 1000 works and 8 million words, resulting in unprecedented insights.
This approach has ushered in a completely new era in Grundtvig research, according to Katrine Frøkjær Baunvig. She dismisses the criticism of digital humanities sceptics who argue that word embedding fails to consider the surrounding context of words.
“This type of rejection is prevalent only among researchers who have not taken the time to understand or familiarize themselves with the current state and level of the research. When creating a word embedding, I obtain a vast mapping of a given word’s extensive association structure. Therefore, I can clearly discern different semantic focal points and contexts where the word appears in Grundtvig’s body of work. This is precisely what allows me to gain an overview.”
Katrine Frøkjær Baunvig, Head of the Grundtvig Center at Aarhus University
Katrine Frøkjær Baunvig opted to form a research partnership with the Center for Humanities Computing at Aarhus University. Her best advice for other researchers going into supercomputing in the humanities is to team up with the right people.
“Stepping into the world of supercomputing requires an approach to work processes that, in my opinion, represents a new trend in the humanities, namely, interdisciplinary collaborations and team-based publishing. Someone takes care of what is typically called the domain expert area – in this case, knowledge of Grundtvig’s authorship – while others handle the more technical aspects of execution.”
Katrine Frøkjær Baunvig, Head of the Grundtvig Center at Aarhus University
She also emphasises the importance of comprehending the workings of the tools to better harness the power of supercomputing.
“Even if you may not be able to train your algorithm yourself, it can be very practical to devote time and energy to obtain an operational understanding of the steps involved in creating a Grundtvig-artificial intelligence and the various types of applications such an intelligence can be used for.”
Katrine Frøkjær Baunvig, Head of the Grundtvig Center at Aarhus University
With years of experience in using supercomputing in her research, Katrine plans to continue using it and encourages others to do so when it seems fit. Especially in times where humanities research is often dismissed as lacking scientific rigor, Katrine Frøkjær Baunvig sees an opportunity to make an impact. With a keen sense of responsibility to bring her field forward, she is determined to prove that humanities research can be just as methodical and rigorous as research in any other discipline.
“Researchers who have pioneering eagerness should explore supercomputing as it can give them a head start by venturing into “blue ocean” territory.”
Katrine Frøkjær Baunvig, Head of the Grundtvig Center at Aarhus University
Katrine Frøkjær Baunvig has used the DeiC Interactive HPC system for a range of NLP tasks such as linguistic normalisation of historical Danish, semantic representation learning and inference, and finally, historical chat bot development based on custom Large Language Model for Danish.
You have just read the first of three cases in our series on Interactive HPC usage in humanities.
Through these compelling cases it becomes evident that supercomputing in humanities research is transforming traditional approaches, empowering researchers to uncover new insights and deepen our understanding of the field. It opens doors to interdisciplinary collaborations and expands the possibilities for data analysis and modelling, ultimately shaping the future of digital humanities.
Stay tuned for our second and third case featuring Iza Romanowska and Rebekah Baglini representing their fields of archaeology and linguistics .
DeiC Interactive HPC consisting of Aalborg University, Aarhus University, and University of Southern Denmark has been at the forefront of cloud and interactive high-performance computing in Denmark for several years. Their commitment to information security and compliance with international standards, including their ISO 27001 certifications, has been a key factor in their success.
In fact, DeiC Interactive HPC was the first HPC facility in Denmark to obtain an ISO 27001 certification, which is an internationally recognised standard for information security management systems (ISMS). The certification provides a framework for organisations to manage and protect their information assets, and it requires a rigorous process of assessment and ongoing monitoring to ensure compliance with the standard.
A Commitment to Information Security
Recently, the University of Southern Denmark announced that they have successfully renewed their ISO 27001 certification three years after they first obtained it in 2020. This recertification demonstrates the university’s ongoing commitment to information security and compliance with international standards.
“We are very proud to have received this renewal of our ISO 27001 certification. It is a testament to our ongoing efforts to ensure the highest levels of security and protection for our data and systems.”
Claudio Pica, CEO of DeiC National HPC center.
Both Aalborg University and the University of Southern Denmark have held ISO 27001 certifications for several years, demonstrating their commitment to maintaining the highest levels of security and compliance in their operations. This commitment has been particularly important in light of new regulations such as the General Data Protection Regulation (GDPR), which require organisations to take a proactive approach to data protection and privacy. Increasing threats from cyber attacks and data breaches also highlight the importance of taking proactive steps to protect data and systems from potential attacks.
Read the SDU eScience story for a detailed walk-through of the process of obtaining the ISO 27001 certification.
Dansk version:
Interactive HPC lever op til højeste internationale standarder med ISO 27001
DeiC Interactive HPC bestående af Aalborg Universitet, Aarhus Universitet og Syddansk Universitet været førende inden for cloud og interaktiv high-performance computing i Danmark i flere år. Deres engagement i informationssikkerhed og overholdelse af internationale standarder, herunder deres ISO 27001-certificeringer, har været en nøglefaktor i deres succes.
Faktisk var DeiC Interactive HPC de første i Danmark til at opnå en ISO 27001-certificering, som er en internationalt anerkendt standard for informationssikkerhedsstyringssystemer (ISMS). Certificeringen udstikker retningslinjer til organisationer i forhold til administration og beskyttelse af deres informationsaktiver, og den kræver en streng proces med løbende vurdering og overvågning for at sikre overholdelse af standarden.
Proaktiv tilgang til databeskyttelse og privatliv
For nylig meddelte Syddansk Universitet, at de med succes har fornyet deres ISO 27001-certificering tre år efter, de første gang opnåede den i 2020. Denne gencertificering demonstrerer universitetets løbende engagement i informationssikkerhed og overholdelse af internationale standarder.
“Vi er meget stolte over at have modtaget denne fornyelse af vores ISO 27001-certificering. Det er et vidnesbyrd om vores igangværende bestræbelser på at sikre det højeste niveau af sikkerhed og beskyttelse af vores data og systemer.”
Claudio Pica, CEO for DeiCs nationale HPC center
Både Aalborg Universitet og Syddansk Universitet har haft ISO 27001-certificeringer i flere år, hvilket viser deres engagement i at opretholde det højeste niveau af sikkerhed og compliance i deres drift. Denne forpligtelse har været særlig vigtig i lyset af nye regler såsom den generelle databeskyttelsesforordning (GDPR), som kræver, at organisationer tager en proaktiv tilgang til databeskyttelse og privatliv. Stigende trusler fra cyberangreb og databrud synliggør ligeledes vigtigheden af at tage proaktive skridt for at beskytte data og systemer mod potentielle angreb.
Se nyheden fra SDU eScience for en detaljeret gennemgang af processen med at opnå ISO 27001 certificeringen (på engelsk).
One minute!
That’s how long it took to set up the new SSH access to DeiC Interactive HPC applications.
If SSH is of interest to you, you probably know that DeiC Interactive HPC applications have recently experienced limitations in providing a reliable and scalable solution for accessing their services using Secure Shell Protocol (SSH).
The challenges were attributed to a limited number of available IP addresses from the common pool on their platform, along with the implementation of a more scalable solution. The latter proved to be burdensome, as acquiring multiple new IP addresses would not provide the scalability required.
However, DeiC Interactive HPC has launched a new solution for Secure Shell Protocol access that eliminates the need for multiple IP addresses. This new solution is based on ports which are much more scalable. Therefore, users can now access DeiC Interactive HPC applications using SSH with ease.
To access this new solution, users only need to create a private/public key or use an existing one and add the public key to their account at Interactive HPC. Then select one of the supported applications and follow the documentation. Supported applications include AlmaLinux Xfce vJun2023, Rsync v3.2.7, Terminal Ubuntu vJun2023, Terminal Debian vJun2023, Terminal AlmaLinux vJun2023, Ubuntu Xfce vJun2023, and JupyterLab v4.0.2. Soon to be added to this list are RStudio and all the Coder applications.
With this new solution in place, users can now enjoy pure command-line bliss without any limitations or challenges:
