Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

make compute centres and IT Departments to IT Units #85

Merged
merged 10 commits into from
Jan 24, 2025
37 changes: 18 additions & 19 deletions paper.tex
Original file line number Diff line number Diff line change
Expand Up @@ -387,14 +387,13 @@ \subsection{Module 5: Create a Network of Institutional Partners}%
However, note that as research organisations can differ widely from one another, so can the tasks and even existence of the entities below.
Arguments and conclusions below have to be adapted to specific circumstances when applying them to specific environments.

All research institutions in Germany can use the services provided by a \textbf{computing centre} in one form or another.
At the very least, these are the service providers that deal with the every-day IT-need of the institution:
Internet access, Email, Web\todo{magi: web presence?}, central administration of computers (at least that of administrative staff), etc.
Typically, the assigned tasks of the computing centre are not research-driven, or also the staff does not have a research background\todo{magi: I would drop the second part of this sentence as you can't categorically say where computing staff are coming from.}.

However, research software often has to work within the environment provided by the computing centre.
A central RSE unit can help to either adapt the research software or even the environment such that the needs of researchers can be met.
Usually this requires a level of engagement and understanding of the underlying research concepts that the staff of the computing centre cannot provide alone.
All research institutions in Germany can use the services provided by a central \textbf{IT unit} in one form or another.
The central IT unit typically looks after common compute and storage infrastructure in data centres and associated network infrastructure.
They also provide software services such Email, web services, databases and administer standard desktops and laptops (at least for administrative staff).
However, research software often has to work within the environment provided by the IT unit.
A central RSE unit can help researchers adapt their software to run on central services where necessary.
RSEs can also work with central IT staff to provide IT infrastructure well suited for research projects.
Usually, this requires a level of engagement and understanding of both the underlying research concepts and IT infrastructure that the staff of the IT unit or the researchers cannot provide alone.

If available, a second important partner is a scientific \textbf{library}, which has already gained tasks much beyond the preservation and organisation of publications on physical paper for quite some time.
Besides digital forms of rather traditional publications, these more and more include digital data and recently also software publications, their discovery and citation.
Expand All @@ -407,7 +406,7 @@ \subsection{Module 5: Create a Network of Institutional Partners}%
Thus, a close collaboration between RSE and RDM groups helps everyone: both RSE and RDM groups by being able to offer a more comprehensive service than when working alone, as well as the researcher, who benefits from receiving this single coordinated service, instead of dealing with two independent entities.
The question whether RSE and RDM should be located in two separate groups or should be combined in one common group is intentionally left open, as the answer depends on local, pre-existing circumstances.

Some research institutions might host a dedicated \textbf{HPC group}, maybe even independent of the computing centre.
Some research institutions might host a dedicated \textbf{HPC group} which may or may not be part of the central IT unit.
HPC is an RSE-related field, so HPC groups might already provide training, consulting and funding opportunities in this area.
At the same time, HPC by nature focuses on highly efficient, many-core, if possible parallel computations.
The challenges of an average researchers often start a long way before reaching that level, and they never might need to.
Expand All @@ -416,23 +415,23 @@ \subsection{Module 5: Create a Network of Institutional Partners}%
\subsection{Module 6: RSE Infrastructure Provisioning}%
\label{sec:infrastructure}

IT and (potentially high-performance) computing infrastructure provisioning is usually the purview of an institution's IT department and/or a computing centre\todo{magi: what's the difference between IT department and computing centre, I would contract}.
IT and (potentially high-performance) computing infrastructure provisioning is usually the purview of an institution's IT unit.
However, a central RSE unit can provide extra services by acting as an intermediary for RSE infrastructure and by hosting pilot instances of new tools and services.
IT departments typically provide the service for hosting and accessing IT infrastructures, including services that facilitate the work of RSEs.
Central RSE units are a link between the central services offered either by IT departments, computing centres or over-archingly available services on one side,
IT departments typically only provide the service for hosting and accessing IT infrastructures, such as RSE infrastructures.
Central RSE units are a link between the central services offered either by IT units or over-archingly available services on one side,
and RSEs in spokes on the other, offering documentation, training and best-practices to efficiently and effectively use available services and comply with established processes.

Furthermore, the central RSE unit can offer consulting for RSEs in spokes to guide selection processes of the tools and services best suited for each project.
This holds for existing RSE, or more general IT, infrastructure.
However, as scientists are working, by definition, at the cutting edge, they will often need or want to use the newest tools.
When such a need is identified in the course of a consultation, a central RSE unit can set up and provide access to pilot instances to evaluate these tools.
This evaluation will specifically consider a wider applicability of the tool, with the aim of handing over administration of widely required tools and services to, \eg{}, the central IT department.
This evaluation will specifically consider a wider applicability of the tool, with the aim of handing over administration of widely required tools and services to, \eg{}, the central IT unit.

It is crucial that the RSE unit does not compete with the IT department, nor should it duplicate existing infrastructure.
On the contrary, the RSE unit should act as a multiplier for the RSE-relevant services offered by the IT department, helping RSEs to discover and use existing and upcoming services.
Similarly, the RSE unit can promote the use of the available computing infrastructure provided by a computing centre, helping with the support of the users when RSE-related questions in this context arise.
Once the mutual collaboration between RSE unit, IT department and computing centre has been established, a stricter policy-based involvement of the RSE unit for infrastructure requests is envisioned.
Overall, by acting as an intermediary for RSE infrastructure related requests, the central RSE unit can augment the IT department and the computing centre, providing RSEs in spokes with the specific support they require.
It is crucial that the RSE unit does not compete with the IT unit, nor should it duplicate existing infrastructure.
On the contrary, the RSE unit should act as a multiplier for the RSE-relevant services offered by the IT unit, helping RSEs to discover and use existing and upcoming services.
Similarly, the RSE unit can promote the use of the available computing infrastructure provided by an IT unit, helping with the support of the users when RSE-related questions in this context arise.
Once the mutual collaboration between an RSE unit and an IT unit has been established, a stricter policy-based involvement of the RSE unit for infrastructure requests is envisioned.
Overall, by acting as an intermediary for RSE infrastructure related requests, the central RSE unit can augment the central IT unit, providing RSEs in spokes with the specific support they require.

\subsection{Module 7: Research Software Engineering Research}%
\label{sec:rseresearch}
Expand Down Expand Up @@ -587,7 +586,7 @@ \subsubsection{Developing a Business Plan}

A rather difficult and crucial question can be the positioning of the RSE unit within the organisational structure of the institution.
A canonical place would be a new subunit of an existing unit close to software,
training services and computing such as the institution's IT department, the computing centre or the library.
training services and computing such as the local or central IT unit or the library.
Since most institutions already have an RDM unit, it seems natural to add the RSE unit as a parallel structure.
Another choice for the parent unit, particularly at universities, is the faculty for computer science.
Determining the best place may involve discussions with several stakeholders at the institution and can already be beneficial for creating a
Expand Down
Loading