Aldridge Abaasa & Gautam Samriya: Open Science with Python and FOSS at the ICHEC

Supporting Open Science with Python and FOSS at the Irish Centre for High-End Computing. Aldridge Abaasa & Gautam Samriya The Irish Centre for High-End Computing (ICHEC) is a public body hosting Ireland’s supercomputing national service and data services supporting Irish and European research across climate, weather, health and the environment. To help scale our service delivery to account for increasing data-centric (including AI) processing needs, a new Platform Engineering team has been set-up. The team is focused on building tooling and platforms to support open and federated scientific research, with a heavy use of Python tooling and free and open-source software (FOSS). In this talk we’ll overview the design challenges and decisions we’ve made in the early stages of building out our platform, highlighting several Python-based tools we’re building to support: standardization and deployment of technical documentation and teaching material with Jupyter Books and MyST Markdown, for example: https://ichec-handbook.readthedocs.io/en/latest/src/frontmatter.html standardizing and securing the deployment of scientist-developed Django and FastAPI projects with pyproject.toml, container and CI/CD templates the development of toolkits to support rapid prototyping of web portals and data pipelines using Pydantic, FastAPI, Django and Apache Airflow Attendees may be interested in the following aspects of our talk: the use of FOSS and an open development process in the Irish public sector: https://git.ichec.ie/platform-engineering the challenges of supporting a diverse array of scientific workflows and tools with a small team using automation experiences bringing modern Python and Software Engineering practices to an academic environment Talk room 2 (200 people) Sat 4:50 pm - 5:20 pm