LISA Pipeline Runner Dashboard

Guardado en:
Detalles Bibliográficos
Publicado en:PQDT - Global (2025)
Autor principal: Jakovleva, Marija
Publicado:
ProQuest Dissertations & Theses
Materias:
Acceso en línea:Citation/Abstract
Full Text - PDF
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!

MARC

LEADER 00000nab a2200000uu 4500
001 3275478027
003 UK-CbPIL
020 |a 9798265425577 
035 |a 3275478027 
045 2 |b d20250101  |b d20251231 
084 |a 189128  |2 nlm 
100 1 |a Jakovleva, Marija 
245 1 |a LISA Pipeline Runner Dashboard 
260 |b ProQuest Dissertations & Theses  |c 2025 
513 |a Dissertation/Thesis 
520 3 |a Effective resource management and workflow execution monitoring are essential for ensuring performance, stability, and minimal downtime in high-performance computing (HPC) environments. This dissertation presents the design and implementation of a modular, extensible monitoring dashboard tailored to the LISA Pipeline Runner infrastructure, which is responsible for executing complex scientific workflows within the context of the LISA mission.LISA (Laser Interferometer Space Antenna) is a space-based mission aimed at detecting gravitational waves generated by massive cosmic events such as merging black holes, supermassive black holes, and white dwarfs. To achieve this, a constellation of detectors will be deployed in space to capture these gravitational wave signals, which will then be transmitted back to Earth for analysis. This analysis will be carried out in dedicated Data Computing Centers (DCCs), each hosting a Pipeline Runner that orchestrates the data processing workflows. Given the computational demands and critical nature of the data, each Pipeline Runner must be supported by a dedicated monitoring dashboard to provide real-time visibility into system health and resource utilization during data analysis operations.A comparative analysis of existing open-source and research-developed technologies was conducted, focusing on their capabilities in collecting, processing, and visualizing telemetry data from multiple sources. Key metrics such as CPU, memory consumption and workflow execution data were identified as critical for effective monitoring in the context of the LISA mission.Based on this evaluation, a monitoring solution was implemented using Prometheus for metrics collection, Grafana for visualization, and Thanos for long-term storage of time-series data. Loki was also integrated to aggregate and query workflow logs. The system was deployed within a Kubernetes cluster, tightly coupled with the developed Pipeline Runner, with special attention to monitoring Argo Workflow executions and the overall health of the cluster. The resulting dashboard offers a centralized, intuitive interface for operators and developers, supporting observability, traceability, and future scalability within the LISA mission. 
653 |a User interface 
653 |a Random access memory 
653 |a Star & galaxy formation 
653 |a Data visualization 
653 |a Success 
653 |a Graphs 
653 |a Fault lines 
653 |a Black holes 
653 |a Decision making 
653 |a Supercomputers 
653 |a Data processing 
653 |a Design 
653 |a Gravitational waves 
653 |a Structured Query Language-SQL 
653 |a High performance computing 
653 |a Business metrics 
653 |a Astronomy 
653 |a Astrophysics 
653 |a Theoretical physics 
653 |a Engineering 
773 0 |t PQDT - Global  |g (2025) 
786 0 |d ProQuest  |t ProQuest Dissertations & Theses Global 
856 4 1 |3 Citation/Abstract  |u https://www.proquest.com/docview/3275478027/abstract/embedded/6A8EOT78XXH2IG52?source=fedsrch 
856 4 0 |3 Full Text - PDF  |u https://www.proquest.com/docview/3275478027/fulltextPDF/embedded/6A8EOT78XXH2IG52?source=fedsrch