Admin Tooling v0.1 - Roadmap

Summary

The development of Helm charts for deploying perfSONAR and the SODA service on Kubernetes (K8s) clusters is essential for SRCNet v0.1. Helm charts will streamline and standardize the deployment process across various sites, ensuring reproducibility. The SODA service will leverage existing Docker Compose files, requiring the creation of Deployment Custom Resource Definitions (CRDs) and parameterization in Helm’s `values.yaml`.

Key tasks include:

• Consolidating development and production clusters, including migrating repositories and setting up ArgoCD for deployment management.
• Documenting application deployment procedures in a centralized GitLab repository, specifically tailored for SRCNet operations.
• Benchmarking the Orange SODA service to identify and address performance bottlenecks compared to alternatives like Astropy.
• Transitioning from FluxCD to ArgoCD for a more effective GitOps strategy, alongside developing documentation for GitOps processes in SRCNet.

Additionally, a centralized dashboard using Grafana will be established to monitor services, necessitating the collection of metrics and events from both local and global services. This will involve choosing between push or pull methods for data collection.

Key Technical Features Completed

1. Helm Chart Development: Initiation of Helm charts for perfSONAR and SODA services to facilitate easy K8s deployment.

2. Cluster Consolidation: Migrated development and production clusters, including repository restructuring and deployment tracking via ArgoCD.

3. Documentation Creation: Started documenting application deployment procedures in the GitLab repo to support SRCNet operations.

4. Benchmarking Framework: Development of a framework for benchmarking the Orange SODA service, aimed at performance optimization.

5. Transition to ArgoCD: Completed migration to ArgoCD for managing deployments, replacing FluxCD due to its limitations.

6. Centralized Monitoring Dashboard: Initial setup for a Grafana dashboard to visualize SRCNet service metrics, with plans for data collection methodologies.

Pending Tasks

1. Finalisation of Helm Charts: Complete and test the Helm charts for both perfSONAR and SODA.

2. Demo and Verification: Conduct demonstrations of the production cluster and verify the deployment processes.

3. Completion of Benchmarking: Finalize the benchmarking framework for the Orange SODA service and implement any necessary optimizations.

4. Complete Documentation: Finalize the centralized operational documentation for SRCNet, including GitOps practices and application deployment instructions.

5. Monitoring Data Collection Setup: Establish the data collection mechanism for the Grafana dashboard, deciding between push or pull methods for metrics gathering.