Data Product Dashboard v0.9.0

Summary

Added

• Added SDP_DATAPRODUCT_API_ELASTIC_INDICES to environment variables to enable specification of Elasticsearch instances in deployments.
   

• 
  Changed the default deployment of the SKA Permission API to true.

Changed

• Updated documentation to include details for the configuration and use of the required shared persistent volume.
   

• BREAKING  This update refactors the data structure used by the DPD API to serve data to the MUI DataGrid component. It now aligns with the structure expected by the MUI DataGrid itself. This brings several improvements:

• •  Column Filters and Pagination: You can now leverage built-in MUI DataGrid features like column filters and pagination.
  • Full API Configurability: The table can be fully configured from the API, allowing for more granular control over its behaviours.

• Updated Data Product API Helm chart and the values file to reflect updated environment variables required for PostgreSQL and ElasticSearch.
   

• BREAKING The DPD API have been updated to find data products based on their execution_blocks. The dashboard has been updated to request data related to execution_blocks in requests.
   

• BREAKING Updated charts and pipeline to include env variables required for integration with PostgreSQL and ElasticSearch instances in the cluster.
   

• Updated the environment variable names for Elasticsearch in the API Chart.
   

• BREAKING Added the users access token to the request for data product metadata form the filterdataproducts endpoint of the DPD API.
   

• Updated reload behaviour to reload data products on the dashboard as they are added in the database by the API.
  Deprecated

• None

Removed

• None

Fixed

• 
  Removed the .env file from the Git repository and Docker file. To do this we moved all the environment variable declarations out of the .env file into a new file named 'expected_env_names'. This is done to prevent confusion when deploying the docker image where environment variables is set by other means, as well as preventing accidental commits of secrets to the Git repository.

Test Evidence

• <TBD>

Security

• None