AdArte

ALLERTA PREDITTIVA (LEONARDO ENGINE)
Severita Ricalcolata dall'AI: WARNING
Probabilita Impatto Ricalcolata: 73%
Time-to-Impact Stimato: 107 minuti

Soluzione / Procedura Operativa Prioritaria:

• Verificare su ada-pd-psql-c01 il ruolo PostgreSQL rilevato dal nodo con pg_is_in_recovery(), stato replica e raggiungibilita della porta 5432.
• Controllare nella configurazione Commvault PostgreSQL Instance/Subclient che discovery primary-standby, credenziali e dump based backup set siano allineati al nodo corretto.
• Raccogliere log del 10576153 e dell'agent PostgreSQL per l'errore [94:13] prima del rilancio del Full backup.
• Please check Client and Access node configuration, confirm Access Node and Client are up and running then check network connectivity between Commserve and Access Node, and Access Node and Client.
• Aprire il dettaglio del job Commvault e verificare Event Viewer/log del Job ID, client, subclient e MediaAgent coinvolti.

Step di Diagnosi ed Esecuzione:

• Usare la query Datadog riportata sotto per aprire log/APM nello stesso timeframe e verificare se esistono errori sul servizio coinvolto.

Dati Datadog / Telemetry:

• finestra analizzata: ultimi 180 minuti
• chiavi evento usate per la ricerca: ADARTE, Backup, Failed, Management, Protection, CommCell, psnbckcmsdcrz, Detected
• topologia: Datadog live topology:
• agent: ADA-AD1, ADA-AD2, ADA-Gluster01, ADA-Gluster02, ADA-Gluster03, ADA-Kafka01, ADA-Kafka02, ADA-Kafka03, ADA-Kafka04, ADA-Kafka05, ADA-Rancher01, ADA-Rancher02, ADA-Rancher03, ADA-SQL-C02, ADA-Zookeeper01, ADA-Zookeeper02, ADA-Zookeeper03, ADA-elkinfr01, ADA-elkinfr02, ADA-elkinfr03, ADA-postgsql-c1, ADA-sqldatadog, ADA-sqlnode1, ADA-sqlnode2, ADA_SQL_C02, ADA_SQL_CLUSTER, acs-dv-psql01, acs-dv-psql02, acs-dv-psql03, ada-k8singress2-adarte, ada-k8smanager1-adarte, ada-k8smanager2-adarte, ada-k8smanager3-adarte, ada-k8sworker01-adarte, ada-k8sworker02-adarte, ada-k8sworker03-adarte, ada-k8sworker04-adarte, ada-k8sworker05-adarte, ada-k8sworker06-adarte, ada-k8sworker07-adarte, ada-k8sworker08-adarte, ada-k8sworker09-adarte, ada-k8sworker10-adarte, ada-pd-psql-c01, ada-pd-psql-c02, ada-pd-psql-c03, ada-redis-en-00, ada-redis-en-01, ada-redis-en-02, ada-redis-en-03, ada-redis-en-04, ada-redis-en-05, ada-redis-en-06, ada-redis-en-07, ada-redis-en-08, ada-redis-en-09, pcd-pd-elastic-c01, pcd-pd-elastic-c02, pcd-pd-elastic-c03, pcd-pd-k8ns-m01-acs-prd, pcd-pd-k8ns-m02-acs-prd, pcd-pd-k8ns-m03-acs-prd, pcd-pd-k8ns-w01-acs-prd, pcd-pd-k8ns-w02-acs-prd, pcd-pd-k8ns-w03-acs-prd, pcd-pd-mnio-c01, pcd-pd-mnio-c02, pcd-pd-mnio-c03, pcd-pd-mnio-c04, pcd-pd-mongodb-c01, pcd-pd-mongodb-c01:27017, pcd-pd-mongodb-c02, pcd-pd-mongodb-c02:27017, pcd-pd-mongodb-c03, pcd-pd-mongodb-c03:27017, pcd-pd-psgl-c01, pcd-pd-psgl-c02, pcd-pd-psgl-c03
• ntp: ADA-AD1, ADA-AD2, ADA-Gluster01, ADA-Gluster02, ADA-Gluster03, ADA-Kafka01, ADA-Kafka02, ADA-Kafka03, ADA-Kafka04, ADA-Kafka05, ADA-Rancher01, ADA-Rancher02, ADA-Rancher03, ADA-SQL-C02, ADA-Zookeeper01, ADA-Zookeeper02, ADA-Zookeeper03, ADA-elkinfr01, ADA-elkinfr02, ADA-elkinfr03, ADA-postgsql-c1, ADA-sqldatadog, ADA-sqlnode1, ADA-sqlnode2, acs-dv-psql01, acs-dv-psql02, acs-dv-psql03, ada-k8singress2-adarte, ada-k8smanager1-adarte, ada-k8smanager2-adarte, ada-k8smanager3-adarte, ada-k8sworker01-adarte, ada-k8sworker02-adarte, ada-k8sworker03-adarte, ada-k8sworker04-adarte, ada-k8sworker05-adarte, ada-k8sworker06-adarte, ada-k8sworker07-adarte, ada-k8sworker08-adarte, ada-k8sworker09-adarte, ada-k8sworker10-adarte, ada-pd-psql-c01, ada-pd-psql-c02, ada-pd-psql-c03, ada-redis-en-00, ada-redis-en-01, ada-redis-en-02, ada-redis-en-03, ada-redis-en-04, ada-redis-en-05, ada-redis-en-06, ada-redis-en-07, ada-redis-en-08, ada-redis-en-09, pcd-pd-elastic-c01, pcd-pd-elastic-c02, pcd-pd-elastic-c03, pcd-pd-k8ns-m01-acs-prd, pcd-pd-k8ns-m02-acs-prd, pcd-pd-k8ns-m03-acs-prd, pcd-pd-k8ns-w01-acs-prd, pcd-pd-k8ns-w02-acs-prd, pcd-pd-k8ns-w03-acs-prd, pcd-pd-mnio-c01, pcd-pd-mnio-c02, pcd-pd-mnio-c03, pcd-pd-mnio-c04, pcd-pd-mongodb-c01, pcd-pd-mongodb-c02, pcd-pd-mongodb-c03, pcd-pd-psgl-c01, pcd-pd-psgl-c02, pcd-pd-psgl-c03
• cert_manager: ada-k8sworker07-adarte, pcd-pd-k8ns-w03-acs-prd
• container: ada-k8singress2-adarte, ada-k8smanager1-adarte, ada-k8smanager2-adarte, ada-k8smanager3-adarte, ada-k8sworker01-adarte, ada-k8sworker02-adarte, ada-k8sworker03-adarte, ada-k8sworker04-adarte, ada-k8sworker05-adarte, ada-k8sworker06-adarte, ada-k8sworker07-adarte, ada-k8sworker08-adarte, ada-k8sworker09-adarte, ada-k8sworker10-adarte, pcd-pd-k8ns-m01-acs-prd, pcd-pd-k8ns-m02-acs-prd, pcd-pd-k8ns-m03-acs-prd, pcd-pd-k8ns-w01-acs-prd, pcd-pd-k8ns-w02-acs-prd, pcd-pd-k8ns-w03-acs-prd
• jvm: 10.32.12.31, 10.32.12.32, 10.32.12.33, ADA-Kafka01, ADA-Kafka02, ADA-Kafka03, ADA-Kafka04, ADA-Kafka05, ada-k8sworker01-adarte, ada-k8sworker02-adarte, ada-k8sworker03-adarte, ada-k8sworker04-adarte, ada-k8sworker05-adarte, ada-k8sworker06-adarte, ada-k8sworker07-adarte, ada-k8sworker08-adarte, ada-k8sworker09-adarte, ada-k8sworker10-adarte, pcd-pd-k8ns-w01-acs-prd, pcd-pd-k8ns-w02-acs-prd, pcd-pd-k8ns-w03-acs-prd

Contesto Operativo:

• ADARTE Backup Job Failed Alert: Backup job failed Type: Job Management - Data Protection. Backup job failed ADARTE Type Job Management - Data Protection CommCell psnbckcmsdcrz Detected Criteria Job Failed User master Job ID 10576153 Status Failed Client ada-pd-psql-c01 Agent Type PostgreSQL Instance [...contenuto ridotto per evitare inferenza lenta...] i Jul 10 01:29:08 2026 Error Code [94:13] Failure Reason PostgreSQL Database: [~Function failed during execution. (ERROR_FUNCTION_FAILED.1627), Master and Standby roles could not be properly set (W32.1627)~] Data Backup Failed. Protected Counts 0 Failed Counts 0 Generated At Fri Jul 10 01:29:08 2026

Previsione e Contesto (RAG + LLM):
Gli eventi indicano: Alert tecnico: Job ID 10576153; stato Failed; client ada-pd-psql-c01; CommCell psnbckcmsdcrz; errore [94:13]; failure reason: PostgreSQL Database: [~Function failed during execution. (ERROR_FUNCTION_FAILED.1627), Master and Standby roles could not be properly set (W32.1627)~] Data Backup Failed.

Causa probabile da verificare: IMPATTO: Il fallimento del job di backup notturno per il server di produzione SQL potrebbe compromettere la capacità di ripristinare dati critici in caso di incidente.

Prima azione consigliata: Verificare su ada-pd-psql-c01 il ruolo PostgreSQL rilevato dal nodo con pg_is_in_recovery(), stato replica e raggiungibilita della porta 5432.

Sistemi Coinvolti: ['Commvault / Data Protection', 'CommCell psnbckcmsdcrz', 'ada-pd-psql-c01', 'PostgreSQL Instance ada-pd-psql-c01_5432', 'Adarte', 'Please', 'Client', 'Access']

ROOT CAUSE PROBABILE:

• IMPATTO: Il fallimento del job di backup notturno per il server di produzione SQL potrebbe compromettere la capacità di ripristinare dati critici in caso di incidente.

Tracciato Deduttivo / Ricalibrazione:

• Eventi correlati: 1; sorgenti: graph.
• Severita matematica/predittiva: WARNING con probabilita 73%.
• Modelli verticali selezionati: dataset commvault backup disaster recovery, dataset postgresql, dataset terraform infrastructure as code.
• Motore usato: qwen2.5-coder-0.5b-instruct-q8_0.gguf; LoRA: nessuno.

--- EVENTI ORIGINALI CHE HANNO SCATENATO L'ALLARME ---

--- ORIGINE: GRAPH ---
Oggetto: ADARTE Backup Job Failed Alert: Backup job failed Type: Job Management - Data Protection
Mittente: noreply-servizi@polostrategiconazionale.it
Dettaglio: Backup job failed ADARTE Type Job Management - Data Protection CommCell psnbckcmsdcrz Detected Criteria Job Failed User master Job ID 10576153 Status Failed Client ada-pd-psql-c01 Agent Type PostgreSQL Instance ada-pd-psql-c01_5432 Backup Set DumpBasedBackupSet Subclient default Backup Level Full Storage Policies Used PSNBackup_plan_RN_DCRZ_7_giorni Start Time Thu Jul 9 22:04:47 2026 End Time Fri Jul 10 01:29:08 2026 Error Code [94:13] Failure Reason PostgreSQL Database: [~Function failed during execution. (ERROR_FUNCTION_FAILED.1627), Master and Standby roles could not be properly set (W32.1627)~] Data Backup Failed. Protected Counts 0 Failed Counts 0 Generated At Fri Jul 10 01:29:08 2026

--- MEMORIA STORICA UTILIZZATA (RAG) ---
Nessuna memoria storica sufficientemente rilevante trovata.

--- PARERI ESPERTI VERTICALI ---

• Nessun parere multi-esperto disponibile

--- MODELLI VERTICALI UTILIZZATI ---

• dataset commvault backup disaster recovery (dataset, score=0.47, reason=semantic contrastive match)
• dataset postgresql (dataset, score=0.32, reason=semantic contrastive match)
• dataset terraform infrastructure as code (dataset, score=0.18, reason=semantic contrastive match)

Predictive Ticket generato da PRISM.AI - Leonardo ML Engine