AUS - R&D SaaS Environments overnight upgrade status
Incident Report for TechnologyOne Internal
Resolved
This incident has been resolved.
Posted Apr 22, 2024 - 10:03 AEST
Investigating
****** AUS ******
R&D SaaS Environment Status

DEV
----------
DataSets are not on latest Instance
Latest Snapshot Code is - DEV-2024B-A037

DataSets on instance DEV-2024B-A035A from 2 days ago (03/03/2024 11:35:02 PM)
SAAS-DEV-SQL: DataSet Rolled back due to Smoke Test Failure
SAAS-PLATFORM-DEV: DataSet Rolled back due to Smoke Test Failure
SAAS-DEV-QA: Schema Upgrade Failed, DataSet is in an Error State
SAAS-ZEBRA: Unable to retrieve DataSet status from Team City. Schema upgrade was successful but state is unknown
SAAS-PLATFORM-DEV-US: Schema Upgrade Failed, DataSet is in an Error State
SAAS-ECM-DEV-SQL: Schema Upgrade Failed, DataSet is in an Error State
SAAS-MIGCENT-CONF: Unable to retrieve DataSet status from Team City. Schema upgrade was successful but state is unknown
SAAS-CPM-RA-DEV: Unable to retrieve DataSet status from Team City. Schema upgrade was successful but state is unknown
SAAS-SDXP-DEV: Unable to retrieve DataSet status from Team City. Schema upgrade was successful but state is unknown
SAAS-LICENCE: Schema Upgrade Failed, DataSet is in an Error State
SAAS-SDXP-DEV-PRESALES: Unable to retrieve DataSet status from Team City. Schema upgrade was successful but state is unknown
SAAS-ECM-REFRESH: Unable to retrieve DataSet status from Team City. Schema upgrade was successful but state is unknown

Deploy logs
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Dev/5140866?buildTab=artifacts
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_DevSecondaryDatasets1/5140868?buildTab=artifacts
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_DevSecondaryDatasets2/5140867?buildTab=artifacts
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_DevSecondaryDatasets3/5140869?buildTab=artifacts

REL 2024B
----------
Some DataSets are NOT on the latest Instance

DataSets successfully upgraded to latest instance REL-2024B-A037A
SAAS-REL-2024B, SAAS-REL-2024B-DXP, SAAS-REL-2024B-LGDXP, SAAS-IT, SAAS-REL-DXP-LG-LOCALDEV, SAAS-IM-PUBLIC, SAAS-REL-2024B-T1UNI, SAAS-AUTOFT-2024B-DAILYONECOUNCILAU, SAAS-AUTOFT-2024B-DAILYONECOUNCILUK, SAAS-AUTOFT-2024B-GOLDONECOUNCILAU

DataSets on instance REL-2024B-A035E from 2 days ago (04/03/2024 08:33:49 AM)
SAAS-REL-DXP-LG-SANDPIT: Schema Upgrade Failed, DataSet is in an Error State
T1COLL-PRODDEV: Schema Upgrade Failed, DataSet is in an Error State
SAAS-AUTOFT-2024B-DAILYSTUDENTAU: Schema Upgrade Failed, DataSet is in an Error State
SAAS-AUTOFT-2024B-DAILYSTUDENTUK: Schema Upgrade Failed, DataSet is in an Error State
SAAS-AUTOFT-2024B-GOLDONECOUNCILUK: Schema Upgrade Failed, DataSet is in an Error State
SAAS-AUTOFT-2024B-GOLDSTUDENTAU: Schema Upgrade Failed, DataSet is in an Error State

Deploy logs
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Rel2024b/5140583?buildTab=artifacts
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Rel2024bSecondaryDatasets1/5140808?buildTab=artifacts
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Rel2024bSecondaryDatasets2/5140807?buildTab=artifacts

REL 2024A
----------
DataSets successfully upgraded to latest instance REL-2024A-A240D
SAAS-REL-2024A-LGDXP
DataSets successfully upgraded to latest instance REL-2024A-A240A
SAAS-REL-2024A, SAAS-REL-2024A-DXP, SAAS-AUTOFT-2024A-DAILYSTUDENTAU, SAAS-AUTOFT-2024A-DAILYONECOUNCILAU, SAAS-REL-2024A-T1UNI, SAAS-REL-2024A-CLEAN-ONECOUNCIL, SAAS-REL-2024A-CLEAN-ONESTUDENT, SAAS-AUTOFT-2024A-DAILYONECOUNCILAU, SAAS-HRP-MULTI-CURRENT, SAAS-HRP-DEMO, RDSHOWCASE-HANDOVER, SAAS-AUTOFT-2024A-GOLDONECOUNCILUK, SAAS-AUTOFT-2024A-DAILYONECOUNCILUK, SAAS-AUTOFT-2024A-DAILYSTUDENTUK

Deploy logs
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Rel2024a/5140578?buildTab=artifacts
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Rel2024aModernised/5140585?buildTab=artifacts
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Rel2024aSecondaryDatasets1/5140660?buildTab=artifacts
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Rel2024aSecondaryDatasets2/5140659?buildTab=artifacts

REL 2023B
----------
Some DataSets are NOT on the latest Instance

DataSets successfully upgraded to latest instance REL-2023B-A502A
SAAS-REL-2023B, SAAS-REL-2023B-DXP, SAAS-AUTOFT-2023B-DAILYONECOUNCILAU, SAAS-SUPRELB-APAC, SAAS-AUTOFT-2023B-GOLDONECOUNCILUK, SAAS-REL-2023B-LGDXP, SAAS-REL-DXP-LG-GOLD, SAAS-REL-2023B-T1UNI, SAAS-HRP-MULTI-PREVIOUS, SAAS-PPLGSPROD, SAAS-REL-2023B-CLEAN-ONESTUDENT, SAAS-REL-2023B-CLEAN-ONECOUNCIL, SAAS-REL-SPTPROVE, SAAS-REL-2023B-COUNCIL-PENTEST, SAAS-REL-2023B-STUDENT-PENTEST, SAAS-AUTOFT-2023B-DAILYONECOUNCILUK, SAAS-AUTOFT-2023B-DAILYSTUDENTUK, T1SOL-ONECOUNCILCONFIGAU-2023AB-RD, T1SOL-ONECOUNCILTESTAU-2023AB-RD, T1SOL-ONECOUNCILSANDPITAU-2023AB-RD, T1SOL-ONECOUNCILCONFIGNZ-2023AB-RD, T1SOL-ONECOUNCILTESTNZ-2023AB-RD, T1SOL-ONECOUNCILSANDPITNZ-2023AB-RD, T1SOL-ONEEDUCATIONCONFIGAU-2023AB, T1SOL-ONEEDUCATIONWORKSHOPAU-2023AB, T1SOL-ONEEDUCATIONSANDPITAU-2023AB

DataSets on instance REL-2023B-A501A from 1 day ago (05/03/2024 12:14:33 AM)
SAAS-CIA-LIVE-RELEASE-CURRENT: Schema Upgrade Failed, DataSet is in an Error State
SAAS-CIA-LIVE-INTERNAL-USE: Schema Upgrade Failed, DataSet is in an Error State

DataSets not assigned to an instance: SAAS-AUTOFT-2023B-DAILYSTUDENTAU

Deploy logs
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Rel2023b/5140618?buildTab=artifacts
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Rel2023bSecondaryDatasets1/5140667?buildTab=artifacts
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Rel2023bSecondaryDatasets2/5140666?buildTab=artifacts
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Rel2023bSecondaryDatasets3/5140943?buildTab=artifacts
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Rel2023bSecondaryDatasets4/5140944?buildTab=artifacts

REL 2023A
----------
Some DataSets are NOT on the latest Instance

DataSets successfully upgraded to latest instance REL-2023A-A737A
SAAS-REL-2023A, SAAS-REL-2023A-DXP, SAAS-REL-2023A-CLEAN-ONECOUNCIL, SAAS-REL-2023A-CLEAN-ONESTUDENT, SAAS-REL-2023A-STUDENT-PENTEST

DataSets on instance REL-2023A-A736A from 1 day ago (05/03/2024 01:13:01 AM)
SAAS-REL-2023A-T1UNI: Schema Upgrade Failed, DataSet is in an Error State
SAAS-PLATFORM01: Schema Upgrade Failed, DataSet is in an Error State
SAAS-HRP-MULTI-PREVIOUSX2: Schema Upgrade Failed, DataSet is in an Error State
SAAS-SUPRELA-APAC: Schema Upgrade Failed, DataSet is in an Error State
SAAS-AUTOFT-2023A-DAILYSTUDENTAU: Schema Upgrade Failed, DataSet is in an Error State
SAAS-AUTOFT-2023A-DAILYONECOUNCILAU: Schema Upgrade Failed, DataSet is in an Error State
SAAS-REL-2023A-LGDXP: Schema Upgrade Failed, DataSet is in an Error State
SAAS-CIA-LIVE-RELEASE-PRIOR: Schema Upgrade Failed, DataSet is in an Error State
SAAS-REL-2023A-COUNCIL-PENTEST: Schema Upgrade Failed, DataSet is in an Error State

Deploy logs
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Rel2023a/5140655?buildTab=artifacts
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Rel2023aSecondaryDatasets1/5140810?buildTab=artifacts
https://builds.code.one/buildConfiguration/T1SaaS_Deployments_Nightly_Rel2023aSecondaryDatasets2/5140809?buildTab=artifacts

This is an automated message. Please contact rd.environments.team@technologyonecorp.com with any issues
Posted Mar 06, 2024 - 07:02 AEST