University of Central Florida

Status
Dashboard

What’s up, or down? The UCF Services Status Health Dashboard displays a real-time view of services that are working or possible current outages. Contact the UCF Support Center at 407-823-5117 for assistance or information about this site.

Update - What is happening?
We've confirmed after extensive monitoring an issue where applications that utilize UCF's SMTP relay servers for email delivery may experience intermittent service degradation & connection delays for SMTP transactions due to concurrency/recipient limits.

Who is impacted?
Applications, monitoring tools & Customer Relationship Software (CRMs) that utilize UCF's SMTP relay servers to send email and attachments for promotional campaigns, marketing, LEAP requests, NID password resets, UCF custom applications, eFORMs, helpdesk tickets, PeopleSoft, enterprise remote monitoring etc.

What are we doing about it?
We're continuing to work with the vendor to improve performance on the underlying infrastructure and are evaluating additional mitigation options through cloud-based SMTP providers for bulk-email marketing and business critical applications.

What happens next?
The SMTP relay servers are operational at this time but applications utilizing UCF's SMTP relays for email delivery may experience intermittent service degradation issues & connection delays when concurrency & recipient limits are reached.

What do I need to do?
To ensure that your emails reach their destination, we recommend that you use the following practices:
- Ensure your recipient lists are current and accurate.
- Scheduling bulk email or marketing campaigns during non-peak business hours.
- Utilizing group email addresses, or shared mailboxes instead of individualized email addresses for recipients where applicable.
- Increasing the retry timeout interval on renewed SMTP connection attempts.
- Decreasing the 'batch size' of SMTP transactions to send 500 or less emails to be delivered per SMTP session.

For users who are still impacted, we'll continue to provide updates in Service-Now under Problem Record PRB0040809.
Jan 11, 09:55 EST
Update - What is happening?
We've confirmed after extensive monitoring an issue where applications that utilize UCF's SMTP relay servers for email delivery may experience intermittent service degradation & connection delays for SMTP transactions due to concurrency/recipient limits.

Who is impacted?
Applications, monitoring tools & Customer Relationship Software (CRMs) that utilize UCF's SMTP relay servers to send email and attachments for promotional campaigns, marketing, LEAP requests, eFORMs, helpdesk tickets, PeopleSoft, enterprise remote monitoring etc.

What are we doing about it?
We're continuing to work with the vendor to improve performance on the underlying infrastructure and are evaluating additional mitigation options through cloud-based SMTP providers for bulk-email marketing and business critical applications.

What happens next?
The SMTP relay servers are operational at this time but applications utilizing UCF's SMTP relays for email delivery may experience intermittent service degradation issues & connection delays when concurrency & recipient limits are reached.

What do I need to do?
To ensure that your emails reach their destination, we recommend that you use the following practices:
- Ensure your recipient lists are current and accurate.
- Scheduling bulk email or marketing campaigns during non-peak business hours.
- Utilizing group email addresses, or shared mailboxes instead of individualized email addresses for recipients where applicable.
- Increasing the retry timeout interval on renewed SMTP connection attempts.

For users who are still impacted, we’ll continue to provide updates in Service-Now under Problem Record PRB0040816.
Jan 3, 16:10 EST
Identified - We've confirmed after extensive monitoring an issue where users may experience intermittent connection delays for SMTP transactions due to concurrency/recipient limits. We're continuing to work with the vendor to improve performance on the underlying infrastructure. For users who are still impacted, we’ll continue to provide updates in Service-Now under Problem Record PRB0040816.
Dec 21, 23:22 EST
Investigating - We are currently investigating this issue.
Dec 15, 11:32 EST
Software & App Distribution ? Operational
UCF Apps ? Operational
Web Services ? Operational
my.ucf.edu ? Operational
DNS - Public ? Operational
www.ucf.edu ? Operational
ikm.ucf.edu ? Operational
Human Resource Systems ? Operational
Human Capital Management ? Operational
IT Service Delivery & Support ? Operational
ServiceNow ? Operational
Printing & Related Services ? Operational
Student Printing ? Operational
Student Information Systems ? Operational
Campus Solutions ? Operational
Financial & Procurement ? Operational
UCF Financials ? Operational
Adaptive Planning ? Operational
Network & Connectivity ? Operational
Campus Internet ? Operational
Housing Internet ? Operational
DNS - Internal ? Operational
Enterprise VPN ? Operational
Email & Collaboration ? Operational
Microsoft 365 ? Operational
Data Center Services ? Operational
Virtual Server Hosting ? Operational
Physical Server Hosting ? Operational
Microsoft Azure ? Operational
Amazon Web Services ? Operational
Mass Communications ? Degraded Performance
ListServ ? Operational
SMTP ? Degraded Performance
Conferencing & Telephones ? Operational
Cisco IPT Phone System ? Operational
Skype for Business ? Operational
Teams Calling ? Operational
Cellular Service ? Operational
Identity & Access Management ? Operational
Active Directory Domain ? Operational
Single Sign On Service ? Operational
Account Password Reset ? Operational
Learning Management Systems ? Operational
Webcourses Operational
Research Admin Systems ? Operational
Huron Research Suite - Grants Operational
Huron Research Suite - IRB Operational
Huron Research Suite - IACUC Operational
Huron Research Suite - Agreements Operational
Data, Reporting & Analytics ? Operational
Pegasus Mine Portal (PMP) ? Operational
Reporting DB Service (RDS) ? Operational
Insights Dashboards ? Operational
Enterprise Guide (EG) ? Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Past Incidents
Jan 23, 2022

No incidents reported today.

Jan 22, 2022

No incidents reported.

Jan 21, 2022

No incidents reported.

Jan 20, 2022

No incidents reported.

Jan 19, 2022

No incidents reported.

Jan 18, 2022
Resolved - A patch causing Boot loops on the domain controllers was uninstalled.
Jan 18, 14:58 EST
Update - WHAT IS HAPPENING?
Intermittent login issues are being seen in the environment with domain controller reboot loops.

WHO IS IMPACTED?
Students and Staff

WHAT ARE WE DOING ABOUT IT?
Monitoring

WHAT HAPPENS NEXT?
The Microsoft patch that is causing boot loops has been removed. We are monitoring the environment to make sure there are no issues. Please contact us if you see any problems.

WHAT DO I NEED TO DO?
Stay Updated
Jan 18, 13:20 EST
Identified - WHAT IS HAPPENING?
Intermittent login issues are being seen in the environment with domain controller reboot loops.

WHO IS IMPACTED?
Students and Staff

WHAT ARE WE DOING ABOUT IT?
Identified

WHAT HAPPENS NEXT?
The Microsoft patch that is causing boot loops is being removed. One Domain Controller per site is being updated and rebooted at a time.

WHAT DO I NEED TO DO?
Stay Updated
Jan 18, 11:59 EST
Investigating - WHAT IS HAPPENING?
Intermittent login issues are being seen in the environment with domain controller reboot loops.

WHAT ARE WE DOING ABOUT IT?
We are currently investigating this issue.
Jan 18, 10:54 EST
Jan 17, 2022

No incidents reported.

Jan 16, 2022

No incidents reported.

Jan 15, 2022

No incidents reported.

Jan 14, 2022

No incidents reported.

Jan 13, 2022

No incidents reported.

Jan 12, 2022

No incidents reported.

Jan 11, 2022

Unresolved incident: SMTP Degraded Performance.

Jan 10, 2022

No incidents reported.

Jan 9, 2022

No incidents reported.