Alerts

Open (68)

sincehostcheckseveritysummary
11-21 03:06 crafty linux:disk crit disk critical: / 96%
11-17 01:06 proxmox security:scan crit security target missing Linux SSH configuration
11-10 03:40 nordkey ping crit 10.4.1.195 unreachable (100% loss)
11-08 03:06 hpstor01 pve:ssh crit PVE check exit 255: ssh: connect to host 10.4.1.193 port 22: Connection timed out
11-08 03:06 hpstor01 linux:ssh crit SSH deep check failed: Command '['ssh', '-o', 'BatchMode=yes', '-o', 'StrictHostKeyChecking=accept-new', '-i', '/home/deploy/.ssh/infra_mack_ed25519', 'root@10.4.1.193', 'hostname\necho \'===UPTIME===\'\ncat /proc/uptime 2>/dev/null\nawk \'{print $3}\' /proc/loadavg 2>/dev/null\nnproc 2>/dev/null\necho \'===DF===\'\ndf -P -x tmpfs -x devtmpfs -x overlay -x squashfs -x efivarfs -x cgroup -x cgroup2 -x devpts -x proc -x sysfs -x pstore -x bpf -x tracefs -x debugfs -x fusectl -x mqueue -x hugetlbfs -x rpc_pipefs -x configfs -x securityfs 2>/dev/null\necho \'===FAILED===\'\nsystemctl --failed --no-legend --plain 2>/dev/null\necho \'===REBOOT===\'\n[ -f /var/run/reboot-required ] && echo yes || echo no\necho \'===UPDATES===\'\napt-get -s -o Debug::NoLocking=true upgrade 2>/dev/null | grep -c \'^Inst\' || echo 0\necho \'===UPDATES_SEC===\'\napt-get -s -o Debug::NoLocking=true upgrade 2>/dev/null | grep \'^Inst\' | grep -ic security || echo 0\necho \'===SMART===\'\nif command -v smartctl >/dev/null 2>&1; then\n smartctl --scan 2>/dev/null | awk \'{print $1}\' | grep -vE \'^/dev/bus\' | while read d; do\n echo "-- $d"\n smartctl -H -A "$d" 2>/dev/null | grep -iE \'overall-health|Health Status|Reallocated|Current_Pending|Offline_Uncorrectable|Reported_Uncorrect|Temperature|Power_On_Hours|Percentage Used|Wear_Leveling|Media_Wearout|uncorrected\' | head -20\n done\nfi\necho \'===SERVICES===\'\nfor s in true; do\n printf \'%s: \' "$s"; systemctl is-active "$s" 2>/dev/null || echo missing\ndone\necho \'===LISTENERS===\'\nss -tlnH 2>/dev/null | awk \'{print $4}\' | grep -oE \'[0-9]+$\' | sort -un\n']' timed out after 120 seconds
11-08 03:06 home-proxmox linux:failed-units crit 1 failed units: pfsense-experiment4.service loaded failed failed pfsense 5g optimization exp4
11-06 20:32 hpstor01 http:8006 crit https :8006 HTTP error: timed out
11-06 20:32 hpstor01 tcp:8006 crit 10.4.1.193:8006 (https) filtered
11-06 20:10 windows10vm-79 tcp:5985 crit 10.4.1.79:5985 (winrm) filtered/unreachable
11-06 20:10 torrentvm4 tcp:5985 crit 10.4.1.71:5985 (winrm) filtered/unreachable
11-06 20:10 windows10vm-79 ping crit 10.4.1.79 unreachable (100% loss)
11-06 20:10 hpstor01 tcp:22 crit 10.4.1.193:22 (ssh) filtered/unreachable
11-06 20:10 torrentvm4 ping crit 10.4.1.71 unreachable (100% loss)
11-06 20:10 hpstor01 ping crit 10.4.1.193 unreachable (100% loss)
11-03 23:17 home-aihost tcp:8096 crit 10.4.1.87:8096 (bookops_ai) filtered
11-03 06:00 abbey-qb-archive-dev tcp:5985 crit 10.4.175.90:5985 (winrm) filtered/unreachable
11-03 06:00 abbey-qb-archive-dev ping crit 10.4.175.90 unreachable (100% loss)
11-03 03:06 proxmox-backup-server pbs:backups crit backup failures: backup:Abbey-MainBackup:vm/100=backup ended but finished state is not set.
11-03 03:06 r820 pbs:backups crit backup failures: backup:Abbey-MainBackup:vm/100=backup ended but finished state is not set.
11-03 03:06 abbey-proxmox pbs:backups crit backup failures: syncjob:mack-pbs:Abbey-MainBackup:abbey-pbs-main::abbey-to-mack-daily=Sync failed with some errors!
11-03 01:47 marketing-mcp tcp:8382 crit 10.4.175.138:8382 (manager_mcp) filtered
11-03 01:47 marketing-mcp tcp:8381 crit 10.4.175.138:8381 (read_only_mcp) filtered
11-02 22:00 grisonpress-v2 linux:failed-units crit 1 failed units: grisonpress-forum-arc-sync.service loaded failed failed Grison Press development Discourse ARC entitlement reconciliation
10-14 17:00 grisonpress-v2 http:8103 crit app :8103 HTTP error: timed out
10-14 17:00 grisonpress-v2 tcp:8103 crit 10.4.175.134:8103 (app) filtered
10-14 17:00 abbey-qb-workstation2 tcp:8791 crit 10.4.3.52:8791 (qbwc) filtered
10-13 22:00 infraagent-vm linux:services crit services down: infraagent-mcp=inactive
10-10 19:30 - http:mackdesigner-www crit mackdesigner-www HTTP error: Exceeded maximum allowed redirects.
10-10 19:30 abbey-qb-workstation tcp:8791 crit 10.4.3.51:8791 (qbwc) filtered
10-10 19:30 - http:quickknobs crit quickknobs HTTP error: Exceeded maximum allowed redirects.
10-10 19:30 - http:mackdesigner-site crit mackdesigner-site HTTP error: [Errno 113] No route to host
10-10 19:30 frigate http:8971 crit ui :8971 connect error: [Errno 113] No route to host
10-10 19:30 frigate http:5000 crit api :5000 connect error: [Errno 113] No route to host
10-10 19:30 frigate tcp:8971 crit 10.4.175.160:8971 (ui) filtered
10-10 19:30 frigate tcp:5000 crit 10.4.175.160:5000 (api) filtered
10-10 19:30 webserver-henry tcp:8102 crit 10.4.175.131:8102 (scorehorizon) filtered
10-10 19:30 ecommerce-1 http:8088 crit http :8088 HTTP error: timed out
10-10 19:30 abbey-qb-archive-dev tcp:8791 crit 10.4.175.90:8791 (qbwc) filtered
10-10 19:30 main-webserver http:443 crit https HTTP 500
10-08 13:55 abbey-qb-workstation ping crit 10.4.3.51 unreachable (100% loss)
10-08 12:35 abbey-qb-workstation tcp:5985 crit 10.4.3.51:5985 (winrm) filtered/unreachable
09-22 22:00 abbey-windowsvm1 win:winrm crit WinRM check failed: WinRM error: Failed to authenticate the user MACKDESIGNER\infra-agent with ntlm
09-22 22:00 home-proxmox linux:disk crit disk critical: 73% 34021014216%, 73% 34021014216%
09-22 22:00 home-dc win:winrm crit WinRM check failed: WinRM error: Failed to authenticate the user 160REEDinfra-agent with ntlm
09-22 22:00 abbey-qb-workstation win:winrm crit WinRM check failed: WinRM connection failed to http://10.4.3.51:5985/wsman: HTTPConnectionPool(host='10.4.3.51', port=5985): Max retries exceeded with url: /wsman (Caused by ConnectTimeoutError(<HTTPConnection(host='10.4
09-22 22:00 frigate linux:ssh crit SSH deep check exit 255: ssh: connect to host 10.4.175.160 port 22: No route to host
09-22 22:00 haproxy linux:ssh crit SSH deep check exit 255: ssh: connect to host 10.4.175.19 port 22: No route to host
09-22 22:00 abbey-qbvm win:winrm crit WinRM check failed: PowerShell failed: Cannot open Service Control Manager on computer '.'. This operation might require other privileges.
09-22 22:00 idrac-55n0fz1 linux:ssh crit SSH deep check exit 255: root@10.4.175.196: Permission denied (publickey,password).
09-22 22:00 abbey-qb-archive-dev win:winrm crit WinRM check failed: WinRM connection failed to http://10.4.175.90:5985/wsman: HTTPConnectionPool(host='10.4.175.90', port=5985): Max retries exceeded with url: /wsman (Caused by NewConnectionError("HTTPConnection(host='1
09-21 17:05 frigate ping crit 10.4.175.160 unreachable (100% loss)
09-21 17:05 home-tivo ping crit 10.4.50.100 unreachable (100% loss)
09-21 17:05 fusiontally ping crit 10.4.175.41 unreachable (100% loss)
09-21 17:05 hylafax ping crit 10.4.175.143 unreachable (100% loss)
09-21 17:05 syncory ping crit 10.4.175.43 unreachable (100% loss)
09-21 17:05 bookstack ping crit 10.4.175.21 unreachable (100% loss)
09-21 17:05 hpcmasterking tcp:5985 crit 10.4.175.27:5985 (winrm) filtered/unreachable
09-21 17:05 haproxy ping crit 10.4.175.19 unreachable (100% loss)
09-21 17:05 frigate tcp:22 crit 10.4.175.160:22 (ssh) filtered/unreachable
09-21 17:05 qbwebapp-vm ping crit 10.4.175.12 unreachable (100% loss)
09-21 17:05 infraagent-winvm ping crit 10.4.175.91 unreachable (100% loss)
09-21 17:05 haproxy tcp:22 crit 10.4.175.19:22 (ssh) filtered/unreachable
09-21 17:05 qbvm2024 ping crit 10.4.175.15 unreachable (100% loss)
09-21 17:05 abbey-windowsvm1 ping crit 10.4.3.50 unreachable (100% loss)
09-21 17:05 qbwebapp-vm tcp:22 crit 10.4.175.12:22 (ssh) filtered/unreachable
09-21 17:05 qbvm2024 tcp:5985 crit 10.4.175.15:5985 (winrm) filtered/unreachable
09-21 17:05 remotevm-2 tcp:5985 crit 10.4.175.112:5985 (winrm) filtered/unreachable
09-21 17:05 remotevm-1 tcp:5985 crit 10.4.175.111:5985 (winrm) filtered/unreachable

Resolved (last 50)

resolvedhostchecksummary
11-18 17:30 mediastack ping 10.4.1.19 unreachable (100% loss)
11-18 16:36 home-proxmox security:scan security process scan failed: Command '['ssh', '-o', 'BatchMode=yes', '-o', 'StrictHostKeyChecking=accept-new', '-i', '/home/deploy/.ssh/infra_mack_ed25519', 'root@10.4.1.9', '\nps -eo pid=,pcpu=,etimes=,uid=,comm= --sort=-pcpu 2>
11-18 03:06 infraagent-winvm win:winrm WinRM check failed: WinRM error: Received a WSManFault message. (Code: 1359, Machine: 10.4.175.91, Reason: An internal error occurred.)
11-16 15:47 - http:frigate frigate HTTP 503
11-15 03:06 home-proxmox pbs:backups stale backups: home-pbs-14tb:ct/105 (282.2h)
11-06 07:45 home-pfsense ping 10.4.1.1 unreachable (100% loss)
11-06 07:45 home-proxmox tcp:22 10.4.1.9:22 (ssh) filtered/unreachable
11-06 07:45 home-nas tcp:22 10.4.1.16:22 (ssh) filtered/unreachable
11-06 07:45 home-dc ping 10.4.1.11 unreachable (100% loss)
11-06 07:45 home-proxmox ping 10.4.1.9 unreachable (100% loss)
11-06 07:45 home-plex ping 10.4.1.76 unreachable (100% loss)
11-06 07:45 home-aihost ping 10.4.1.87 unreachable (100% loss)
11-06 07:45 home-plex tcp:32400 10.4.1.76:32400 (plex) filtered/unreachable
11-06 07:45 home-nas ping 10.4.1.16 unreachable (100% loss)
11-06 07:45 home-dc tcp:5985 10.4.1.11:5985 (winrm) filtered/unreachable
11-06 07:45 home-aihost tcp:22 10.4.1.87:22 (ssh) filtered/unreachable
11-04 21:45 proxmox tcp:22 10.4.175.10:22 (ssh) filtered/unreachable
11-04 21:45 proxmox ping 10.4.175.10 unreachable (100% loss)
11-04 21:02 r820 tcp:8007 10.4.175.7:8007 (pbs) filtered
11-04 21:02 proxmox-backup-server tcp:8007 10.4.175.7:8007 (pbs) filtered
11-04 20:55 proxmox-backup-server ping 10.4.175.7 unreachable (100% loss)
11-04 20:55 r820 tcp:22 10.4.175.7:22 (ssh) filtered/unreachable
11-04 20:55 pbs-r820 ping 10.4.175.7 unreachable (100% loss)
11-04 20:55 proxmox-backup-server tcp:22 10.4.175.7:22 (ssh) filtered/unreachable
11-04 20:55 r820 ping 10.4.175.7 unreachable (100% loss)
11-04 12:32 home-aihost tcp:8080 10.4.1.87:8080 (http) filtered
11-04 12:32 home-aihost http:8080 http :8080 HTTP error: timed out
11-04 12:32 home-dc tcp:53 10.4.1.11:53 (dns) filtered
11-04 12:32 home-aihost tcp:11434 10.4.1.87:11434 (ollama) filtered
11-04 03:04 main-webserver linux:failed-units 1 failed units: certbot.service loaded failed failed Certbot
11-04 03:04 proxmox2 linux:failed-units 1 failed units: grisonpress-forum-pbs-recovery-qa.service loaded failed failed Offline isolated restore of VM139 PBS backup to never-networked VM140
11-03 05:56 home-proxmox security:process 1 high-confidence anomaly(s): kvm PID 2807635, 437% CPU, deleted executable; sustained high CPU, exe=/usr/bin/qemu-system-x86_64 (deleted)
11-03 05:55 abbey-windowsvm1 tcp:5985 10.4.3.50:5985 (winrm) filtered/unreachable
11-03 05:55 abbey-qbvm tcp:5985 10.4.3.13:5985 (winrm) filtered/unreachable
11-03 03:06 qbwebapp-vm win:winrm WinRM check failed: WinRM connection failed to http://10.4.175.12:5985/wsman: HTTPConnectionPool(host='10.4.175.12', port=5985): Max retries exceeded with url: /wsman (Caused by NewConnectionError("HTTPConnection(host='1
10-23 22:00 build-runner-01 linux:ssh SSH deep check exit 255: @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ @ WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @ @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ IT IS POSSIBLE THAT
10-15 22:00 proxmoxmail-gw linux:failed-units 1 failed units: pmg-hourly.service loaded failed failed Hourly Proxmox Mail Gateway activities
10-09 22:00 postgresql linux:ssh SSH deep check exit 255: @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ @ WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @ @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ IT IS POSSIBLE THAT
09-21 17:10 remotevm-2 ping 10.4.175.112 unreachable (100% loss)