701-750 of 10000 results (77ms)
2020-02-03 §
18:23 <mholloway-shell@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'wikifeeds' for release 'production' . [production]
18:17 <mholloway-shell@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'wikifeeds' for release 'staging' . [production]
16:52 <eevans@deploy1001> helmfile [EQIAD] Ran 'apply' command on namespace 'sessionstore' for release 'production' . [production]
16:47 <eevans@deploy1001> helmfile [CODFW] Ran 'apply' command on namespace 'sessionstore' for release 'production' . [production]
16:38 <eevans@deploy1001> helmfile [STAGING] Ran 'apply' command on namespace 'sessionstore' for release 'staging' . [production]
15:38 <XioNoX> rollback: add debug on eqiad-knams link interfaces - T240659 [production]
15:33 <XioNoX> add debug on eqiad-knams link interfaces - T240659 [production]
14:59 <moritzm> restarting exim on phab* to pick up libidn security update [production]
14:55 <moritzm> restarting superset on an-tool1004/1005 to pick up libidn security update [production]
14:44 <moritzm> restarting apache on an-tool*. cloudmetrics*, logstash*, grafana1002 to pick up libidn security update [production]
14:21 <moritzm> restarting slapd on ldap-corp* to pick up libidn2 security updates [production]
14:18 <cdanis> T243634 ✔️ cdanis@cp4031.ulsfo.wmnet ~ 🕤☕ sudo varnish-frontend-restart [production]
13:58 <moritzm> installing libidn2 security updates [production]
13:32 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:32 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
13:32 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:32 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
13:31 <moritzm> rebooting ganeti1009 - ganeti1022 to pick up microcode update T228924 [production]
12:58 <XioNoX> deactivate v6 BGP to AS25596 [production]
12:57 <moritzm> installing spamassassin security updates [production]
12:53 <Urbanecm> Previous message should be "EU SWAT done" [production]
12:52 <Urbanecm> Morning SWAT done [production]
12:52 <Urbanecm> Purge https://en.wikipedia.org/static/images/project-logos/zh_classicalwiki*.png (T243509) [production]
12:51 <urbanecm@deploy1001> Synchronized static/images/project-logos/: SWAT: af0b745: Update logo for zh_classical wiki (T243509) (duration: 01m 06s) [production]
12:45 <urbanecm@deploy1001> Synchronized dblists/mobilemainpagelegacy.dblist: SWAT: e9387b2: Disable MobileFrontend Mainpage special casing on frwiktionary (T241888) (duration: 01m 05s) [production]
12:40 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 5f13c19: Add minerva custom log for la.wiki (T240728; 2/2) (duration: 01m 06s) [production]
12:37 <urbanecm@deploy1001> Synchronized static/images/mobile/copyright/: SWAT: 5f13c19: Add minerva custom log for la.wiki (T240728; 1/2) (duration: 01m 06s) [production]
12:35 <moritzm> installing openjpeg2 security updates [production]
12:31 <Urbanecm> Purge https://en.wikipedia.org/static/images/mobile/copyright/wikipedia-wordmark-szl.svg (T233104) [production]
12:30 <urbanecm@deploy1001> Synchronized static/images/mobile/copyright/: SWAT: 76e67cd: e266e25: Add wordmarks for szlwiki and etwiki (T233104, T230379) (duration: 01m 06s) [production]
12:29 <urbanecm@deploy1001> Synchronized static/images/mobile/copyright/: SWAT: 76e67cd: e266e25: Add static wordmarks for szlwiki and etwiki (T233104, T230379) (duration: 01m 06s) [production]
12:25 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 32e0356: Add vzg-easydb.gbv.de to the wgCopyUploadsDomains (T243118) (duration: 01m 07s) [production]
12:20 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 6c48af8: Assign editautopatrolprotected to hewiki patrollers (T243665) (duration: 01m 06s) [production]
12:14 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 6b497e7: Wikidata - enable TaintedRefs (T241989) (duration: 01m 06s) [production]
12:09 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 0c0ef87: Add wgImportSources for hiwikibooks (T244022) (duration: 01m 05s) [production]
12:07 <urbanecm@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: Remove $wgImgAuthDetails=true (T153459) (duration: 01m 36s) [production]
11:38 <ema> powercycle cp3057 T244127 T238305 [production]
10:24 <godog> temp disable puppet on cp hosts as precaution for https://gerrit.wikimedia.org/r/c/operations/puppet/+/563977 [production]
10:08 <moritzm> installing sudo security updates on stretch [production]
2020-02-02 §
19:25 <effie> restart varnish on cp4028 [production]
08:48 <effie> reboot host analytics1061 - T244081 [production]
2020-02-01 §
18:17 <effie> pool scb2003, no need for host to stay depooled - T244069 [production]
17:46 <cdanis> T243634 ✔️ cdanis@cp4030.ulsfo.wmnet ~ 🕐☕ sudo varnish-frontend-restart [production]
17:27 <effie> depool scb2003 T244069 [production]
16:51 <effie> pool mw1273 [production]
16:50 <effie> pool scb2003 [production]
16:30 <elukey> powerup analytics1073 (attempt to see if it was only a kernel-related crash) - T244064 [production]
16:16 <effie> poweroff analytics1073 - T244064 [production]
16:16 <effie> poweroff analytics1073 - /T244064 [production]
16:16 <effie> poweroff analytics1073 [production]