2701-2750 of 10000 results (58ms)
2019-03-18 §
13:03 <arturo> T218022 disable icinga checks for labtestservices2001.wikimedia.org [production]
12:54 <arturo> T218025 disable icinga checks for cloudnet2001-dev.codfw.wmnet [production]
12:49 <mvolz@deploy1001> scap-helm citoid finished [production]
12:49 <mvolz@deploy1001> scap-helm citoid cluster staging completed [production]
12:49 <mvolz@deploy1001> scap-helm citoid upgrade staging -f citoid-staging-values.yaml stable/citoid [namespace: citoid, clusters: staging] [production]
12:48 <mvolz@deploy1001> scap-helm citoid upgrade staging -f citoid-values-staging.yaml stable/citoid [namespace: citoid, clusters: staging] [production]
11:45 <zeljkof> EU SWAT finished [production]
11:45 <zfilipin@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:496696|Enable mobile section editing on bnwiki, hewiki, zh_yuewiki (T218375)]] (duration: 00m 50s) [production]
10:51 <_joe_> testing safety checks for php-fpm on mwdebug2001 [production]
10:35 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:497261| Bumping portals to master (T128546)]] (duration: 00m 48s) [production]
10:34 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:497261| Bumping portals to master (T128546)]] (duration: 00m 49s) [production]
10:12 <vgutierrez> uploaded acme-chief 0.12 to apt.wikimedia.org (buster) - T218543 [production]
10:12 <volans> restarted irc echo on icinga2001 [production]
10:04 <_joe_> hot-patching the error in php7.2-fpm config [production]
10:02 <volans> running puppet on hosts matching 'C:php::fpm' to apply I004349ebfab34a4b7b5a65b9b10f78817e5cf193 [production]
10:00 <volans> running puppet on failed hosts [production]
09:57 <volans> temporarily stop ircecho to avoid spam [production]
09:40 <ema> superior-cache-analyzer_3.3.7 uploaded to stretch-wikimedia T213263 [production]
09:29 <godog> switch to mpm_event for prometheus apache before merging https://gerrit.wikimedia.org/r/c/operations/puppet/+/496750 [production]
08:58 <vgutierrez> uploaded acme-chief 0.11 to apt.wikimedia.org (buster) - T207295 [production]
08:52 <moritzm> restarting ferm on sessionstore, was stuck in resolving one of the -a records, which were only merged in a subsequent step (T215883) [production]
08:50 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1104 (duration: 00m 48s) [production]
08:39 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1104 (duration: 00m 48s) [production]
08:34 <filippo@puppetmaster1001> conftool action : set/pooled=yes; selector: name=prometheus2003.codfw.wmnet [production]
08:32 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2002.codfw.wmnet,service=varnish-fe [production]
08:32 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2002.codfw.wmnet,service=nginx [production]
08:31 <ema> cp2002: repool varnish-fe to resume ATS testing T213263 [production]
08:28 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1101 (duration: 00m 48s) [production]
08:22 <moritzm> armed keyholder on neodymium [production]
07:49 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1101 (duration: 00m 48s) [production]
07:35 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1101 (duration: 00m 48s) [production]
07:24 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1101 (duration: 00m 48s) [production]
07:16 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly repool db1101 (duration: 00m 49s) [production]
07:02 <marostegui> Stop db1101 to upgrade mysql and kernel [production]
07:02 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1101 (duration: 00m 48s) [production]
06:33 <marostegui> Deploy schema change on s8 codfw master (db2045), this will generate lag on s8 codfw [production]
06:30 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1121 (duration: 00m 48s) [production]
06:08 <marostegui> Deploy schema change on x1 master (db1069) with replication - T218397 [production]
06:04 <marostegui> Deploy schema change on db1121 - lag will appear on labsdb:s4 [production]
06:03 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1121 (duration: 01m 04s) [production]
03:58 <kart_> Finished manual run of unpublished ContentTranslation draft purge script (T218279) [production]
02:00 <kart_> Started manual run of unpublished ContentTranslation draft purge script (T218279) [production]
2019-03-17 §
11:51 <Amir1> ladsgroup@mwmaint1002:~$ mwscript maintenance/createAndPromote.php --wiki=labswiki --force --sysop Ladsgroup [production]
08:49 <elukey> restart pdfrender on scb1004 [production]
2019-03-16 §
10:00 <chasemp> stop apache on cobalt for maintenance [production]
00:19 <andrewbogott> restarting slapd on seaborgium [production]
2019-03-15 §
22:37 <shdubsh> temporarily stop ircecho on icinga2001 [production]
17:59 <thcipriani@deploy1001> Synchronized php-1.33.0-wmf.21/extensions/MobileFrontend: SWAT: [[gerrit:496827|iOS: Fix mobile editor]] T218069 T218062 T218352 T211490 T218062 T211491 T172877 (duration: 00m 54s) [production]
17:53 <ema@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp2002.codfw.wmnet,service=varnish-fe [production]
17:53 <ema@puppetmaster1001> conftool action : set/pooled=no; selector: name=cp2002.codfw.wmnet,service=nginx [production]