901-950 of 10000 results (46ms)
2018-02-23 §
15:58 <moritzm> rebooting job runners in codfw for kernel security updates [production]
15:27 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1083 (duration: 02m 21s) [production]
15:15 <jynus> about to deploy gerrit:413375 disabling puppet on affected hosts [production]
14:59 <elukey> update facts on puppet compiler [production]
14:40 <moritzm> installing kernel updates on API servers in codfw [production]
14:09 <jynus> restarting tendril database- will case unavailability of dbtree for a while [production]
13:44 <moritzm> reboot ocg1003 for tests [production]
13:11 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1083 and fully repool db1076 (duration: 01m 13s) [production]
12:28 <hashar@tin> Synchronized wmf-config/throttle.php: Define new throttle rule - T188090 (duration: 01m 11s) [production]
12:16 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1083 (duration: 01m 21s) [production]
12:09 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1076 - T186321 (duration: 01m 12s) [production]
11:38 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1076 - T186321 (duration: 01m 13s) [production]
11:29 <marostegui> Restart mariadb on db1076 for binlog format change - T186321 [production]
11:28 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1076 for binlog format change - T186321 (duration: 01m 08s) [production]
11:03 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1090 after alter table (duration: 01m 12s) [production]
11:02 <moritzm> installing kernel updates on mw* in codfw [production]
10:30 <hashar> releases1001: sudo -u jenkins rm -fR /var/lib/jenkins/jobs/mediawiki-private-nightlies/workspace/BRANCH/REL1_??/mediawiki-snapshot-REL1_??-2018???? # T188080 [production]
10:19 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Pool db2090 for the first time (duration: 01m 12s) [production]
10:08 <jynus@tin> Synchronized wmf-config/db-codfw.php: Pool db2090 for the first time (duration: 01m 12s) [production]
10:01 <elukey> restart hhvm on mw1230 [production]
09:54 <elukey> restart hhvm on mw1286 [production]
09:50 <elukey> restart hhvm on mw1227 [production]
08:05 <marostegui> MariaDB and kernel upgrade on db1083 [production]
07:58 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1083, fully repool db1089 - T162807 (duration: 01m 12s) [production]
06:55 <marostegui> Reboot db2093 to test /srv auto-mounting [production]
06:40 <marostegui> Deploy schema change on db1090 - T187089 T185128 T153182 [production]
06:38 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1090 for alter table (duration: 01m 13s) [production]
05:58 <mutante> puppetmaster1001 - signing puppet certs for kafkamon1001/kafkamon2001 - initial puppet runs, adding as role spare (T187901) [production]
05:40 <mutante> ganeti1004 - initial startup of kafkamon1001 - booting to PXE, installing stretch (T187901) [production]
04:56 <mutante> ganeti: ganeti2004 - creating new VM kafkamon2001 - vcpus=2,memory=8g,disk=60G, row_A codfw (T187901) [production]
04:53 <mutante> ganeti: creating new VM kafkamon1001 - vcpus=2,memory=8g,disk=60G, row_A eqiad (T187901) [production]
02:46 <demon@tin> Finished deploy [gerrit/gerrit@23ebf75]: deploying webhooks plugin (duration: 00m 10s) [production]
02:46 <demon@tin> Started deploy [gerrit/gerrit@23ebf75]: deploying webhooks plugin [production]
02:10 <demon@tin> Synchronized docroot/: mw.org docroot moving (duration: 01m 13s) [production]
01:45 <eileen> update process control process-control config revision is 1605238b2e [production]
01:20 <eileen> update civicrm revision changed from aa251f1a93 to a47eafcbad, config revision is c1787646bc [production]
01:19 <demon@tin> Synchronized static/favicon/: smaller favicons (duration: 01m 12s) [production]
01:13 <demon@tin> Synchronized wmf-config/InitialiseSettings.php: point mkwikt favicon to en version, dupe (duration: 01m 15s) [production]
01:08 <demon@tin> Synchronized wmf-config/InitialiseSettings.php: rtl wikibooks logo (duration: 01m 13s) [production]
01:06 <demon@tin> Synchronized static/favicon/wikibooks-rtl.ico: rtl wikibooks logo (duration: 01m 12s) [production]
00:52 <demon@tin> Synchronized static/images/project-logos/: new project logos for urdu wikt (duration: 01m 13s) [production]
00:37 <krinkle@tin> Synchronized docroot/m.wikipedia.org/w/mobilelanding.php: Ia54cd736f30808 - rm use of MW_LANG (duration: 01m 13s) [production]
2018-02-22 §
22:33 <demon@tin> Synchronized php-1.31.0-wmf.22/includes/filerepo/file/LocalFile.php: Id5cdd8ec (duration: 01m 12s) [production]
22:32 <demon@tin> Synchronized php-1.31.0-wmf.22/includes/externalstore/: Id5cdd8ec (duration: 01m 12s) [production]
22:30 <demon@tin> Synchronized php-1.31.0-wmf.22/includes/Storage/: Id5cdd8ec (duration: 01m 13s) [production]
22:16 <maxsem@tin> Synchronized php-1.31.0-wmf.21/extensions/SyntaxHighlight_GeSHi/: T188019 (duration: 01m 12s) [production]
22:14 <maxsem@tin> Synchronized php-1.31.0-wmf.22/extensions/SyntaxHighlight_GeSHi/: T188019 (duration: 01m 14s) [production]
21:51 <demon@tin> Synchronized php-1.31.0-wmf.22/includes/externalstore/: I9334d36e (duration: 01m 15s) [production]
21:37 <dzahn@puppetmaster1001> conftool action : set/pooled=no; selector: name=wdqs1004.eqiad.wmnet [production]
21:11 <gehel> powercycling wdqs1004 (complete loss of network) [production]