3201-3250 of 10000 results (26ms)
2020-08-03 ยง
18:09 <dcausse@deploy1001> Finished deploy [wdqs/wdqs@20dcff3]: deploy 0.3.43 and gui update (duration: 15m 53s) [production]
17:53 <dcausse@deploy1001> Started deploy [wdqs/wdqs@20dcff3]: deploy 0.3.43 and gui update [production]
17:33 <liw@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.2 [production]
17:28 <dcausse@deploy1001> Finished deploy [wdqs/wdqs@20dcff3]: (no justification provided) (duration: 00m 35s) [production]
17:28 <dcausse@deploy1001> Started deploy [wdqs/wdqs@20dcff3]: (no justification provided) [production]
16:58 <liw@deploy1001> rebuilt and synchronized wikiversions files: Revert "group2 wikis to 1.36.0-wmf.1" [production]
16:21 <oblivian@deploy1001> helmfile [codfw] Ran 'sync' command on namespace 'blubberoid' for release 'production' . [production]
16:16 <oblivian@deploy1001> helmfile [eqiad] Ran 'sync' command on namespace 'blubberoid' for release 'production' . [production]
16:02 <oblivian@deploy1001> helmfile [staging] Ran 'sync' command on namespace 'blubberoid' for release 'staging' . [production]
15:55 <_joe_> regenerating the TLS certs for blubberoid [production]
15:33 <XioNoX> standardize all routers routing-options config [production]
15:27 <marostegui> Change PK on frwiktionary.revision on db2087:3317, db2129, db2121 db2086:3317 T259524 [production]
15:16 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
15:14 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:12 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
15:12 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
15:12 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
15:12 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
15:12 <andrew@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
15:12 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:11 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:11 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:11 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:11 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:11 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:11 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:11 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:10 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:51 <marostegui@cumin1001> dbctl commit (dc=all): 'Slowly repool db1106', diff saved to https://phabricator.wikimedia.org/P12143 and previous config saved to /var/cache/conftool/dbconfig/20200803-145111-marostegui.json [production]
14:40 <moritzm> update Buster netboot images to Buster 10.5 T259519 [production]
14:33 <XioNoX> disable all ALGs from pfw3-codfw [production]
14:28 <XioNoX> remove IGMP and PIM from pfw3-codfw security zones [production]
14:27 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1089 into dump and depool db1106', diff saved to https://phabricator.wikimedia.org/P12142 and previous config saved to /var/cache/conftool/dbconfig/20200803-142749-marostegui.json [production]
14:27 <XioNoX> remove nonstop-bridging from fasw-c-codfw - T191667 [production]
14:22 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:20 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:04 <filippo@deploy1001> Finished deploy [librenms/librenms@413e006]: Upgrade LibreNMS to 1.66 - T257017 (duration: 00m 23s) [production]
14:03 <filippo@deploy1001> Started deploy [librenms/librenms@413e006]: Upgrade LibreNMS to 1.66 - T257017 [production]
14:00 <cdanis> โœ”๏ธ cdanis@cumin1001.eqiad.wmnet ~ ๐Ÿ•™โ˜• sudo cumin A:puppetmaster 'enable-puppet "cdanis deploying I92e9a05"' [production]
13:56 <cdanis> โœ”๏ธ cdanis@cumin1001.eqiad.wmnet ~ ๐Ÿ•™โ˜• sudo cumin A:puppetmaster 'disable-puppet "cdanis deploying I92e9a05"' [production]
13:27 <moritzm> installing libopenmpt security updates [production]
13:15 <XioNoX> remove nonstop-bridging from asw-d-codfw - T191667 [production]
13:14 <XioNoX> remove nonstop-bridging from asw-c-codfw - T191667 [production]
13:12 <XioNoX> remove nonstop-bridging from asw-b-codfw - T191667 [production]
13:11 <XioNoX> remove nonstop-bridging from asw-a-codfw - T191667 [production]
13:05 <moritzm> installing json-c security updates [production]
12:53 <XioNoX> move VRRP master to cr3-eqsin [production]
12:32 <liw@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.36.0-wmf.2 [production]
12:26 <moritzm> installing apache-log4j1.2 security updates [production]
12:20 <moritzm> restarting nginx on francium to pick up luajit update [production]