2001-2050 of 10000 results (30ms)
2021-06-24 ยง
19:04 <dduvall> preparing to roll group2 to 1.37.0-wmf.11 (T281152) (cc risky patch contacts Amir1 Krinkle DannyS712) [production]
19:02 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:56 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
18:21 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:18 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
18:17 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
18:12 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
17:12 <dduvall@deploy1002> Synchronized php: group1 wikis to 1.37.0-wmf.11 (duration: 01m 06s) [production]
17:11 <dduvall@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.37.0-wmf.11 [production]
17:08 <dduvall> re-rolling group1 to 1.37.0-wmf.11 (T281152) following deployment of blocker fixes (cc risky patch contacts Amir1 Krinkle DannyS712) [production]
16:12 <twentyafterfour> restarted php7.3-fpm on phab1001 [production]
15:43 <hnowlan> running `nodetool decommission` on maps2007 [production]
15:42 <hnowlan@puppetmaster1001> conftool action : set/pooled=no; selector: name=maps2007.codfw.wmnet [production]
15:42 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on maps2007.codfw.wmnet with reason: depooling and reimaging as buster replica [production]
15:42 <hnowlan@cumin1001> START - Cookbook sre.hosts.downtime for 1 day, 0:00:00 on maps2007.codfw.wmnet with reason: depooling and reimaging as buster replica [production]
15:31 <moritzm> installing jackson-databind security updates [production]
15:26 <moritzm> installing ruby-websocket-extensions security updates [production]
15:02 <hnowlan> reenabling puppet on P{C:Postgresql::Slave} [production]
14:59 <moritzm> restarting mw canaries to pick up libxml2 security update [production]
14:57 <moritzm> installing libxml2 security updates on buster [production]
14:46 <hnowlan> Disabling puppet on P{C:Postgresql::Slave} (netboxdb2001,puppetdb2002, most maps hosts) to test https://gerrit.wikimedia.org/r/c/operations/puppet/+/700071 [production]
13:29 <volans> uploaded python3-wmflib_0.0.8 to apt.wikimedia.org buster-wikimedia,bullseye-wikimedia [production]
12:45 <tgr> EU deploys done [production]
12:44 <tgr@deploy1002> Finished scap: Backport: [[gerrit:701364|Re-apply "Add custom signup flow for donors", step 3 (T284799 T284740 T284800 T285281)]] (duration: 26m 07s) [production]
12:18 <tgr@deploy1002> Started scap: Backport: [[gerrit:701364|Re-apply "Add custom signup flow for donors", step 3 (T284799 T284740 T284800 T285281)]] [production]
12:08 <tgr@deploy1002> Synchronized php-1.37.0-wmf.9/extensions/GrowthExperiments: Backport: [[gerrit:701363|Re-apply "Add custom signup flow for donors", step 2 (T284799 T284740 T284800 T285281)]] (duration: 01m 06s) [production]
11:53 <jayme> import dragonfly_1.0.6-1 into buster-wikimedia [production]
11:44 <jayme@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 14 days, 0:00:00 on registry2008.codfw.wmnet with reason: Dragonfly tests (jayme) [production]
11:44 <jayme@cumin1001> START - Cookbook sre.hosts.downtime for 14 days, 0:00:00 on registry2008.codfw.wmnet with reason: Dragonfly tests (jayme) [production]
11:37 <jayme> depooling registry2008 for some dragonfly testing [production]
11:37 <jayme@cumin1001> conftool action : set/pooled=inactive; selector: name=registry2008.codfw.wmnet,dc=codfw,cluster=docker-registry [production]
11:34 <tgr@deploy1002> Synchronized php-1.37.0-wmf.9/extensions/GrowthExperiments: Backport: [[gerrit:701361|Re-apply "Add custom signup flow for donors", step 1 (T284799 T284740 T284800 T285281)]] (duration: 01m 06s) [production]
11:25 <tgr@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:699290|Update $wgNamespacesToBeSearchedDefault for wikimania (T284793)]] (duration: 01m 07s) [production]
11:21 <tgr@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:701225|Enable OCR tool on all Wikisources (T285311)]] (duration: 01m 06s) [production]
11:10 <tgr@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:701351|GrowthExperiments: Enable link recommendation feature for more wikis (T284481)]] (duration: 01m 07s) [production]
09:22 <marostegui@cumin1001> dbctl commit (dc=all): 'Adjust s1 weights T284897', diff saved to https://phabricator.wikimedia.org/P16723 and previous config saved to /var/cache/conftool/dbconfig/20210624-092226-marostegui.json [production]
09:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Adjust s1 weights T284897', diff saved to https://phabricator.wikimedia.org/P16722 and previous config saved to /var/cache/conftool/dbconfig/20210624-092157-marostegui.json [production]
09:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Adjust s1 weights T284897', diff saved to https://phabricator.wikimedia.org/P16721 and previous config saved to /var/cache/conftool/dbconfig/20210624-092105-marostegui.json [production]
09:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Adjust s1 weights T284897', diff saved to https://phabricator.wikimedia.org/P16720 and previous config saved to /var/cache/conftool/dbconfig/20210624-092029-marostegui.json [production]
09:19 <marostegui@cumin1001> dbctl commit (dc=all): 'Adjust s1 weights T284897', diff saved to https://phabricator.wikimedia.org/P16719 and previous config saved to /var/cache/conftool/dbconfig/20210624-091949-marostegui.json [production]
09:17 <marostegui@cumin1001> dbctl commit (dc=all): 'Adjust s2 weights T284897', diff saved to https://phabricator.wikimedia.org/P16718 and previous config saved to /var/cache/conftool/dbconfig/20210624-091753-marostegui.json [production]
09:02 <ladsgroup@deploy1002> Synchronized php-1.37.0-wmf.11/includes: Backport: [[gerrit:701191|media: Make the file metadata "_error" check looser (T285431)]] (duration: 01m 12s) [production]
08:55 <legoktm> root@lists1001:/var/log/mailman# rm -rf * [production]
08:41 <marostegui@cumin1001> dbctl commit (dc=all): 'Adjust s3 weights T284897', diff saved to https://phabricator.wikimedia.org/P16717 and previous config saved to /var/cache/conftool/dbconfig/20210624-084147-marostegui.json [production]
08:14 <marostegui@cumin1001> dbctl commit (dc=all): 'Adjust s5 weights T284897', diff saved to https://phabricator.wikimedia.org/P16716 and previous config saved to /var/cache/conftool/dbconfig/20210624-081409-marostegui.json [production]
08:12 <marostegui@cumin1001> dbctl commit (dc=all): 'Adjust s5 weights T284897', diff saved to https://phabricator.wikimedia.org/P16715 and previous config saved to /var/cache/conftool/dbconfig/20210624-081251-marostegui.json [production]
08:11 <marostegui@cumin1001> dbctl commit (dc=all): 'Adjust s5 weights T284897', diff saved to https://phabricator.wikimedia.org/P16714 and previous config saved to /var/cache/conftool/dbconfig/20210624-081137-marostegui.json [production]
08:09 <marostegui@cumin1001> dbctl commit (dc=all): 'Remove db1130 from s5 api T284897', diff saved to https://phabricator.wikimedia.org/P16713 and previous config saved to /var/cache/conftool/dbconfig/20210624-080945-marostegui.json [production]
08:09 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:45:00 on 216 hosts with reason: Change replication monitoring config T284897 [production]
08:08 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 0:45:00 on 216 hosts with reason: Change replication monitoring config T284897 [production]