3901-3950 of 10000 results (40ms)
2021-12-03 §
08:58 <jmm@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host ganeti2009.codfw.wmnet with OS buster [production]
08:45 <marostegui@cumin1001> dbctl commit (dc=all): 'After maintenance db1161', diff saved to https://phabricator.wikimedia.org/P18017 and previous config saved to /var/cache/conftool/dbconfig/20211203-084528-marostegui.json [production]
08:44 <oblivian@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
08:43 <oblivian@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
08:30 <marostegui@cumin1001> dbctl commit (dc=all): 'After maintenance db1161 (T277354)', diff saved to https://phabricator.wikimedia.org/P18016 and previous config saved to /var/cache/conftool/dbconfig/20211203-083023-marostegui.json [production]
08:30 <jmm@cumin2002> START - Cookbook sre.hosts.reimage for host ganeti2009.codfw.wmnet with OS buster [production]
08:29 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1161 (T277354)', diff saved to https://phabricator.wikimedia.org/P18015 and previous config saved to /var/cache/conftool/dbconfig/20211203-082859-marostegui.json [production]
08:28 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on clouddb[1016,1020-1021].eqiad.wmnet,db[1154,1161].eqiad.wmnet with reason: Maintenance T277354 [production]
08:28 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on clouddb[1016,1020-1021].eqiad.wmnet,db[1154,1161].eqiad.wmnet with reason: Maintenance T277354 [production]
08:28 <marostegui@cumin1001> dbctl commit (dc=all): 'After maintenance db1110 (T277354)', diff saved to https://phabricator.wikimedia.org/P18014 and previous config saved to /var/cache/conftool/dbconfig/20211203-082848-marostegui.json [production]
08:13 <marostegui@cumin1001> dbctl commit (dc=all): 'After maintenance db1110', diff saved to https://phabricator.wikimedia.org/P18013 and previous config saved to /var/cache/conftool/dbconfig/20211203-081343-marostegui.json [production]
07:58 <marostegui@cumin1001> dbctl commit (dc=all): 'After maintenance db1110', diff saved to https://phabricator.wikimedia.org/P18012 and previous config saved to /var/cache/conftool/dbconfig/20211203-075839-marostegui.json [production]
07:43 <marostegui@cumin1001> dbctl commit (dc=all): 'After maintenance db1110 (T277354)', diff saved to https://phabricator.wikimedia.org/P18011 and previous config saved to /var/cache/conftool/dbconfig/20211203-074334-marostegui.json [production]
07:39 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1110 (T277354)', diff saved to https://phabricator.wikimedia.org/P18010 and previous config saved to /var/cache/conftool/dbconfig/20211203-073910-marostegui.json [production]
07:39 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1110.eqiad.wmnet with reason: Maintenance T277354 [production]
07:39 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on db1110.eqiad.wmnet with reason: Maintenance T277354 [production]
07:34 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1150.eqiad.wmnet with reason: Maintenance T277354 [production]
07:34 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on db1150.eqiad.wmnet with reason: Maintenance T277354 [production]
07:34 <marostegui@cumin1001> dbctl commit (dc=all): 'After maintenance db1144:3315 (T277354)', diff saved to https://phabricator.wikimedia.org/P18009 and previous config saved to /var/cache/conftool/dbconfig/20211203-073404-marostegui.json [production]
07:19 <marostegui@cumin1001> dbctl commit (dc=all): 'After maintenance db1144:3315', diff saved to https://phabricator.wikimedia.org/P18008 and previous config saved to /var/cache/conftool/dbconfig/20211203-071900-marostegui.json [production]
07:03 <marostegui@cumin1001> dbctl commit (dc=all): 'After maintenance db1144:3315', diff saved to https://phabricator.wikimedia.org/P18007 and previous config saved to /var/cache/conftool/dbconfig/20211203-070355-marostegui.json [production]
06:48 <marostegui@cumin1001> dbctl commit (dc=all): 'After maintenance db1144:3315 (T277354)', diff saved to https://phabricator.wikimedia.org/P18006 and previous config saved to /var/cache/conftool/dbconfig/20211203-064850-marostegui.json [production]
06:28 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1125.eqiad.wmnet with OS bullseye [production]
06:20 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1144:3315 (T277354)', diff saved to https://phabricator.wikimedia.org/P18005 and previous config saved to /var/cache/conftool/dbconfig/20211203-062019-marostegui.json [production]
06:20 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1144.eqiad.wmnet with reason: Maintenance T277354 [production]
06:20 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on db1144.eqiad.wmnet with reason: Maintenance T277354 [production]
06:20 <marostegui@cumin1001> dbctl commit (dc=all): 'After maintenance db1113:3315 (T277354)', diff saved to https://phabricator.wikimedia.org/P18004 and previous config saved to /var/cache/conftool/dbconfig/20211203-062011-marostegui.json [production]
06:05 <marostegui@cumin1001> dbctl commit (dc=all): 'After maintenance db1113:3315', diff saved to https://phabricator.wikimedia.org/P18003 and previous config saved to /var/cache/conftool/dbconfig/20211203-060506-marostegui.json [production]
06:02 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host db1125.eqiad.wmnet with OS bullseye [production]
05:50 <marostegui@cumin1001> dbctl commit (dc=all): 'After maintenance db1113:3315', diff saved to https://phabricator.wikimedia.org/P18002 and previous config saved to /var/cache/conftool/dbconfig/20211203-055001-marostegui.json [production]
05:34 <marostegui@cumin1001> dbctl commit (dc=all): 'After maintenance db1113:3315 (T277354)', diff saved to https://phabricator.wikimedia.org/P18001 and previous config saved to /var/cache/conftool/dbconfig/20211203-053457-marostegui.json [production]
05:30 <marostegui@cumin1001> dbctl commit (dc=all): 'Depooling db1113:3315 (T277354)', diff saved to https://phabricator.wikimedia.org/P18000 and previous config saved to /var/cache/conftool/dbconfig/20211203-053032-marostegui.json [production]
05:30 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on db1113.eqiad.wmnet with reason: Maintenance T277354 [production]
05:30 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on db1113.eqiad.wmnet with reason: Maintenance T277354 [production]
01:39 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host restbase2025.codfw.wmnet with OS buster [production]
01:06 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host restbase2025.codfw.wmnet with OS buster [production]
01:05 <pt1979@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host restbase2024.codfw.wmnet with OS buster [production]
01:01 <tgr> UTC late deploys done [production]
01:00 <tgr@deploy1002> Synchronized php-1.38.0-wmf.9/extensions/GrowthExperiments: Backport: [[gerrit:743177|Add an image: Add test version of GEInfoboxTemplates (T291232)]] (duration: 00m 57s) [production]
00:44 <rzl> rzl@apt1001:~$ sudo -i reprepro -C main include buster-wikimedia /home/rzl/python3-imagecatalog/imagecatalog_0.0.1-1_amd64.changes [production]
00:37 <tgr@deploy1002> Synchronized php-1.38.0-wmf.9/extensions/GrowthExperiments/includes: Backport: [[gerrit:743178|Avoid references to TemplateCollectionFeature]] step2 (duration: 00m 56s) [production]
00:36 <tgr@deploy1002> Synchronized php-1.38.0-wmf.9/extensions/GrowthExperiments/includes/Config/Validation/GrowthConfigValidation.php: Backport: [[gerrit:743178|Avoid references to TemplateCollectionFeature]] step 1 (duration: 00m 56s) [production]
00:33 <pt1979@cumin2002> START - Cookbook sre.hosts.reimage for host restbase2024.codfw.wmnet with OS buster [production]
2021-12-02 §
20:05 <legoktm> re-pooling mw1414 following testing [production]
19:35 <legoktm> installing yaml PHP extension on canaries [production]
19:29 <andrewbogott> upgrading wikitech-static deb packages as well as moving to mediawiki 1.37.0 [production]
19:26 <majavah> UTC evening deploys done [production]
19:26 <taavi@deploy1002> Synchronized php-1.38.0-wmf.9/extensions/WikimediaEvents/modules/ext.wikimediaEvents/webUIScroll.js: Backport: [[gerrit:743227|Update scroll instrument (T294246)]] (duration: 00m 56s) [production]
19:22 <taavi@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:720363|Drop old config names for CentralAuth denylist controls (T277932)]] (duration: 00m 56s) [production]
19:12 <taavi@deploy1002> Synchronized wmf-config: Config: [[gerrit:739032|GrowthExperiments configuration fixes (T294737)]] (duration: 00m 57s) [production]