1651-1700 of 10000 results (63ms)
2020-01-06 §
09:51 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
09:32 <moritzm> reimaging mw2282 to validate correctness of apt::package_from_component for fresh installs [production]
07:37 <Amir1> ladsgroup@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildItemTerms.php --wiki=wikidatawiki --batch-size=100 --sleep=2 --file=/tmp/1mio.lines (T219301) [production]
03:53 <Amir1> ladsgroup@mwmaint1002:~$ mwscript extensions/Wikibase/repo/maintenance/rebuildItemTerms.php --wiki=wikidatawiki --batch-size=100 --sleep=2 --file=/tmp/100k.lines (T219301) [production]
00:06 <effie> pool cp3065 T238305 [production]
00:05 <jiji@cumin1001> conftool action : set/pooled=yes; selector: name=cp3065.esams.wmnet [production]
2020-01-05 §
23:56 <effie> powecycle cp3065.esams.wmnet T238305 [production]
23:53 <jiji@cumin1001> conftool action : set/pooled=no; selector: name=cp3065.esams.wmnet [production]
13:09 <Urbanecm> mwmaint1002: mwscript importImages.php --wiki=commonswiki --comment-ext=txt --user=Coffeeandcrumbs /home/urbanecm/T241917 (T241917) [production]
2020-01-04 §
16:34 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:34 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:34 <aborrero@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
16:34 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]
2020-01-03 §
22:14 <volker-e@deploy1001> Finished deploy [design/style-guide@8054026]: Deploy design/style-guide: (duration: 00m 08s) [production]
22:14 <volker-e@deploy1001> Started deploy [design/style-guide@8054026]: Deploy design/style-guide: [production]
17:44 <jynus@cumin1001> dbctl commit (dc=all): 'Repool db2084 instances T241103', diff saved to https://phabricator.wikimedia.org/P10035 and previous config saved to /var/cache/conftool/dbconfig/20200103-174447-jynus.json [production]
16:54 <ejegg> updated fundraising CiviCRM from 217a1f8c63 to 5642a92223 [production]
16:36 <jynus> stopping db2084 [production]
15:04 <marostegui> Upgrade db2107 [production]
14:58 <marostegui> Deploy schema changes on s2 and s4 eqiad hosts T234052 [production]
14:56 <jbond42> clean up old /etc/apt/preferences.d/smartmontools.pref file [production]
14:48 <jbond42> clean up old /etc/apt/preferences.d/puppet_all.pref file [production]
14:45 <jbond42> clean up old /etc/apt/preferences.d/facter.pref file [production]
14:15 <Urbanecm> Run undelete.php on a couple of pages at plwikisource per T241824 [production]
13:50 <marostegui> Deploy schema change on s4 codfw (lag will appear on codfw s4) - T234052 [production]
13:46 <moritzm> restarting exim on MXes to pick up SASL security update [production]
11:00 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1074 after schema change', diff saved to https://phabricator.wikimedia.org/P10033 and previous config saved to /var/cache/conftool/dbconfig/20200103-110028-marostegui.json [production]
10:20 <moritzm> restarting apache on cloudmetrics* to pick up SASL security update [production]
10:11 <moritzm> installing cyrus-sasl2 security updates on stretch/buster [production]
09:42 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1074 schema change', diff saved to https://phabricator.wikimedia.org/P10032 and previous config saved to /var/cache/conftool/dbconfig/20200103-094252-marostegui.json [production]
09:38 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1076 after schema change', diff saved to https://phabricator.wikimedia.org/P10031 and previous config saved to /var/cache/conftool/dbconfig/20200103-093829-marostegui.json [production]
09:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1076 schema change', diff saved to https://phabricator.wikimedia.org/P10030 and previous config saved to /var/cache/conftool/dbconfig/20200103-092107-marostegui.json [production]
08:17 <marostegui> Deploy schema change on labswiki (wikitech) T234052 [production]
07:09 <marostegui> Deploy schema change on s2 codfw master, lag will appear on codfw - T234052 [production]
06:57 <marostegui> Deploy schema change on s6 eqiad hosts - T234052 [production]
06:23 <marostegui> Deploy schema change on db2089:3316 [production]
06:22 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2089:3316 - T239453', diff saved to https://phabricator.wikimedia.org/P10029 and previous config saved to /var/cache/conftool/dbconfig/20200103-062242-marostegui.json [production]
06:21 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2087:3316 - T239453', diff saved to https://phabricator.wikimedia.org/P10028 and previous config saved to /var/cache/conftool/dbconfig/20200103-062148-marostegui.json [production]
2020-01-02 §
23:33 <ejegg> updated Fundraising CiviCRM from d534f4e966 to 217a1f8c63 [production]
23:09 <ejegg> updated Fundraising CiviCRM from 6936aa0262 to d534f4e966 [production]
22:44 <ejegg> updated fundraising CiviCRM from f4db7fdb31 to 6936aa0262 [production]
20:48 <ejegg> updated Fundraising CiviCRM from abf0019c44 to f4db7fdb31 [production]
20:30 <sbassett@deploy1001> Synchronized wmf-config/CommonSettings.php: Deploying revert of temporary patch for T241503 (permissions clean-up) (duration: 00m 53s) [production]
19:57 <sbassett@deploy1001> Synchronized wmf-config/CommonSettings.php: Deploying temporary patch for T241503 (permissions clean-up) (duration: 00m 54s) [production]
18:53 <ejegg> re-enabled fundraising cron jobs [production]
18:29 <ejegg> disabled fundraising cron jobs [production]
16:15 <moritzm> restarting Apache on graphite* hosts to pick up SASL security update [production]
16:11 <moritzm> restarting Apache on webperf* hosts to pick up SASL security update [production]
15:52 <moritzm> restarting Apache on puppetboard* hosts to pick up SASL security update [production]
15:46 <moritzm> restarting FPM on parsoid canary to pick up SASL security update [production]