101-150 of 10000 results (21ms)
2021-10-25 §
11:22 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/Wikibase.php: Config: [[gerrit:732969|Remove dispatchLagToMaxLagFactor Wikibase setting (T292604)]] (duration: 00m 54s) [production]
11:20 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:18 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/Wikibase.php: Config: [[gerrit:732951|Remove wikibaseDispatchRedisLockManager config (T292604)]] (duration: 00m 54s) [production]
11:14 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:732950|Remove wmg variables for dispatchChanges.php Wikibase settings (T292604)]] (duration: 00m 55s) [production]
11:13 <majavah> removed tons of duplicate qw jobs accross multiple tools [tools]
11:10 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:09 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/Wikibase.php: Config: [[gerrit:732949|Remove dispatchChanges.php-related Wikibase settings (T292604)]] (duration: 00m 55s) [production]
11:07 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:05 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/Wikibase.php: Config: [[gerrit:732372|Remove dispatchViaJobs-related Wikibase settings (T291828)]] (duration: 00m 56s) [production]
09:52 <godog> bounce uwsgi graphite web on graphite2003 - T294220 [production]
09:52 <volans@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
09:48 <volans@cumin1001> START - Cookbook sre.dns.netbox [production]
09:43 <lucaswerkmeister-wmde@deploy1002> Synchronized wmf-config/InitialiseSettings-labs.php: Config: [[gerrit:733089|[BETA CLUSTER] Enable WikibaseLexeme Scribunto access (T294159)]] (merged on Friday, syncing now to avoid outdated files even if it’s just -labs.php) (duration: 00m 55s) [production]
09:18 <godog> bounce graphite-web on graphite2003 to test timeout bump - T294220 [production]
08:08 <XioNoX> merge DNS changes to add drmrs [production]
07:50 <elukey@deploy1002> helmfile [ml-serve-eqiad] DONE helmfile.d/admin 'sync'. [production]
07:50 <elukey@deploy1002> helmfile [ml-serve-eqiad] START helmfile.d/admin 'sync'. [production]
07:40 <majavah> remove "arturo" from project members and instead add "aborrero" which is the real one [cloudinfra-nfs]
05:47 <oblivian@puppetmaster1001> conftool action : set/pooled=yes; selector: dc=eqiad,cluster=parsoid,name=wtp1026.* [production]
05:43 <_joe_> pooling wtp1042 T294212 [production]
05:26 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host db1109.eqiad.wmnet with OS buster [production]
05:01 <marostegui@cumin1001> START - Cookbook sre.hosts.reimage for host db1109.eqiad.wmnet with OS buster [production]
04:30 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1109 (s8) for reimage T290868', diff saved to https://phabricator.wikimedia.org/P17590 and previous config saved to /var/cache/conftool/dbconfig/20211025-043028-marostegui.json [production]
04:26 <Spookyville> Mars instance launched (again) [wikisp]
2021-10-24 §
22:39 <legoktm> one more restart of everything, switched hound container over to bullseye for newer git [codesearch]
22:20 <legoktm> restarted everything to add new prometheus metrics endpoint: https://codesearch.wmcloud.org/_metrics [codesearch]
08:51 <hashar> CI Jenkins: update Clover PHP plugin from 0.5 to 0.6 to solve `java.lang.NoClassDefFoundError: org/apache/commons/digester/Digester` # T292910 [releng]
06:58 <majavah> hard reboot crashed deployment-db08 [releng]
00:47 <andrewbogott> deploying a change so that openstack clients use tls endpoints: https://gerrit.wikimedia.org/r/c/operations/puppet/+/732738 [admin]
2021-10-23 §
16:40 <dcausse> restarting blazegraph on wdqs1004 and wdqs1006 (free allocators alert) [production]
16:06 <majavah> hard reboot codesearch8 after OOM crash [codesearch]
15:45 <urbanecm> Start server-side upload for 1 video file (T289781), testing whether T291137 is still an issue [production]
15:18 <urbanecm> tools.phabbot@tools-sgebastion-07:~$ rm ~/*.err && rm ~/*.out [tools.phabbot]
15:18 <urbanecm> Manually run `tools.phabbot@tools-sgebastion-07:~/phabbot$ ./new_wikis_handler.sh` to re-run the new wikis bot [tools.phabbot]
2021-10-22 §
23:17 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
23:13 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
22:49 <chicocvenancio> restart to run fix from PR#141 fixes T294150 [tools.video2commons]
22:36 <mutante> - deleted simplelamp temp test instance [wikistats]
22:36 <mutante> - creating new instance wikistats-bullseye for testing upgrade to next release [wikistats]
21:19 <James_F> Docker: Publishing quibble-buster-php73-coverage:1.1.1-s3 with quibble 1.1.1 and composer 2.1.8 for a change T292910 [releng]
20:57 <bblack> re-pooling eqiad in DNS [production]
20:54 <legoktm> <XioNoX> I disabled the interface on cr1, going to re-enabled the active on on cr2 [production]
20:48 <legoktm> bblack has temporarily depooled eqiad https://gerrit.wikimedia.org/r/733043 [production]
20:41 <XioNoX> disable sessions to equinix eqiad IXP [production]
19:16 <urbanecm> Start server-side upload of 1 video file (T294134) [production]
18:06 <dancy> Updating deb packages on deployment-imagescaler03.deployment-prep.eqiad1.wikimedia.cloud [releng]
16:38 <majavah> deploy https://github.com/toolforge/paws/pull/91 [paws]
15:35 <majavah> remove "^tools-k8s-master-[0-9]+\.tools\.eqiad\.wmflabs$" from authorized_regexes for the main certificate [tools]
15:35 <majavah> add mail.tools.wmcloud.org to the tools mail tls certificate alternative names [tools]
15:06 <jbond> upload puppetboard_3.1.0-1_all.deb to ullseye-wikimedia [production]