1051-1100 of 10000 results (53ms)
2019-02-04 §
18:22 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Clean-up: Drop reading for wgEcho*FooterNotice*, unread (duration: 00m 46s) [production]
18:18 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: Clean-up: Stop setting wgEchoConfig, unused since 2016 (duration: 00m 48s) [production]
18:11 <jforrester@deploy1001> Synchronized dblists/: T213504: Finally, drop the wikidatarepo dblist (duration: 00m 45s) [production]
18:09 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: T213504: Stop telling CommonsSettings about the wikidatarepo dblist (duration: 00m 45s) [production]
18:06 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T213504: Unconfigure the wikidatarepo dblist (duration: 00m 46s) [production]
18:05 <XioNoX> manually rotate log file wtmp on csw2-esams [production]
18:02 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T213504: Configure wikibaserepo dblist just like the wikidatarepo one (duration: 00m 46s) [production]
17:58 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: T213504: Tell CommonSettings about the new wikibaserepo dblist (duration: 00m 47s) [production]
17:56 <jforrester@deploy1001> Synchronized dblists/wikibaserepo.dblist: T213504: Create the new wikibaserepo dblist (duration: 00m 47s) [production]
17:25 <papaul> powering down thumbor2002 for disk replacement [production]
17:10 <XioNoX> revert ospf metrics to normal values on esams-eqiad Level3 link [production]
16:50 <Lucas_WMDE> deployed patch for T212118 [production]
12:41 <Lucas_WMDE> EU SWAT done [production]
12:40 <lucaswerkmeister-wmde@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:477522|Fix Wikidata base URI in client config (T198946)]] (duration: 00m 46s) [production]
12:34 <ladsgroup@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:487076|Populate wmgWikibaseRepoSpecialSiteLinkGroups for commonswiki (T213975)]] (duration: 00m 51s) [production]
11:04 <moritzm> installing ghostscript security updates [production]
08:48 <jynus> fixing dbstore1002 x1 replication [production]
07:56 <vgutierrez> uploaded certcentral 0.8 to apt.wikimedia.org (stretch) - T209980 T213820 T213301 [production]
2019-02-03 §
20:25 <elukey> powercycle mw1272 - no ssh, no tty available via com2 - DIMM correctable errors + OEM errors registered in getsel [production]
18:56 <elukey> started a tmux session on dbstore1002 to migrate all the tokudb tables of mediawikiwiki to InnoDB - (s3 replication broken) [production]
17:53 <elukey> start all slaves on dbstore1002 (After a crash + recovery) + moved mediawikiwiki.revision_actor_temp to Innodb to unblock s3 slave replication (still broken though) [production]
04:55 <legoktm@deploy1001> Synchronized wmf-config/extension-list: Remove WikibaseQuality from extensions-list (T208499) (duration: 00m 51s) [production]
01:10 <elukey> powercycle mw1299 - can't ssh nor get a tty via console - racadm getsel shows "An OEM diagnostic event occurred." [production]
2019-02-02 §
20:42 <chaomodus> restarted pdfrender on scb1003 [production]
20:41 <chaomodus> restarted pdfrender on scb1004 [production]
20:06 <chaomodus> parsoid was failed on scandium and alerting, the service parsoid-vd was restarted and appears to have come back [production]
05:44 <jforrester@deploy1001> Synchronized php-1.33.0-wmf.14/extensions/VisualEditor/lib/ve/src/ui/dialogs/ve.ui.FindAndReplaceDialog.js: b/src/ui/dialogs/ve.ui.FindAndReplaceDialog.js T214963 Hot-deploy VE fix to stop hitting user pref writes without debounce (duration: 01m 02s) [production]
2019-02-01 §
23:16 <vgutierrez> restart pdfrender on scb1004 [production]
21:57 <ejegg> updated payments-wiki-staging from 7767c7027e to 52a271e681 [production]
21:25 <ejegg> updated payments-wiki-staging to fundraising/REL1_31 branch [production]
07:13 <bawolff_> reset 2FA on wikitech for [[User:Cicalese]] [production]
2019-01-31 §
17:44 <jynus> running alter table on metawiki.revision_actor_temp, trying to fix TokuDB horrible bugs [production]
15:54 <jynus> stop, upgrade and restart db1117 [production]
13:34 <mvolz@deploy1001> scap-helm zotero finished [production]
13:34 <mvolz@deploy1001> scap-helm zotero cluster codfw completed [production]
13:34 <mvolz@deploy1001> scap-helm zotero upgrade production -f zotero-values-codfw.yaml stable/zotero [namespace: zotero, clusters: codfw] [production]
13:31 <mvolz@deploy1001> scap-helm zotero finished [production]
13:31 <mvolz@deploy1001> scap-helm zotero cluster eqiad completed [production]
13:31 <mvolz@deploy1001> scap-helm zotero upgrade production -f zotero-values-eqiad.yaml stable/zotero [namespace: zotero, clusters: eqiad] [production]
13:19 <mvolz@deploy1001> scap-helm zotero finished [production]
13:19 <mvolz@deploy1001> scap-helm zotero cluster staging completed [production]
13:19 <mvolz@deploy1001> scap-helm zotero upgrade staging -f zotero-values-staging.yaml --version=0.0.1 stable/zotero [namespace: zotero, clusters: staging] [production]
13:18 <mvolz@deploy1001> scap-helm zotero upgrade staging -f zotero-values-staging.yaml stable/zotero [namespace: zotero, clusters: staging] [production]
12:54 <jynus> stop, upgrade and restart db2044 [production]
12:12 <jynus> apply new grants to m5-master with replication T214740 [production]
11:30 <arturo> T215012 icinga downtime cloudvirt1015 for 4h while investigating issues [production]
11:24 <arturo> T215012 reboot cloudvirt1015 [production]
11:24 <jynus> restart eventstreams on scb1002,3,4 [production]
11:22 <jynus> restart eventstreams on scb1001 [production]
10:22 <jynus> resetting to defaults innodb consistency options for db2048 T188327 [production]