Commit graph

1045 commits

Author SHA1 Message Date
sbailey 499a1c3796 Use new linter_namespace column and index in the Linter table
* This performance improvement patch uses the namespace from the
   new field 'linter_namespace' in the linter table instead of
   the 'page_namespace' in the page table. It checks for and
   requires the presence of the linter_namespace field in the
   linter table, as well as the config variable
   'LinterUseNamaspaceColumnStage' being set true.

 * If the linter_namespace field is present and aforementioned
   config variable is true, the code assumes that the config
   variable 'LinterWriteNamespaceColumnStage' is set true and
   recording the linter_namespace for new lint errors is
   active and the migrateNamespace.php migrate code has been
   run to migrate the page_namespace data into existing linter
   records that were created before the linter_namespace column
   existed and were left NULL during the table alter maintenance
   operation.

 * A follow on patch should remove the configuration variables and
   conditional code producing the final, refactored code dependent
   on the new namespace column index.

Bug: T299612
Change-Id: I4a1497d9e4dcd6a9a7befdaccf3e34c61694365d
2023-02-24 06:54:08 -08:00
Translation updater bot 073b0913f9 Localisation updates from https://translatewiki.net.
Change-Id: Iff04a425cf7f9f7dd55d7eb63785c3c8d49af036
2023-02-22 09:00:58 +01:00
jenkins-bot f01ada78ae Merge "Remove API action=record-lint" 2023-02-21 19:30:40 +00:00
Kunal Mehta eaf2d26db8 Remove API action=record-lint
The action=record-lint was a hack that allowed Parsoid/JS to send data
to MediaWiki to be stored in the linter database. Thankfully we no
longer need it in the glorious Parsoid/PHP world because it can write
directly to the database.

The API module, i18n messages and $wgLinterSubmitterWhitelist are all
removed.

Bug: T329992
Change-Id: Iba70e05a2e28f4ecd02101cff51993ebe65f19d0
2023-02-20 20:44:00 -05:00
Translation updater bot 1610285468 Localisation updates from https://translatewiki.net.
Change-Id: I6074176ae3428910e9e36b5e0aead19fc323424a
2023-02-20 09:46:49 +01:00
Translation updater bot 1728fde678 Localisation updates from https://translatewiki.net.
Change-Id: I093eab9c98a4240f8fc110780805a6451538938a
2023-02-17 08:56:12 +01:00
sbailey d12bf639f6 Change linter maintenance scripts to use existing config varaibles
* Having separate config variables to enable the maintenance
   migrateNamespace and migrateTagTemplate scripts is duplicitous
   and should be shared with the write enable config variables.

Bug: T329342
Change-Id: I4cb453fc0678b065cb42a2ca59863da1ab9cdbe4
2023-02-14 09:43:54 -08:00
Translation updater bot bb89c3966e Localisation updates from https://translatewiki.net.
Change-Id: I082b800600776deb081e2daf26153172753df74d
2023-02-13 08:30:24 +01:00
Translation updater bot bcee4b9b3b Localisation updates from https://translatewiki.net.
Change-Id: I936065a659f413108e2b9272648cb92df24401c6
2023-02-10 08:44:03 +01:00
jenkins-bot f82904c185 Merge "Link to detailed Special:LintErrors from action=info" 2023-02-10 02:10:20 +00:00
jenkins-bot 107b89a901 Merge "Move LoadExtensionSchemaUpdatesHook handler to separate class" 2023-02-10 02:10:19 +00:00
sbailey 2768a70218 Fix migrate data error when params has excessively long strings
* The linter migrate code for linter_tag field and linter_template
   field are constrained by the database schema to 32 characters
   for the tag field and 255 characters for the template field.
   In some anomalous circumstances parsoid can report tag and or
   template fields in the linter_params object that exceed those
   character limits. This code truncates these excessively long
   strings to protect the database migrate update code from a
   length exceeded error.

Bug: T329113
Change-Id: I8af7c44759f172eae77d3519a6eac47110e9b1e7
2023-02-09 18:20:46 +00:00
sbailey 07046457f0 Fix write error when linter_params has excessively long strings
* The linter write code for linter_tag field and linter_template
   field are constrained by the database schema to 32 characters
   for the tag field and 255 characters for the template field.
   In some anomalous circumstances parsoid can report tag and or
   template fields in the linter_params object that exceed those
   character limits. This code truncates these anomalous strings
   to protect the database update code from a length exceeded
   error.

Bug: T328979
Change-Id: I057ae2e32a9e1a7735b5300409e5693e8db5c764
2023-02-08 10:40:12 -08:00
Msz2001 e2ce10d548 Translate special page name (LintErrors) into Polish
Change-Id: I220fb8e91bef512f23ea668ad2c1ce474462ffb9
2023-02-07 01:44:25 +00:00
Kunal Mehta cb84f3a872 Link to detailed Special:LintErrors from action=info
action=info has a summary table of number of lint errors by category,
but we have richer information available via Special:LintErrors. If
there is a "Lint errors" section, provide a link below the table to
Special:LintErrors for the errors on this page.

Update ApiRecordLint for the new Hooks constructor and leave a FIXME
to eliminate the coupling.

Bug: T301374
Change-Id: Ic1fcf42b50d1392ac53201ceb256691133cf62ff
2023-02-06 20:41:45 -05:00
Kunal Mehta b5a7aaf7e0 Move LoadExtensionSchemaUpdatesHook handler to separate class
This hook is not allowed to have a service, so before we can add
services to the main Hooks class, it needs to be split out.

Change-Id: Ia7b4b8bf7c91ebb851c5de9f0f54f56b0993bf83
2023-02-06 20:36:45 -05:00
Translation updater bot f38c88c1ce Localisation updates from https://translatewiki.net.
Change-Id: I97fb32d1feb9d5634d80c10c893588eee4fa3315
2023-02-06 08:45:24 +01:00
Translation updater bot c72260fa61 Localisation updates from https://translatewiki.net.
Change-Id: Iab78305c80403f3ba80e0af04deba3ba76ab392c
2023-02-03 08:47:57 +01:00
jenkins-bot 54752eb953 Merge "Fix linter table linter_params definition to not be nullable" 2023-01-30 08:42:04 +00:00
Translation updater bot 7d18c60cbf Localisation updates from https://translatewiki.net.
Change-Id: Ica698fa9699b49f5f82f5a55233cd19da454301d
2023-01-30 08:30:21 +01:00
sbailey abbcc17511 Fix linter table linter_params definition to not be nullable
* update all schema files to correct linter_params being set nullable by accident in
   2020 during abstract definition update

 * include hook to provide 3rd party support, use $updater->modifyExtensionField(

Bug: T327806
Change-Id: I7fea08280cf2fa7956e5b300dc3365dc3561ca52
2023-01-26 12:47:36 -08:00
Translation updater bot 74730c5943 Localisation updates from https://translatewiki.net.
Change-Id: I4d1939cb2f7730fb871ef080d563de7ca4abe1a7
2023-01-10 08:25:04 +01:00
Translation updater bot 5609854d75 Localisation updates from https://translatewiki.net.
Change-Id: I56889bc4940f2a93f8342ced4278967e2d71b867
2023-01-05 09:09:00 +01:00
Translation updater bot 233543ce53 Localisation updates from https://translatewiki.net.
Change-Id: I8baaec23ba854da12a526e30dbe8169f664233e4
2022-12-29 10:01:49 +01:00
Umherirrender eb31c6c4dc Replace deprecated HTMLForm::addHeaderText
Bug: T325474
Change-Id: If1a4b14b6cec480f600065c913cb1f27260fbc5f
2022-12-27 12:48:42 +01:00
Translation updater bot c1abd29656 Localisation updates from https://translatewiki.net.
Change-Id: Ia4acd32cf4103f1471ad4e783afc55d47c92b221
2022-12-26 09:10:14 +01:00
Translation updater bot a52faf181f Localisation updates from https://translatewiki.net.
Change-Id: Ib0ed4e182943361a29fa986fce52a6ff15b5ae91
2022-12-21 09:16:16 +01:00
jenkins-bot 97cef36597 Merge "maintenance script for linter extension tag and template migration" 2022-12-16 15:38:11 +00:00
jenkins-bot fcd45f8b58 Merge "Phase 3 of T175177: Migrate linter_params into new fields" 2022-12-16 15:38:08 +00:00
Translation updater bot 6580cd4f3f Localisation updates from https://translatewiki.net.
Change-Id: I6068546041abc2c139505baff220c5427154fdb2
2022-12-15 11:36:13 +01:00
sbailey 2a3d081d43 maintenance script for linter extension tag and template migration
*  It should be safe to automatically run during wiki update on
    3rd party wikis, and requires manual invocation on enwiki.

 * The tag and template migrate for enwiki will be run by an admin
   during a backport window so the process can be monitored and
   may run for a day potentially.

Bug: T175177
Change-Id: I6ce30767300cc907639d72b34f7756f3d9563ca7
2022-12-09 12:02:10 -08:00
sbailey 350d677c5b Phase 3 of T175177: Migrate linter_params into new fields
* The migrate code is designed to perform a one-time update of
   linter_params JSON encoded template and tag information into
   the new discrete template and tag text fields for use as
   additional search criteria. The function can be restarted if
   it is interrupted.
 * It now uses configurable batching and sleep times between
   batches to allow the database to do other work and replication
   to occur without stressing infrastructure.
 * The migrate code is only called by test code and needs to be
   called one-time from a maintenance script.

Bug: T175177
Change-Id: Idc4ca88d4762bc7a3bcbc4e66c0f275562083867
2022-12-09 12:01:06 -08:00
jenkins-bot 9a46876e95 Merge "maintenance script to run linter extension namespace migration" 2022-12-08 16:06:25 +00:00
sbailey fb5bd0fc92 maintenance script to run linter extension namespace migration
*  It should be safe to automatically run during wiki update on
    3rd party wikis, and requires manual invocation on enwiki

 * The namespace migrate for enwiki will be run by an admin during
   a backport window so the process can be monitored and may run
   for a day potentially.

Bug: T299612
Change-Id: I19091a6f177e8b67d80c0b8f46782929d2e951d4
2022-12-07 07:54:19 -08:00
Translation updater bot c7f5025de3 Localisation updates from https://translatewiki.net.
Change-Id: I9af9743da0c6cc3d692cc67afd616e7dd6bf588d
2022-12-06 08:52:45 +01:00
jenkins-bot 374e9da67d Merge "Phase 3 migrate code for namespace column add to Linter table" 2022-12-01 15:41:09 +00:00
Translation updater bot 1f37da70c0 Localisation updates from https://translatewiki.net.
Change-Id: I63d0e63b632dcd20783b9a8ba3aae7bda7b00f7c
2022-11-30 08:53:09 +01:00
Translation updater bot 1030f9c2fc Localisation updates from https://translatewiki.net.
Change-Id: Ie9b9987a5d0a38cf20710abcc7af2fb9ac1ba293
2022-11-29 08:58:50 +01:00
sbailey 702ce215d0 Phase 3 migrate code for namespace column add to Linter table
* Migrates namespace info from the page tables page_namespace field
   to the new linter table field linter_namespace. This duplication
   of the namespace value was requested to greatly reduce the amount
   of database activity required by the linter search and reporting
   code.

 * This patch has been prepared as a dark launch patch enabled with
   config value LinterMigrateNamespaceStage and assumes that the
   Linter table has had the linter_namespace column added to it,
   and recording of the namespace field is already enabled and is
   populating the namespace column.

 * The migrate code now runnable from Linter/maintenance directory,
   using migrateNamespace.php, which will be deployed in a separate
   patch. The maintenance code creates an appropriate environment
   to call migrateNamespace( in Database.php.

Bug: T299612
Change-Id: I73cb80729d6a5a8716fe93164ad1e42e6958d672
2022-11-28 08:07:54 -08:00
Translation updater bot 461827e2e6 Localisation updates from https://translatewiki.net.
Change-Id: Id4c4f9cbda2327726168454412822eb8254d38a4
2022-11-28 08:49:48 +01:00
Translation updater bot babda020af Localisation updates from https://translatewiki.net.
Change-Id: Iba744a6e2698c7d96c87f282a8ee80da43337287
2022-11-22 08:33:59 +01:00
libraryupgrader 278a8aa4d6 build: Updating mediawiki/mediawiki-codesniffer to 40.0.1
Change-Id: Iaebe730ffea80a0511e027f20f909320da6bbb4f
2022-11-16 08:54:23 +00:00
Translation updater bot 7af220720d Localisation updates from https://translatewiki.net.
Change-Id: I29302b4952ac37a308277062211206edc2abce35
2022-11-04 09:03:09 +01:00
Translation updater bot 3bfe500fa1 Localisation updates from https://translatewiki.net.
Change-Id: If7e44827fddf9cec6db0f605cceb159ca76ab0be
2022-11-01 08:53:12 +01:00
Translation updater bot 910aca8e4d Localisation updates from https://translatewiki.net.
Change-Id: Ibf834457f86f0161f23cdb4d6292d9d00dc85139
2022-10-31 09:46:03 +01:00
Translation updater bot 79713a02c5 Localisation updates from https://translatewiki.net.
Change-Id: I507fc523c18ef4eaede392a0add53e0b46201ccc
2022-10-27 08:55:22 +02:00
Translation updater bot f02bbe4d05 Localisation updates from https://translatewiki.net.
Change-Id: I026bbf33223022dd7732b9d59aacf7b065386cee
2022-10-24 08:23:07 +02:00
libraryupgrader 160bce375d build: Updating minimatch to 3.0.8
* https://github.com/advisories/GHSA-f8q6-p94x-37v3

Change-Id: I4ef3ba0626a24d344857870032340acc065c7f02
2022-10-21 07:25:18 +00:00
libraryupgrader a41cb839f8 build: Updating mediawiki/mediawiki-phan-config to 0.12.0
Change-Id: Ifdffe53d5b98a160dcd95ae21dd471d2423fca90
2022-10-09 06:29:02 +00:00
libraryupgrader 512dbf9fc0 build: Updating grunt-banana-checker to 0.10.0
Change-Id: I7680346eed5f173909a33ae09c8ba1eafdc4f525
2022-10-06 07:28:20 +00:00