Commit graph

432 commits

Author SHA1 Message Date
jenkins-bot 457c1568aa Merge "Add phpcs and make pass" 2017-06-02 21:28:32 +00:00
Umherirrender 88758f5884 Add phpcs and make pass
Change-Id: I129fd23a375b4f7de893d3b98f67fdd8de89b4bd
2017-05-30 21:49:44 +02:00
Brad Jorsch b7b6185dae Chunk page ids in internal API call to avoid too-many-pageids-for-query
One of many reasons that internal API calls are bad.

Bug: T41936
Change-Id: I338b444087c7570e455469e2c0fad8f5ca46644e
2017-05-26 17:24:39 -04:00
jenkins-bot 9b63fdc577 Merge "Make PageImages default API license parameter configurable" 2017-05-20 16:02:19 +00:00
aude 97572615e0 Make PageImages default API license parameter configurable
Bug: T156190
Change-Id: Id4b43f2597d5a063dca0d46f308b6283620e9974
2017-05-20 17:36:56 +02:00
Baha a7fc68ced6 Increase default API limit from 1 to 50
Bug: T153709
Change-Id: Ie7c48117ac94e4902948f7336b5e1da7229dbe2d
2017-05-19 09:06:04 -04:00
Umherirrender 88329411c7 Add php-parallel-lint
php-lint will test for valid php files

Change-Id: I2e59da55ff2d5dfcc668bcbd81df4708c8d5f4c6
2017-05-06 12:29:37 +02:00
Antoine Musso 68f89b28b5 build: add grunt-contrib-jshint
See T119973

Change-Id: I6103daa04d2e51de8e29135578be457252771c94
2017-04-21 18:24:03 +02:00
jenkins-bot c75e19ffd1 Merge "Switch TestingAccessWrapper to librarized version" 2017-04-20 19:36:58 +00:00
Gergő Tisza 928a8f6687 Switch TestingAccessWrapper to librarized version
Bug: T163434
Change-Id: Ie3d29b3522d5e176430708b15359803d76a39a2f
Depends-On: I52cc257e593da3d6c3b01a909e554a950225aec8
2017-04-20 11:35:03 +00:00
jenkins-bot cd95488965 Merge "Make PageImagesLeadSectionOnly default to true" 2017-04-18 16:54:46 +00:00
Zach 4c0e441833 Make PageImagesLeadSectionOnly default to true
Supporting changes:
* Update the LinksUpdateHookHandlerTest test case to set the config
  variable to its expected value of false.

Bug: T162203
Change-Id: Ic7b4d5ab42f71f6b4cf24cb5bbbbe808341a09e8
2017-04-18 10:16:22 +01:00
Translation updater bot 9175a42945 Localisation updates from https://translatewiki.net.
Change-Id: If798580c2dee0b159b1c6960cd9a4bb6547cf2b6
2017-04-17 22:39:12 +02:00
jenkins-bot 188f8d6020 Merge "UseGalleries is unused" 2017-04-10 21:43:02 +00:00
Translation updater bot b360c0305c Localisation updates from https://translatewiki.net.
Change-Id: If44887e4774d0d3db27fab120b64e0c18a110746
2017-04-06 23:52:05 +02:00
Translation updater bot 796c84ff7f Localisation updates from https://translatewiki.net.
Change-Id: I22a74b007cd0594020ca4acbf91ab3c6fb104558
2017-03-29 22:39:04 +02:00
Translation updater bot 4e145ec7d0 Localisation updates from https://translatewiki.net.
Change-Id: If34d63db85a970134272e6888b5cdb6308b3b956
2017-03-08 22:36:51 +01:00
Translation updater bot 98630d8f67 Localisation updates from https://translatewiki.net.
Change-Id: I8985991f7a39eb4035d6601730370d6301731cd9
2017-03-03 22:39:29 +01:00
Translation updater bot 8334aab55b Localisation updates from https://translatewiki.net.
Change-Id: Ib43b01cffd470c8af735e0b3b7d8ccea0a291c32
2017-02-15 22:35:48 +01:00
Translation updater bot 7ca697ddbe Localisation updates from https://translatewiki.net.
Change-Id: I24abd8978329315809c509872c211c0847ad6a6a
2017-02-14 22:44:03 +01:00
Thiemo Mättig (WMDE) 6deb3fc986 Revert "Add twitter meta tag for image"
This tag is useless and does nothing without og:title and
og:description also being present, which is not the case
right now. A more complete patch should re-introduce all
three tags in one go.

It is also questionable if this tag belongs to this
extension, because it is explicitly said that the image is
an optional element of a Twitter card. og:title and
og:description are not optional. og:description would
probably be set by the TextExtract extension. This means
this Twitter card tag belongs more to TextExtracts and not
to PageImages.

This reverts commit 2e83a2c1dc.

Bug: T157145
Change-Id: I17ffe8f83d91156a79facb4c35b4a15ecc49f108
2017-02-08 14:27:29 +00:00
Amir Sarabadani 2e83a2c1dc Add twitter meta tag for image
Bug: T157145
Change-Id: I8605b69b658b99941d63db3707ae6c2c0cf1b2ce
2017-02-04 04:14:16 +03:30
Amir Sarabadani b6296a4593 Reduce the thumbnail size to 1200px
Bug: T142048
Change-Id: I28f3c3274f77560ca856695e19e32fb1df3f8e66
2017-02-01 19:07:25 +03:30
jenkins-bot bee7615bb8 Merge "Add basic test for PageImages::onBeforePageDisplay" 2017-01-31 21:05:24 +00:00
Thiemo Mättig a7a74f51ce Add basic test for PageImages::onBeforePageDisplay
This is still only testing negative cases with no page image.

In addition this patch does sort all the hook handlers
alphabetically, and adds a missing PHPDoc block.

Bug: T51859
Change-Id: Iea65f2181dd3cac3ec2ceac191f002f74af3ec24
2017-01-31 19:43:12 +00:00
Amir Sarabadani 571e0d120e Reduce the thumbnail width to 1280px
See https://phabricator.wikimedia.org/T142048#2987319

Bug: T142048
Change-Id: I2b7d3dc1eaac74c2e48d327b8bb9956e1648edbe
2017-01-31 22:45:06 +03:30
Amir Sarabadani e5cbfdb221 Add PageImage OpenGraph tag
Bug: T101711
Bug: T142048
Bug: T51859
Change-Id: Idd9125ad06964f50cbad70283819107611cfec44
2017-01-30 22:24:02 +03:30
jenkins-bot ee36518329 Merge "Document page property names" 2017-01-24 21:53:50 +00:00
jenkins-bot d07a770a54 Merge "API: return free images by default" 2017-01-24 20:11:53 +00:00
jdlrobson 21963c89ea Document page property names
This should protect us when we consider renaming these variables
in future.

Bug: T152239
Change-Id: I227ffd0867f797d6a450b8b51759338cff7ee3a8
2017-01-23 23:12:11 +00:00
jdlrobson e44969eca0 UseGalleries is unused
Unless I'm mistaken this config variable has never been used
in this codebase since introduction in
I64e997d58e4a1b66a8a351d85a3e7df1a77354e9

It's not documented so not clear why it is needed
and not referenced in this codebase.

Change-Id: Ib227eefb77ba2719db277fa80a8bfb958ea6a778
2017-01-23 12:20:58 -08:00
Translation updater bot 1a5bd00330 Localisation updates from https://translatewiki.net.
Change-Id: I4022e79402392aa06593a05092e26f8b599414a5
2017-01-20 09:35:27 +01:00
Baha 83e712791f API: return free images by default
The maintenance script to populate free images has finished executing.

Follow-up on I1d35e965dc37c8c4ecdcc43313b3198e951e1978.

Bug: T152216
Change-Id: I32669e937efa6f5566eee582b911d170a32762e3
2017-01-19 15:20:00 -05:00
Translation updater bot e53154dae0 Localisation updates from https://translatewiki.net.
Change-Id: I59d71e7df7ff4a37219a53b66fab3b4661b36a6f
2017-01-18 22:18:56 +01:00
Michael Holloway a8c7cbc870 API: Surface dimensions when requesting original image info
It's useful for API consumers to have the dimensions of the original
image so that they know the bounds within which they can safely rewrite
the thumb URL (bearing in mind the prerendered widths[1], in the case of
WMF wiki consumers).

This change adds an 'original' property to the page object, containing
the original image source URL along with its width and height, when
original image info is requested.

A warning is added when original image info is requested, noting the
format change and warning the consumer that the original image URL will
no longer be provided within the 'thumbnail' property in a future release.

[1] https://github.com/wikimedia/operations-mediawiki-config/blob/master/wmf-config/InitialiseSettings.php#L17535

Bug: T152163
Change-Id: I9d937f73a974dfb099b93552405531464b8ad3ae
2017-01-17 15:07:28 -05:00
Translation updater bot 25567fa7df Localisation updates from https://translatewiki.net.
Change-Id: I2847b1b4b66e9a97356d2e84df3a62c7d90ac59d
2016-12-22 22:56:36 +01:00
jenkins-bot ee9a09ca27 Merge "Provide test case for getPageImageCandidates" 2016-12-21 16:41:02 +00:00
Translation updater bot 208e36a11f Localisation updates from https://translatewiki.net.
Change-Id: Ia8243102d57f23b6d7105e464410c36afe7f589c
2016-12-14 22:25:46 +01:00
jenkins-bot 658d7feb66 Merge "Fix typo: page_ids -> pageIds" 2016-12-12 21:31:29 +00:00
Erik Bernhardson 8d040dfb1f Fix typo: page_ids -> pageIds
Change-Id: I7054d36bea58c06cd97c704f44c1fec8a23245bc
2016-12-09 17:08:33 -08:00
jenkins-bot aea9c2fab7 Merge "Don't count abandoned jobs as job queue pressure" 2016-12-09 18:17:36 +00:00
jdlrobson 5e1d488d65 Provide test case for getPageImageCandidates
Additional changes:
* Add test @covers statements for existing tests for code
coverage purposes

Change-Id: I1a0d2d331c79df3e5505ae54d27f23e1cb5b910c
2016-12-08 20:12:03 +00:00
Erik Bernhardson 6f0f3e7dc6 Don't count abandoned jobs as job queue pressure
It looks like the reason these jobs arn't processing is because
abandoned jobs are being considered as part of the acquired jobs
count, so if a job gets abandoned it keeps taking up a slot in
our job pressure calculation. These shouldn't count as pressure
because they are not running anymore.

Change-Id: I44fbce2b7dc47345ab0e3745d1653f418d75943d
2016-12-08 11:46:46 -08:00
jenkins-bot 4e9444f3f3 Merge "Restrict page images to lead section" 2016-12-08 19:26:39 +00:00
jdlrobson 00b9f9fdc4 Restrict page images to lead section
When $wgPageImagesLeadSectionOnly is true restrict
the scoring of page images to images in the lead section.
This results in an additional parse of the lead section of the
content, but this should only happen once after an edit
has occurred and is deferred.

If false all images will be considered as candidates for
the page image choice.

Note that the choice between modes is per site not by
request. This is intentional to avoid having to store 4
different properties respecting license and
article position. As a result when enabling or disabling
this switch on existing setups, there will be a transitional
period where pages previously parsed will show pageimages
as calculated by the previous value of this config variable.

Bug: T87336
Change-Id: I09bdae82515f6e93f5606553259f10b3a10e9eaa
2016-12-08 10:41:21 -08:00
Erik Bernhardson 9b20854a59 Wrap waitForReplication in try/catch
Very few of these jobs seem to be finishing, due to some
replicas being so far behind we get DBReplicationWaitError
thrown, which causes the job to be restarted. Catch and log,
but don't stop processing because of it.

There is also a problem with jobs that blow out the memory limits,
but not sure what to do with that.

Change-Id: Idffcfad76936f5e62e9018c58f2cb57db35af4b8
2016-12-07 10:18:53 -08:00
Erik Bernhardson 03e14d0c86 Add job queue option for initImageData maintenance script
Trying to run this script in the cluster fatals out due to memory
problems somewhat regularly. The --start option helps to restart
it where it fell down, but when trying to run against hundreds of
wiki's that is a one-off solution that makes ensuring everything is
actually visited a pain.

To try and isolate errors add an option to push the parsing into the
job queue. There is still the possibility to miss pages, but job queue
retries should take care of us for the most part. Attempts to keep
load down on the databases by making sure no more than a specified
number of jobs are queued/processing at a given time.

Bug: T152155
Change-Id: I3a4e3a415b2f03de0bb36ac0515241e950130fde
2016-12-06 10:56:52 -08:00
Baha 9215a7f9d9 Choose the best image
Follow up to If6cbb82f01fa298945c615a2f25e972a9d767d58
Change-Id: I5e46985bfd22b2f96eb659a3d14137bdadbc4b99
2016-12-03 02:44:11 +00:00
jenkins-bot 7fa933cf00 Merge "Return any image, not just the non-free image" 2016-12-03 01:32:39 +00:00
Baha 250103022d Return any image, not just the non-free image
The mobileview API directly accesses the page image,
bypassing the PageImages API.

I1d35e965dc37c8c4ecdcc43313b3198e951e1978 fixes the issue for
the PageImages API.

This patch fixes the issue for the mobileview API.

Change-Id: If6cbb82f01fa298945c615a2f25e972a9d767d58
2016-12-02 20:29:35 -05:00