Go to file
Hamish 61a6d3123d
Fix minoredits=exclude (#234)
fixes issue #226

Previously, the query selected the latest revision for each page based on the rev_timestamp, but did not consider the rev_minor_edit value until afterwards.
Now it will retrieve the latest revision that satisfies the condition rev.rev_minor_edit = 0.
2023-11-06 12:31:11 -07:00
.github Bump sqren/backport-github-action from 8.9.7 to 9.3.0 (#242) 2023-11-06 12:30:25 -07:00
.phan phan: enable SecurityCheck-ReDoS (#217) 2023-01-14 11:13:06 -07:00
i18n Cleanup in en.json (#237) 2023-11-06 12:30:37 -07:00
includes Fix minoredits=exclude (#234) 2023-11-06 12:31:11 -07:00
maintenance Support MediaWiki 1.39 for actor and templatelinks migration (#188) 2022-12-06 17:10:46 -07:00
tests Fix usedby query returning all templates (#224) 2023-03-16 14:49:35 -06:00
.gitattributes Major cleanup (#57) 2021-10-01 16:52:30 -06:00
.gitignore Major cleanup (#57) 2021-10-01 16:52:30 -06:00
.phpcs.xml phpcs: enable MediaWiki.Commenting.FunctionComment (#149) 2022-03-22 13:59:52 -06:00
CHANGELOG.md Add CHANGELOG entry 2023-03-16 14:51:12 -06:00
composer.json Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 (#245) 2023-11-06 12:29:29 -07:00
COPYING Major cleanup (#57) 2021-10-01 16:52:30 -06:00
DynamicPageList3Magic.php Re-namespace and use AutoloadNamespaces (#113) 2022-03-13 13:57:34 -06:00
extension.json Add support for PHP 8.0 and PHP 8.1 (#216) 2023-01-13 14:12:14 -07:00
README.md Add alwaysCacheResults to README (#126) 2022-03-16 17:05:35 -06:00

DynamicPageList3

The DynamicPageList3 extension is a reporting tool for MediaWiki, listing category members and intersections with various formats and details. For full documentation, see the manual.

When invoked with a basic set of selection parameters DPL3 displays a list of pages in one or more categories. Selections may also be based on factors such as author, namespace, date, name pattern, usage of templates, or references to other articles. Output takes a variety of forms, some of which incorporate elements of selected articles.

This extension is invoked with the parser function {{#dpl: .... }} or parser tag <DPL>. A Wikimedia-compatible implementation of certain features can be invoked with <DynamicPageList>.

Complex look ups can result in computationally expensive database queries. However, by default all output is cached for a period of one hour to reduce the need to rerun the query every page load. The DPL:Parameters: Other Parameters manual page contains information on parameters that can be used to disable the cache and allow instant updates.

Installation

Please see the releases page for the latest releases.

Configuration

These are DPL3's configuration settings and along with their default values. To change them make sure they are defined before including the extension on the wiki. More configuration information is available on the MediaWiki extension page.

Note: In release 3.0.4 the configuration variable name was changed from $dplSettings to $wgDplSettings. This was to faciliate compatibility with Mediawiki 1.25's extension registration change.

Setting Default Description
$wgDplSettings['allowedNamespaces'] null By default all existing namespaces are used when DPL3 initializes. Customize this setting with an array of namespace constants to restrict DPL3 to work only in those namespaces.
$wgDplSettings['allowUnlimitedCategories'] false Set this to true to ignore 'maxCategoryCount' and allow unlimited categories. Please note that large amounts of categories in a query can slow down or crash servers.
$wgDplSettings['allowUnlimitedResults'] false Set this to true to ignore 'maxResultCount' and allow unlimited results. Please note that large result sets may result in slow or failed page loads.
$wgDplSettings['alwaysCacheResults'] false Set this to true to ignore 'allowcachedresults' and always enable the parser cache.
$wgDplSettings['categoryStyleListCutoff'] 6 Maximum number of items in a category list before being cut off.
$wgDplSettings['functionalRichness'] 3 Set the level of parameters available to end users.
$wgDplSettings['maxCategoryCount'] 4 Maximum number of categories to allow in queries.
$wgDplSettings['minCategoryCount'] 0 Minimum number of categories to allow in queries.
$wgDplSettings['maxResultCount'] 500 Maximum number of results to return from a query.
$wgDplSettings['recursiveTagParse'] false Do recursive tag parsing on parser tags converting tags and functions such as magic words like {{PAGENAME}}. This is similar to the {{#dpl}} parser function call, but may not work exactly the same in all cases.
$wgDplSettings['runFromProtectedPagesOnly'] false Set this to true to allow DPL3 to run from protected pages only. This is recommend if wiki administrators are having issues with malicious users creating computationally intensive queries.
$wgDplSettings['handleSectionTag'] false Set this to true to have DPL3 handle
tags outside of the parser tags provided by DPL3.
$wgDplSettings['maxQueryTime'] 10000 Maximum allowed time for database queries in milliseconds.
$wgDplSettings['queryCacheTime'] 0 Can help with situations where you have a template with the same query used on a large number of pages all being refreshed at once. The query cache cannot be purged. Suggested value between 30 to 600.

The global variable $wgNonincludableNamespaces is automatically respected by DPL3. It will prevent the contents of the listed namespaces from appearing in DPL3's output.

Note: $wgDplSettings['maxResultCount'] is a LIMIT on the SQL query itself. Some DPL3 query parameters like includematch are applied after the SQL query, however, so results here may easily be misleading.

Functional Richness

DynamicPageList3 has many features which are unlocked based on the maximum functional richness level. There are some that can cause high CPU or database load and should be used sparingly.

  • $wgDplSettings['functionalRichness'] = 0 is equivalent to Wikimedia's DynamicPageList
  • $wgDplSettings['functionalRichness'] = 1 adds additional formatting parameters
  • $wgDplSettings['functionalRichness'] = 2 adds performance equivalent features for templates and pagelinks
  • $wgDplSettings['functionalRichness'] = 3 allows more-expensive page inclusion features and regular expression queries.
  • $wgDplSettings['functionalRichness'] = 4 permits exotic and potentially dangerous batch update and delete operations; not recommended for public websites. Includes debugging parameters for testing and development.

Usage

Extended DPL3 Functionality

Extended DPL3 is invoked by using the parser function {{#dpl: .... }}, or the parser extension tag <DPL> .... </DPL>.

See Manual - General Usage and Invocation Syntax and DPL:Parameters: Criteria for Page Selection

Backwards Compatibility

Functionality compatible with Wikimedia's DPL extension (Intersection) can be invoked with <DynamicPageList> .... </DynamicPageList>. Further information can be found on the Compatibility manual page.

Usage Philosophy and Overview

With the assumption there are some articles writtne about countries those articles will typically have three things in common:

  • They will belong to a common category
  • They will have a similar chapter structure, i.e. they will contain paragraphs named 'Religion' or 'History'
  • They will use a template which is used to present highly structured short data items ('Capital', 'Inhabitants', ..) in a nice way (e.g. as a wikitable)

Generate a Report Based on countries

If there was a need to assemble a report of what countries practice a certain religion this could be easily done with the category and linksto parameters.

{{#dpl:
category=countries
|linksto=Pastafarianism
}}

With DPL3 one could:

  • Generate a list of all those articles (or a random sample)
  • Show metadata of the articles (popularity, date of last update, ..)
  • Show one or more chapters of the articles ('transclude' content)
  • Show parameter values which are passed to the common template
  • Order articles appropriately
  • Present the result in a sortable table (e.g.)
  • Generate multiple column output

Which steps are necessary?

Find the articles you want to list:

  • Select by a logical combination (AND,OR,NOT) of categories
  • Specify a range for the number of categories the article must be assigned to
  • Select by a logical combination (AND,OR,NOT) of namespaces
  • Define a pattern which must match the article's name
  • Name a page to which the article must or must not link
  • Name a template which the article must or must not use
  • Name a text pattern which must occur within external links from a page
  • Exclude or include redirections
  • Restrict your search to stable pages or quality pages ("flagged revisions")
  • Use other criteria for selection like author, date of last change etc.
  • Define regular expressions to match the contents of pages you want to include

Order the result list of articles according to

  • Article Name
  • Article Size
  • Date of last change
  • Last User to Make an Edit

Define attributes you want to see

  • Article Name
  • Article Namespace
  • Article Size
  • Date of Last Change
  • Date of Last Access
  • Last User to Make an Edit

Define contents you want to show

  • Whole Article
  • Contents of Certain Sections (Identified by headings)
  • Text Portions (Defined by special marker tags in the article)
  • Values of template calls
  • Use a custom template to show output

Define the output format

  • Specify header and footer for the default output
  • Use ordered list, unordered list
  • Use tables
  • Format table fields individually by applying templates to their content
  • Use category style listing
  • Truncate title or contents to a certain maximum length
  • Add a link to the article or to one or more of its sections

Considerations

Performance

DPL3's code execution and database access is typically fast for typical category and article look ups. However, using loose LIKE and REGEXP match parameters and/or requesting large data sets can result in long database access times. Parser time should also be kept in consideration. For example, having the query of image results go into a template that displays them will result in a parser media transform for each one. This can quickly eat up 2MBs of RAM per media transform.

See Also

Further Reading

DPL3 can do much more than we can explain here. A complete manual is available with full parameter documentation.