မေႃႇၵျူး:category tree/poscatboiler/data
Introduction
[မႄးထတ်း]This is the documentation page for the main data module for Module:category tree/poscatboiler, as well as for its submodules. Collectively, these modules handle generating the descriptions and categorization for almost all category pages. The only current exception is topic pages such as Category:en:Birds and Category:zh:State capitals of Germany, and the corresponding non-language-specific pages such as Category:Birds and Category:State capitals of Germany; these are handled by Module:category tree/topic cat.
Originally, there were a large number of Module:category tree implementations, of which Module:category tree/poscatboiler was only one. It originally handled part-of-speech categories like Category:French nouns and Category:German lemmas (and corresponding "umbrella" categories such as Category:Nouns by language and Category:Lemmas by language); hence the name. However, it has long since been generalized, and the name no longer describes its current use.
The main data module at Module:category tree/poscatboiler/data does not contain data itself, but rather imports the data from its submodules, and applies some post-processing.
- To find which submodule implements a specific category, use the search box on the right.
- To add a new data submodule, copy an existing submodule and modify its contents. Then, add its name to the
subpages
list at the top of Module:category tree/poscatboiler/data.
Concepts
[မႄးထတ်း]The poscatboiler system internally distinguishes the following types of categories:
- Language categories. These are of the form
LANG LABEL
(e.g. Category:French lemmas and Category:English learned borrowings from Late Latin). Here,LANG
is the name of a language, andLABEL
can be anything, but should generally describe a topic that can apply to multiple languages. Note that the language mentioned byLANG
must currently be a regular language, not an etymology-only language. (Etymology-only languages include lects such as Provençal, considered a variety of Occitan, and Biblical Hebrew, considered a variety of Hebrew. See here for the list of such lects.) Most language categories have an associated umbrella category; see below. - Umbrella categories. These are normally of the form
LABEL by language
, and group all categories with the same label. Examples are Category:Lemmas by language and Category:Learned borrowings from Late Latin by language. Note that the label appears with an initial lowercase letter in a language category, but with an initial uppercase letter in an umbrella category, consistent with the general principle that category names are capitalized. Umbrella categories themselves are grouped into umbrella metacategories, which group related umbrella categories under a given high-level topic. Examples are Category:Lemmas subcategories by language (which groups umbrella categories describing different types of lemmas, such as Category:Nouns by language and Category:Interrogative adverbs by language) and Category:Terms derived from Proto-Indo-European roots (which groups umbrella categories describing terms derived from particular Proto-Indo-European roots, such as Category:Terms derived from the Proto-Indo-European root *preḱ- and Category:Terms derived from the Proto-Indo-European root *bʰeh₂- (speak)). The names of umbrella metacategories are not standardized (although many end insubcategories by language
), and internally they are handled as raw categories; see below.- Note that umbrella categories are just a special type of parent category with built-in support in the category-handling system. In particular, some types of categories have what is logically an umbrella category but which has a nonstandard name. These are handled as just another parent category, with a separate raw-category entry for the parent itself. An example is categories of the form
LANG phrasebook/AREA
(e.g. Category:English phrasebook/Health), whose umbrella category has the nonstandard namePhrasebooks by language/AREA
(e.g. Category:Phrasebooks by language/Health). Another example is categories of the formLANG terms borrowed back into LANG
, with a nonstandard umbrella category Category:Terms borrowed back into the same language. Both of these examples are handled by disabling the standard umbrella category support and listing the nonstandard umbrella category as an additional parent. - Some umbrella categories are missing the
by language
suffix; an example is Category:Terms borrowed from Latin, which groups categories of the formLANG terms borrowed from Latin
. There is special support for umbrella categories of this nature, so they do not need to be handled as described above for umbrella categories with nonstandard names.
- Note that umbrella categories are just a special type of parent category with built-in support in the category-handling system. In particular, some types of categories have what is logically an umbrella category but which has a nonstandard name. These are handled as just another parent category, with a separate raw-category entry for the parent itself. An example is categories of the form
- Language-specific categories. These are of the same form
LANG LABEL
as regular language categories, but with the difference that the label in question applies only to a single language, rather than to all or a large group of languages. Examples are Category:Belarusian class 4c verbs, Category:Dutch separable verbs with bloot, and Category:Japanese kanji by kan'yōon reading. For these categories, it does not make sense to have a corresponding umbrella category. - Raw categories. These can have any form whatsoever, and may or may not have a language name in them. Examples are Category:Requests for images in Korean entries and Category:Terms with redundant transliterations/ru (which logically are language categories but do not follow the standard format of a language category); Category:Phrasebooks by language/Health (which is logically an umbrella category, but again with a nonstandard name); Category:Terms by etymology subcategories by language (an umbrella metacategory); and Category:Templates (a miscellaneous high-level category).
Under the hood, the poscatboiler system distinguishes two types of implementations for categories: individual labels (or individual raw categories), and handlers. Individual labels describe a single label, such as nouns
or refractory rhymes
. Similarly, an individual raw category describes a single raw category. Handlers, on the other hand, describe a whole class of similar labels or raw categories, e.g. labels of the form learned borrowings from SOURCE
where SOURCE
is any language or etymology language. Handlers are more powerful than individual labels, but require knowledge of Lua to implement.
Adding, removing or modifying categories
[မႄးထတ်း]A sample entry is as follows (in this case, found in Module:category tree/poscatboiler/data/lemmas):
labels["adjectives"] = { description = "{{{langname}}} terms that give attributes to nouns, extending their definitions.", parents = {"lemmas"}, umbrella_parents = "Lemmas subcategories by language", }
This generates the description and categorization for all categories of the form "LANG adjectives" (e.g. Category:English adjectives or Category:Norwegian Bokmål adjectives), as well as for the umbrella category Category:Adjectives by language.
The meanings of these fields are as follows:
- The
description
field gives the description text that will appear when a user visits the category page. Here,{{{langname}}}
is automatically replaced with the name of the language in question. The text in this field is also used to generate the description of the umbrella category Category:Adjectives by language, by chopping off the{{{langname}}}
and capitalizing the next letter. - The
parents
field gives the labels of the parent categories. For example, Category:English adjectives will have Category:English lemmas as its parent category, and Category:Norwegian Bokmål adjectives will have Category:Norwegian Bokmål lemmas as its parent category. The umbrella category Category:Adjectives by language will automatically be added as an additional parent. - The
umbrella_parents
field specifies the parent category of the umbrella category Category:Adjectives by language (i.e. the umbrella metacategory which this page belongs to; see #Concepts above).
Category label fields
[မႄးထတ်း]The following fields are recognized for the object describing a label:
parents
- A table listing one or more parent labels of this label. This controls the parent categories that the category is contained within, as well as the chain of breadcrumbs appearing across the top of the page (see below).
- An item in the table can be either a single string (the parent label), or a table containing (at least) the two elements
name
andsort
. In the latter case,name
specifies the parent label name, while thesort
value specifies the sort key to use to sort it in that category. The default sort key is the category's label. - If a parent label begins with
Category:
it is interpreted as a raw category name, rather than as a label name. It can still have its own sort key as usual. - The first listed parent controls the category's parent breadcrumb in the chain of breadcrumbs at the top of the page. (The breadcrumb of the category itself is determined by the
breadcrumb
setting, as described below.)
- An item in the table can be either a single string (the parent label), or a table containing (at least) the two elements
description
- A plain English description for the label. This should generally be no longer than one sentence. Place additional, longer explanatory text in the
additional=
field described below, and put{{wikipedia}}
boxes in thetopright=
field described below so that they are correctly right-aligned with the description. Template invocations and special template-like references such as{{{langname}}}
and{{{langcode}}}
will be expanded appropriately; see #Template substitutions in field values below. breadcrumb
- The text of the last breadcrumb that appears at the top of the category page.
- By default, it is the same as the category label, with the first letter capitalized.
- The value can be either a string, or a table containing two elements called
name
andnocap
. In the latter case,name
specifies the breadcrumb text, whilenocap
can be used to disable the automatic capitalization of the breadcrumb text that normally happens. - Note that the breadcrumbs collectively are the chain of links that serve as a navigation aid for the hierarchical organization of categories. For example, a category like Category:French adjectives will have a breadcrumb chain similar to "Fundamental » All languages » French » Lemmas » Adjectives", where each breadcrumb is a link to a category at the appropriate level. The last breadcrumb here is "Adjectives", and its text is controlled by this field.
displaytitle
-
- Apply special formatting such as italics to the category page title, as with the
{{DISPLAYTITLE:...}}
magic word (see mw:Help:Magic words). The value of this is either a string (which should be the formatted category title, without the precedingCategory:
) or a Lua function to generate the formatted category title. A Lua function is most useful inside of a handler (see #Handlers below). The Lua function is passed two parameters, the raw category title (without the precedingCategory:
) and the language object of the category's language (ornil
for umbrella categories), and should return the formatted category title (again without the precedingCategory:
). If the value of this field is a string, template invocations and special template-like references such as{{{langname}}}
and{{{langcode}}}
will be expanded appropriately; see below. See Module:category tree/poscatboiler/data/terms by etymology and Module:category tree/poscatboiler/data/lang-specific/nl for examples of usingdisplaytitle=
.
- Apply special formatting such as italics to the category page title, as with the
topright
- Introductory text to display right-aligned, before the edit and recent-entries boxes on the right side. This field should be used for {{wikipedia}} and other similar boxes. Template invocations and special template-like references such as
{{{langname}}}
and{{{langcode}}}
are expanded appropriately, just as withdescription=
; see #Template substitutions in field values below. Compare thepreceding=
field, which is similar totopright=
but used for left-aligned text placed above the description. preceding
- Introductory text to display directly before the text in the
description=
field. The difference between the two is thatdescription=
text will also be shown in the list of children categories shown on the parent category's page, while thepreceding=
text will not. For this reason, usepreceding=
instead ofdescription=
for {{also}} hatnotes and similar text, and keepdescription=
relatively short. Template invocations and special template-like references such as{{{langname}}}
and{{{langcode}}}
are expanded appropriately, just as withdescription=
; see #Template substitutions in field values below. Compare thetopright=
field, which is similar topreceding=
but is right-aligned, placed above the edit and recent-entries boxes. additional
- Additional text to display directly after the text in the the
description=
field. The difference between the two is thatdescription=
text will also be shown in the list of children categories shown on the parent category's page, while theadditional=
text will not. For this reason, useadditional=
instead ofdescription=
for long explanatory notes, See also references and the like, and keepdescription=
relatively short. Template invocations and special template-like references such as{{{langname}}}
and{{{langcode}}}
are expanded appropriately, just as withdescription=
; see #Template substitutions in field values below. umbrella
- A table describing the umbrella category that collects all language-specific categories associated with this label, or the special value
false
to indicate that there is no umbrella category. The umbrella category is normally called "LABEL by language". For example, for adjectives, the umbrella category is named Category:Adjectives by language, and is a parent category (in addition to any categories specified usingparents
) of Category:English adjectives, Category:French adjectives, Category:Norwegian Bokmål adjectives, and all other language-specific categories holding adjectives. This table contains the following fields:name
- The name of the umbrella category. It defaults to "LABEL by language". You should not use this, even if the umbrella category has a nonstandard name, because if you set it, you will have to modify Module:auto cat to recognize the new name of the umbrella category. Instead, set
umbrella = false
and list the nonstandard umbrella category as an additional parent (and add a raw-category entry for the umbrella category itself; see the implementation of categories like Category:English terms borrowed back into English for an example). description
- A plain English description for the umbrella category. By default, it is derived from the
description
field of the category itself by removing any{{{langname}}}
,{{{langcode}}}
or{{{langcat}}}
template parameter reference and capitalizing the remainder. Text is automatically added to the end indicating that this category is an umbrella category that only contains other categories, and does not contain pages describing terms. parents
- The parent category or categories of the umbrella category. This can either be a single string specifying a category (with or without the
Category:
prefix), a table with fieldsname
(the category name) andsort
(the sort key, as in the outerparents
field described above), or a list of either type of entity. breadcrumb
- The last breadcrumb in the chain of breadcrumbs at the top of the category page; see above. By default, this is the category label (i.e. the same as the umbrella category name, minus the final "by language" text).
displaytitle
- Apply special formatting such as italics to the umbrella category page title; see above.
topright
- Like the
topright=
field on regular category pages; see above. preceding
- Like the
preceding=
field on regular category pages; see above. additional
- Like the
additional=
field on regular category pages; see above. toc_template
,toc_template_full
- Override the table of contents bar used on umbrella pages. See below. It's unlikely you will ever need to set this.
umbrella_parents
- The same as the
parents
subfield of theumbrella
field. This typically specifies a single umbrella metacategory to which the page's corresponding umbrella page belongs; see #Concepts above). A separate field is provided for this because the umbrella's parent or parents always need to be given, whereas other umbrella properties can usually be defaulted. (In practice, you will find that most entries in a subpage of Module:category tree/poscatboiler/data do not explicitly specify the umbrella's parent. This is because a default value is supplied near the end of the "LABELS" section in which the entry is found.) toc_template
- The template or templates to use to display the "table of contents" bar for easier navigation on categories with multiple pages of entries. By default, categories with more than 200 entries or 200 subcategories display a language-appropriate table of contents bar whose contents are held in a template named
CODE-categoryTOC
, whereCODE
is the language code of the category's language. (If no such template exists, no table of contents bar is displayed. If the category has no associated language, as with umbrella pages, the English-language table of contents bar is used.) For example, the category Category:Spanish interjections (and other Spanish-language categories) use Template:es-categoryTOC to display a Spanish-appropriate table of contents bar. (In the case of Spanish, this includes entries for Ñ and for acute-accented vowels such as Á and Ó.) To override this behavior, specify a template or a list of templates intoc_template
. The first template that exists will be used; if none of the specified templates exist, the regular behavior applies, i.e. the language-appropriate table of contents bar is selected.- Special strings such as
{{{langcode}}}
(to specify the language code of the category's language) can be used in the template names; see below. - Use the special value
false
to disable the table of contents bar. - An example of a category that uses this property is "LANG romanizations". For example, the category Category:Gothic romanizations would by default use the Gothic-specific template Template:got-categoryTOC to display a Gothic-script table of contents bar. This is inappropriate for this particular category, which contains Latin-script romanizations of Gothic terms rather than terms written in the Gothic script. To fix this, the "romanizations" label specifies a
toc_template
value of{"{{{langcode}}}-rom-categoryTOC", "en-categoryTOC"
}, which first checks for a special Gothic-romanization-specific template Template:got-rom-categoryTOC (which in this case does exist), and falls back to the English-language table of contents template.
- Special strings such as
toc_template_full
- Similar to
toc_template
but used for categories with large numbers of entries (specifically, more than 2,500 entries or 2,500 subcategories). If none of the specified templates exist, the templates listed intoc_template
are tried, and if none of them exist either, the default behavior applies. In this case, the default behavior is to use a language-appropriate "full" table of contents template namedCODE-categoryTOC/full
, and if that doesn't exist, fall back to the regular table of contents template namedCODE-categoryTOC
. An example of a "full" table of contents template is Template:es-categoryTOC/full, which shows links for all two-letter combinations and appears on pages such as Category:Spanish nouns, with over 50,000 entries. catfix
- Specifies the language code of the language to use when calling the
catfix()
function in Module:utilities on this page. Thecatfix()
function is used to ensure that page names in foreign scripts show up in the correct fonts and are linked to the correct language.- The default value is the category's language, if any (for example, the language
LANG
in pages of the formLANG LABEL
). If the category has no associated language, or if the settingcatfix = false
is used, the catfix mechanism is not applied. - The setting
catfix = false
is used, for example, on theromanizations
label (which holds Latin-script romanizations of foreign-script terms, rather than terms in the language's native script) and theredlinks
labels (which holds pages linking to nonexistent terms in the language in question). If this is omitted, for example, then pages in Category:Manchu romanizations will show up oriented vertically despite being in Latin script, and pages in Category:Cantonese redlinks will show up using a double-width font despite mostly not being Cantonese-language pages. - The setting
catfix = "en"
is used for example on categories of the formRequests for translations into LANG
(see Module:category tree/poscatboiler/data/entry maintenance) because these categories contain English pages need translations into a given language, rather than containing pages of that language. - Note that setting a particular language for
catfix=
will normally cause that language's table of contents page to display in place of the category's normal language, and setting a value offalse
will normally cause the English table of contents page to display. In both cases, this behavior can be overridden by specifying thetoc_template=
ortoc_template_full=
fields.
- The default value is the category's language, if any (for example, the language
|hidden = true
- Specifies that the category is hidden. This should be used for maintenance categories. (Hidden categories do not show up in the list of categories at the bottom of a page, but do show up when searched for in the search box.)
|can_be_empty = true
- Specifies that the category should not be deleted when empty. This should be used for maintenance categories.
Template substitutions in field values
[မႄးထတ်း]Template invocations can be inserted in the text of description
, parents
(both name and sort key), breadcrumb
, toc_template
and toc_template_full
values, and will be expanded appropriately. In addition, the following special template-like invocations are recognized and replaced by the equivalent text:
{{PAGENAME}}
- The name of the current page. (Note that two braces are used here instead of three, as with the other parameters described below.)
{{{langname}}}
- The name of the language that the category belongs to. Not recognized in umbrella fields.
{{{langcode}}}
- The code of the language that the category belongs to (e.g.
en
for English,de
for German). Not recognized in umbrella fields. {{{langcat}}}
- The name of the language's main category, which adds "language" to the regular name. Not recognized in umbrella fields.
Raw categories
[မႄးထတ်း]Raw categories are treated similarly to regular labels. The main differences are:
Handlers
[မႄးထတ်း]It is also possible to have handlers that can handle arbitrarily-formed labels, e.g. "###-syllable words" for any ###; "terms in XXX script" for any XXX; or "learned borrowings from LANG" for any LANG. As an example, the following is the handler for "terms coined by COINER" (such as Category:English terms coined by Lewis Carroll):
table.insert(handlers, function(data) local coiner = data.label:match("^terms coined by (.+)$") if coiner then return { description = "{{{langname}}} terms coined by " .. coiner .. ".", breadcrumb = coiner, umbrella = false, parents = {{ name = "coinages", sort = coiner, }}, } end end)
The handler checks if the passed-in label has a recognized form, and if so, returns an object that follows the same format as described above for directly-specified labels. In this case, the handler disables the umbrella category "Terms coined by COINER by language" because most people coin words in only one language.
The handler is passed a single argument data
, which is an object containing the following fields:
label
: the label;lang
: the language object of the language at the beginning of the category, ornil
for no language (this happens with umbrella categories);sc
: the script code of the script mentioned in the category, if the category is of the form "LANG LABEL in SCRIPT", ornil
otherwise;args
: a table of extra parameters passed to{{auto cat}}
.
If the handler interprets the extra parameters passed as data.args
, it should return two values: a label object (as described above), and the value true
. Otherwise, an error will be thrown if any extra parameters are passed to {{auto cat}}
. An example of a handler that interprets the extra parameters is the affix-cat handler in Module:category tree/poscatboiler/data/terms by etymology, which supports {{auto cat}}
parameters |alt=
, |sort=
, |tr=
and |sc=
. The |alt=
parameter in particular is used to specify extra diacritics to display on the affix that forms part of the category name, as in categories such as Category:Latin terms suffixed with -inus (properly -īnus).
For further examples, see Module:category tree/poscatboiler/data/words by number of syllables, Module:category tree/poscatboiler/data/terms by script or Module:category tree/poscatboiler/data/terms by etymology.
Note that if a handler is specified, the module should return a table holding both the label and handler data; see the above modules.
Language-specific labels
[မႄးထတ်း]Support exists for labels that are specialized to particular languages. A typical label such as "verbs" applies to many languages, but some categories have labels that are specialized to a particular language, e.g. Category:Belarusian class 4c verbs or Category:Dutch prefixed verbs with ver-. Here, the label "class 4c verbs" is specific to Belarusian with a description and other properties only for this particular language, and similarly for the Dutch-specific label "prefixed verbs with ver-". Yet, it is desirable to integrate these categories into the poscatboiler hierarchy, so that e.g. breadcrumbs and other features are available. This can be done by creating a module such as Module:category tree/poscatboiler/data/lang-specific/be (for Belarusian) or Module:category tree/poscatboiler/data/lang-specific/nl (for Dutch), and specifying labels and/or handlers in the same fashion as is done for language-agnostic categories. See Module:category tree/poscatboiler/data/lang-specific/documentation for more information.
Subpages
[မႄးထတ်း]local labels = {}
local raw_categories = {}
local handlers = {}
local raw_handlers = {}
local subpages = {
"affixes and compounds",
"characters",
"entry maintenance",
"families",
"figures of speech",
"language varieties",
"languages",
"ၶေႃႈတင်ႈ",
"miscellaneous",
"modules",
"names",
"non-lemma forms",
"phrases",
"rhymes",
"scripts",
"shortenings",
"symbols",
"templates",
"terms by etymology",
"terms by grammatical category",
"terms by lexical property",
"terms by semantic function",
"terms by script",
"terms by usage",
"transliterations",
"unicode",
"wiktionary",
"wiktionary maintenance",
"word of the day",
}
-- Import subpages
for _, subpage in ipairs(subpages) do
local datamodule = "Module:category tree/poscatboiler/data/" .. subpage
local retval = require(datamodule)
if retval["LABELS"] then
for label, data in pairs(retval["LABELS"]) do
if labels[label] and not retval["IGNOREDUP"] then
error("Label " .. label .. " defined in both [["
.. datamodule .. "]] and [[" .. labels[label].module .. "]].")
end
data.module = datamodule
labels[label] = data
end
end
if retval["RAW_CATEGORIES"] then
for category, data in pairs(retval["RAW_CATEGORIES"]) do
if raw_categories[category] and not retval["IGNOREDUP"] then
error("Raw category " .. category .. " defined in both [["
.. datamodule .. "]] and [[" .. raw_categories[category].module .. "]].")
end
data.module = datamodule
raw_categories[category] = data
end
end
if retval["HANDLERS"] then
for _, handler in ipairs(retval["HANDLERS"]) do
table.insert(handlers, { module = datamodule, handler = handler })
end
end
if retval["RAW_HANDLERS"] then
for _, handler in ipairs(retval["RAW_HANDLERS"]) do
table.insert(raw_handlers, { module = datamodule, handler = handler })
end
end
end
-- Add child categories to their parents
local function add_children_to_parents(hierarchy, raw)
for key, data in pairs(hierarchy) do
local parents = data.parents
if parents then
if type(parents) ~= "table" then
parents = {parents}
end
if parents.name or parents.module then
parents = {parents}
end
for _, parent in ipairs(parents) do
if type(parent) ~= "table" or not parent.name and not parent.module then
parent = {name = parent}
end
if parent.name and not parent.module and type(parent.name) == "string" and not parent.name:find("^Category:") then
local parent_is_raw
if raw then
parent_is_raw = not parent.is_label
else
parent_is_raw = parent.raw
end
-- Don't do anything if the child is raw and the parent is lang-specific,
-- otherwise e.g. "Lemmas subcategories by language" will be listed as a
-- child of every "LANG lemmas" category.
-- FIXME: We need to rethink this mechanism.
if not raw or parent_is_raw then
local child_hierarchy = parent_is_raw and raw_categories or labels
if child_hierarchy[parent.name] then
local child = {name = key, sort = parent.sort, raw = raw}
if child_hierarchy[parent.name].children then
table.insert(child_hierarchy[parent.name].children, child)
else
child_hierarchy[parent.name].children = {child}
end
end
end
end
end
end
end
end
add_children_to_parents(labels)
add_children_to_parents(raw_categories, true)
return {
LABELS = labels, RAW_CATEGORIES = raw_categories,
HANDLERS = handlers, RAW_HANDLERS = raw_handlers
}