Wikipedia Content Library Mediawiki Content History V1 — Snapshot Change
ChangedPrevious snapshot
17 Oct 2026, 18:00 (Berlin)
2fa201708844910a067741df4a6ecca7…
This snapshot
19 Oct 2026, 18:00 (Berlin)
468036de48e47d8f4c42f34691d47954…
Run Assessment
insignificant ollama / llama3.1:8b auto: significant ⚠ rule/AI disagreementThe change appears to be a cosmetic update to the page layout and links, with no new dataset endpoints or API documentation URLs added or removed. This makes it insignificant because the content is functionally identical and only minor wording/formatting changes were made.
+ 0 lines added
− 156 lines removed
43 links removed
https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1
Links Changed
Removed
https://creativecommons.org/licenses/by-sa/4.0/
https://developer.wikimedia.org
https://donate.wikimedia.org/?wmf_source=donate&wmf_medium=sidebar&wmf_campaign=wikitech.wikimedia.org&uselang=en
https://foundation.wikimedia.org/wiki/General_disclaimer
https://foundation.wikimedia.org/wiki/Special:MyLanguage/Policy:Cookie_statement
https://foundation.wikimedia.org/wiki/Special:MyLanguage/Policy:Privacy_policy
https://foundation.wikimedia.org/wiki/Special:MyLanguage/Policy:Terms_of_Use
https://phabricator.wikimedia.org/project/view/2875/
https://stats.wikimedia.org/#/wikitech.wikimedia.org
https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=edit
https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=history
https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=info
https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&mobileaction=toggle_view_mobile
https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&useparsoid=0
https://wikitech.wikimedia.org/w/index.php?title=Special:Book&bookcmd=book_creator&referer=Data+Platform%2FData+Lake%2FContent%2FMediawiki+content+history+v1
https://wikitech.wikimedia.org/w/index.php?title=Special:CiteThisPage&page=Data_Platform%2FData_Lake%2FContent%2FMediawiki_content_history_v1&id=2395782&wpFormIdentifier=titleform
https://wikitech.wikimedia.org/w/index.php?title=Special:CreateAccount&returnto=Data+Platform%2FData+Lake%2FContent%2FMediawiki+content+history+v1
https://wikitech.wikimedia.org/w/index.php?title=Special:DownloadAsPdf&page=Data_Platform%2FData_Lake%2FContent%2FMediawiki_content_history_v1&action=show-download-screen
https://wikitech.wikimedia.org/w/index.php?title=Special:UrlShortener&url=https%3A%2F%2Fwikitech.wikimedia.org%2Fwiki%2FData_Platform%2FData_Lake%2FContent%2FMediawiki_content_history_v1
https://wikitech.wikimedia.org/w/index.php?title=Special:UserLogin&returnto=Data+Platform%2FData+Lake%2FContent%2FMediawiki+content+history+v1
https://wikitech.wikimedia.org/w/index.php?title=Talk:Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=edit&redlink=1
https://wikitech.wikimedia.org/wiki/Cloud_VPS_Server_Admin_Log
https://wikitech.wikimedia.org/wiki/Data_Platform
https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake
https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content
https://wikitech.wikimedia.org/wiki/Deployments
https://wikitech.wikimedia.org/wiki/Incident_status
https://wikitech.wikimedia.org/wiki/Main_Page
https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS
https://wikitech.wikimedia.org/wiki/Portal:Toolforge
https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL
https://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests
https://wikitech.wikimedia.org/wiki/Server_Admin_Log
https://wikitech.wikimedia.org/wiki/Special:RecentChanges
https://wikitech.wikimedia.org/wiki/Special:RecentChangesLinked/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1
https://wikitech.wikimedia.org/wiki/Special:Search
https://wikitech.wikimedia.org/wiki/Special:SpecialPages
https://wikitech.wikimedia.org/wiki/Special:WhatLinksHere/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1
https://wikitech.wikimedia.org/wiki/Wikitech:Village_pump
https://www.mediawiki.org/
https://www.mediawiki.org/wiki/Special:MyLanguage/Code_of_Conduct
https://www.mediawiki.org/wiki/Special:MyLanguage/Parsoid
https://www.wikimedia.org/
Line-by-line changes
163 lines
| − | [Jump to content](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#bodyContent) |
| − | |
| − | Main menu |
| − | |
| − | Main menu |
| − | |
| − | move to sidebar |
| − | hide |
| − | |
| − | Navigation |
| − | |
| − | - [Main page](https://wikitech.wikimedia.org/wiki/Main_Page "Visit the main page [z]") |
| − | - [Server admin log: Prod](https://wikitech.wikimedia.org/wiki/Server_Admin_Log) |
| − | - [Admin log: RelEng](https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL) |
| − | - [Incident status](https://wikitech.wikimedia.org/wiki/Incident_status) |
| − | - [Deployments](https://wikitech.wikimedia.org/wiki/Deployments) |
| − | - [SRE Team Help](https://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests) |
| − | |
| − | Cloud VPS & Toolforge |
| − | |
| − | - [Cloud VPS portal](https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS) |
| − | - [Toolforge portal](https://wikitech.wikimedia.org/wiki/Portal:Toolforge) |
| − | - [Request VPS project](https://phabricator.wikimedia.org/project/view/2875/) |
| − | - [Admin log: Cloud VPS](https://wikitech.wikimedia.org/wiki/Cloud_VPS_Server_Admin_Log) |
| − | |
| − | wikitech.wikimedia.org |
| − | |
| − | - [Recent changes](https://wikitech.wikimedia.org/wiki/Special:RecentChanges "A list of recent changes in the wiki [r]") |
| − | - [Special pages](https://wikitech.wikimedia.org/wiki/Special:SpecialPages "A list of all special pages [q]") |
| − | - [Village pump](https://wikitech.wikimedia.org/wiki/Wikitech:Village_pump) |
| − | |
| − | [Search](https://wikitech.wikimedia.org/wiki/Special:Search "Search Wikitech [f]") |
| − | |
| − | Search |
| − | |
| − | - [English](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1) |
| − | |
| − | Appearance |
| − | |
| − | - [Donate](https://donate.wikimedia.org/?wmf_source=donate&wmf_medium=sidebar&wmf_campaign=wikitech.wikimedia.org&uselang=en) |
| − | - [Create account](https://wikitech.wikimedia.org/w/index.php?title=Special:CreateAccount&returnto=Data+Platform%2FData+Lake%2FContent%2FMediawiki+content+history+v1 "You are encouraged to create an account and log in; however, it is not mandatory") |
| − | - [Log in](https://wikitech.wikimedia.org/w/index.php?title=Special:UserLogin&returnto=Data+Platform%2FData+Lake%2FContent%2FMediawiki+content+history+v1 "You are encouraged to log in; however, it is not mandatory [o]") |
| − | |
| − | Personal tools |
| − | |
| − | - [Donate](https://donate.wikimedia.org/?wmf_source=donate&wmf_medium=sidebar&wmf_campaign=wikitech.wikimedia.org&uselang=en) |
| − | - [Create account](https://wikitech.wikimedia.org/w/index.php?title=Special:CreateAccount&returnto=Data+Platform%2FData+Lake%2FContent%2FMediawiki+content+history+v1 "You are encouraged to create an account and log in; however, it is not mandatory") |
| − | - [Log in](https://wikitech.wikimedia.org/w/index.php?title=Special:UserLogin&returnto=Data+Platform%2FData+Lake%2FContent%2FMediawiki+content+history+v1 "You are encouraged to log in; however, it is not mandatory [o]") |
| − | |
| − | ## Contents |
| − | |
| − | move to sidebar |
| − | hide |
| − | |
| − | - [Beginning](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1) |
| − | - [1 |
| − | Schema](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#Schema) |
| − | |
| − | Toggle Schema subsection |
| − | - [1.1 |
| − | Changes and known problems](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#Changes_and_known_problems) |
| − | - [2 |
| − | FAQ](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#FAQ) |
| − | |
| − | Toggle FAQ subsection |
| − | - [2.1 |
| − | How do I query this table if I am only interested in the main slot?](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#How_do_I_query_this_table_if_I_am_only_interested_in_the_main_slot?) |
| − | - [2.2 |
| − | This table doesn't seem to have Hive partitions, such as the usual 'snapshot' column. How do I consume it?](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#This_table_doesn't_seem_to_have_Hive_partitions,_such_as_the_usual_'snapshot'_column._How_do_I_consume_it?) |
| − | - [2.3 |
| − | What does the sensor guarantee? Will there be missing/incorrect data?](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#What_does_the_sensor_guarantee?_Will_there_be_missing/incorrect_data?) |
| − | - [2.4 |
| − | What minimal Spark configuration do I need to fully read this table?](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#What_minimal_Spark_configuration_do_I_need_to_fully_read_this_table?) |
| − | - [3 |
| − | Pipeline](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#Pipeline) |
| − | - [4 |
| − | SLO](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#SLO) |
| − | |
| − | Toggle the table of contents |
| − | |
| − | # Data Platform/Data Lake/Content/Mediawiki content history v1 |
| − | |
| − | - [Page](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1 "View the content page [c]") |
| − | - [Discussion](https://wikitech.wikimedia.org/w/index.php?title=Talk:Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=edit&redlink=1 "Discussion about the content page (page does not exist) [t]") |
| − | |
| − | English |
| − | |
| − | - [Read](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1) |
| − | - [View source](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=edit "This page is protected. |
| − | You can view its source [e]") |
| − | - [View history](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=history "Past revisions of this page [h]") |
| − | |
| − | Tools |
| − | |
| − | Tools |
| − | |
| − | move to sidebar |
| − | hide |
| − | |
| − | Actions |
| − | |
| − | - [Read](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1) |
| − | - [View source](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=edit "This page is protected. |
| − | You can view its source [e]") |
| − | - [View history](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=history "Past revisions of this page [h]") |
| − | |
| − | General |
| − | |
| − | - [What links here](https://wikitech.wikimedia.org/wiki/Special:WhatLinksHere/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1 "A list of all wiki pages that link here [j]") |
| − | - [Related changes](https://wikitech.wikimedia.org/wiki/Special:RecentChangesLinked/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1 "Recent changes in pages linked from this page [k]") |
| − | - [Permanent link](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&oldid=2395782 "Permanent link to this revision of this page") |
| − | - [Page information](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=info "More information about this page") |
| − | - [Cite this page](https://wikitech.wikimedia.org/w/index.php?title=Special:CiteThisPage&page=Data_Platform%2FData_Lake%2FContent%2FMediawiki_content_history_v1&id=2395782&wpFormIdentifier=titleform "Information on how to cite this page") |
| − | - [Get shortened URL](https://wikitech.wikimedia.org/w/index.php?title=Special:UrlShortener&url=https%3A%2F%2Fwikitech.wikimedia.org%2Fwiki%2FData_Platform%2FData_Lake%2FContent%2FMediawiki_content_history_v1) |
| − | - [Switch to legacy parser](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&useparsoid=0) |
| − | |
| − | Print/export |
| − | |
| − | - [Create a book](https://wikitech.wikimedia.org/w/index.php?title=Special:Book&bookcmd=book_creator&referer=Data+Platform%2FData+Lake%2FContent%2FMediawiki+content+history+v1) |
| − | - [Download as PDF](https://wikitech.wikimedia.org/w/index.php?title=Special:DownloadAsPdf&page=Data_Platform%2FData_Lake%2FContent%2FMediawiki_content_history_v1&action=show-download-screen) |
| − | - [Printable version](javascript:print(); "Printable version of this page [p]") |
| − | |
| − | Appearance |
| − | |
| − | move to sidebar |
| − | hide |
| − | |
| − | From Wikitech |
| − | |
| − | < [Data Platform](https://wikitech.wikimedia.org/wiki/Data_Platform "Data Platform") | [Data Lake](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake "Data Platform/Data Lake") | [Content](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content "Data Platform/Data Lake/Content") |
| − | |
| `wmf_content.mediawiki_content_history_v1` is a dataset available in the [Data Lake](https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake "Analytics/Data Lake") that provides the full content of *all revisions*, past and present, from all Wikimedia wikis. | |
| The schema of this table is similar to that of [Mediawiki wikitext history](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_wikitext_history "Data Platform/Data Lake/Content/Mediawiki wikitext history"). However, this table's source data comes primarily from event streams from the [Event Platform](https://wikitech.wikimedia.org/wiki/Event_Platform "Event Platform"), allowing us to update it on a daily basis. The content under this table's `revision_content_slots['main']` is typically unparsed [Wikitext](https://www.mediawiki.org/wiki/Wikitext "mediawikiwiki:Wikitext"), and [Multi-Content Revisions](https://www.mediawiki.org/wiki/Multi-Content_Revisions "mediawikiwiki:Multi-Content Revisions") content is also included, which as of this writing is only being used by `commonswiki`. | |
| ⋯ 144 unchanged lines ⋯ | |
| This page also has some nice pipeline diagrams. | |
| Retrieved from "<https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&oldid=2395782>" | |
| − | |
| − | - This page was last edited on 25 March 2026, at 14:52. |
| − | - Page was rendered with [Parsoid](https://www.mediawiki.org/wiki/Special:MyLanguage/Parsoid "mw:Special:MyLanguage/Parsoid"). |
| − | - Text is available under the [Creative Commons Attribution-ShareAlike License](https://creativecommons.org/licenses/by-sa/4.0/); |
| − | additional terms may apply. |
| − | See [Terms of Use](https://foundation.wikimedia.org/wiki/Special:MyLanguage/Policy:Terms_of_Use) for details. |
| − | |
| − | - [Privacy policy](https://foundation.wikimedia.org/wiki/Special:MyLanguage/Policy:Privacy_policy) |
| − | - [About Wikitech](https://wikitech.wikimedia.org/wiki/Main_Page) |
| − | - [Disclaimers](https://foundation.wikimedia.org/wiki/General_disclaimer) |
| − | - [Code of Conduct](https://www.mediawiki.org/wiki/Special:MyLanguage/Code_of_Conduct) |
| − | - [Developers](https://developer.wikimedia.org) |
| − | - [Statistics](https://stats.wikimedia.org/#/wikitech.wikimedia.org) |
| − | - [Cookie statement](https://foundation.wikimedia.org/wiki/Special:MyLanguage/Policy:Cookie_statement) |
| − | - [Mobile view](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&mobileaction=toggle_view_mobile) |
| − | |
| − | Search |
| − | |
| − | Search |
| − | |
| − | Toggle the table of contents |
| − | |
| − | Data Platform/Data Lake/Content/Mediawiki content history v1 |
| − | |
| − | [Add topic](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1) |
| Previous · 17 Oct 2026, 18:00 (Berlin) | Current · 19 Oct 2026, 18:00 (Berlin) | |||
|---|---|---|---|---|
| − | [Jump to content](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#bodyContent) | |||
| − | ||||
| − | Main menu | |||
| − | ||||
| − | Main menu | |||
| − | ||||
| − | move to sidebar | |||
| − | hide | |||
| − | ||||
| − | Navigation | |||
| − | ||||
| − | - [Main page](https://wikitech.wikimedia.org/wiki/Main_Page "Visit the main page [z]") | |||
| − | - [Server admin log: Prod](https://wikitech.wikimedia.org/wiki/Server_Admin_Log) | |||
| − | - [Admin log: RelEng](https://wikitech.wikimedia.org/wiki/Release_Engineering/SAL) | |||
| − | - [Incident status](https://wikitech.wikimedia.org/wiki/Incident_status) | |||
| − | - [Deployments](https://wikitech.wikimedia.org/wiki/Deployments) | |||
| − | - [SRE Team Help](https://wikitech.wikimedia.org/wiki/SRE/SRE_Team_requests) | |||
| − | ||||
| − | Cloud VPS & Toolforge | |||
| − | ||||
| − | - [Cloud VPS portal](https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS) | |||
| − | - [Toolforge portal](https://wikitech.wikimedia.org/wiki/Portal:Toolforge) | |||
| − | - [Request VPS project](https://phabricator.wikimedia.org/project/view/2875/) | |||
| − | - [Admin log: Cloud VPS](https://wikitech.wikimedia.org/wiki/Cloud_VPS_Server_Admin_Log) | |||
| − | ||||
| − | wikitech.wikimedia.org | |||
| − | ||||
| − | - [Recent changes](https://wikitech.wikimedia.org/wiki/Special:RecentChanges "A list of recent changes in the wiki [r]") | |||
| − | - [Special pages](https://wikitech.wikimedia.org/wiki/Special:SpecialPages "A list of all special pages [q]") | |||
| − | - [Village pump](https://wikitech.wikimedia.org/wiki/Wikitech:Village_pump) | |||
| − | ||||
| − | [Search](https://wikitech.wikimedia.org/wiki/Special:Search "Search Wikitech [f]") | |||
| − | ||||
| − | Search | |||
| − | ||||
| − | - [English](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1) | |||
| − | ||||
| − | Appearance | |||
| − | ||||
| − | - [Donate](https://donate.wikimedia.org/?wmf_source=donate&wmf_medium=sidebar&wmf_campaign=wikitech.wikimedia.org&uselang=en) | |||
| − | - [Create account](https://wikitech.wikimedia.org/w/index.php?title=Special:CreateAccount&returnto=Data+Platform%2FData+Lake%2FContent%2FMediawiki+content+history+v1 "You are encouraged to create an account and log in; however, it is not mandatory") | |||
| − | - [Log in](https://wikitech.wikimedia.org/w/index.php?title=Special:UserLogin&returnto=Data+Platform%2FData+Lake%2FContent%2FMediawiki+content+history+v1 "You are encouraged to log in; however, it is not mandatory [o]") | |||
| − | ||||
| − | Personal tools | |||
| − | ||||
| − | - [Donate](https://donate.wikimedia.org/?wmf_source=donate&wmf_medium=sidebar&wmf_campaign=wikitech.wikimedia.org&uselang=en) | |||
| − | - [Create account](https://wikitech.wikimedia.org/w/index.php?title=Special:CreateAccount&returnto=Data+Platform%2FData+Lake%2FContent%2FMediawiki+content+history+v1 "You are encouraged to create an account and log in; however, it is not mandatory") | |||
| − | - [Log in](https://wikitech.wikimedia.org/w/index.php?title=Special:UserLogin&returnto=Data+Platform%2FData+Lake%2FContent%2FMediawiki+content+history+v1 "You are encouraged to log in; however, it is not mandatory [o]") | |||
| − | ||||
| − | ## Contents | |||
| − | ||||
| − | move to sidebar | |||
| − | hide | |||
| − | ||||
| − | - [Beginning](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1) | |||
| − | - [1 | |||
| − | Schema](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#Schema) | |||
| − | ||||
| − | Toggle Schema subsection | |||
| − | - [1.1 | |||
| − | Changes and known problems](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#Changes_and_known_problems) | |||
| − | - [2 | |||
| − | FAQ](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#FAQ) | |||
| − | ||||
| − | Toggle FAQ subsection | |||
| − | - [2.1 | |||
| − | How do I query this table if I am only interested in the main slot?](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#How_do_I_query_this_table_if_I_am_only_interested_in_the_main_slot?) | |||
| − | - [2.2 | |||
| − | This table doesn't seem to have Hive partitions, such as the usual 'snapshot' column. How do I consume it?](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#This_table_doesn't_seem_to_have_Hive_partitions,_such_as_the_usual_'snapshot'_column._How_do_I_consume_it?) | |||
| − | - [2.3 | |||
| − | What does the sensor guarantee? Will there be missing/incorrect data?](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#What_does_the_sensor_guarantee?_Will_there_be_missing/incorrect_data?) | |||
| − | - [2.4 | |||
| − | What minimal Spark configuration do I need to fully read this table?](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#What_minimal_Spark_configuration_do_I_need_to_fully_read_this_table?) | |||
| − | - [3 | |||
| − | Pipeline](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#Pipeline) | |||
| − | - [4 | |||
| − | SLO](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1#SLO) | |||
| − | ||||
| − | Toggle the table of contents | |||
| − | ||||
| − | # Data Platform/Data Lake/Content/Mediawiki content history v1 | |||
| − | ||||
| − | - [Page](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1 "View the content page [c]") | |||
| − | - [Discussion](https://wikitech.wikimedia.org/w/index.php?title=Talk:Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=edit&redlink=1 "Discussion about the content page (page does not exist) [t]") | |||
| − | ||||
| − | English | |||
| − | ||||
| − | - [Read](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1) | |||
| − | - [View source](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=edit "This page is protected. | |||
| − | You can view its source [e]") | |||
| − | - [View history](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=history "Past revisions of this page [h]") | |||
| − | ||||
| − | Tools | |||
| − | ||||
| − | Tools | |||
| − | ||||
| − | move to sidebar | |||
| − | hide | |||
| − | ||||
| − | Actions | |||
| − | ||||
| − | - [Read](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1) | |||
| − | - [View source](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=edit "This page is protected. | |||
| − | You can view its source [e]") | |||
| − | - [View history](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=history "Past revisions of this page [h]") | |||
| − | ||||
| − | General | |||
| − | ||||
| − | - [What links here](https://wikitech.wikimedia.org/wiki/Special:WhatLinksHere/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1 "A list of all wiki pages that link here [j]") | |||
| − | - [Related changes](https://wikitech.wikimedia.org/wiki/Special:RecentChangesLinked/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1 "Recent changes in pages linked from this page [k]") | |||
| − | - [Permanent link](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&oldid=2395782 "Permanent link to this revision of this page") | |||
| − | - [Page information](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&action=info "More information about this page") | |||
| − | - [Cite this page](https://wikitech.wikimedia.org/w/index.php?title=Special:CiteThisPage&page=Data_Platform%2FData_Lake%2FContent%2FMediawiki_content_history_v1&id=2395782&wpFormIdentifier=titleform "Information on how to cite this page") | |||
| − | - [Get shortened URL](https://wikitech.wikimedia.org/w/index.php?title=Special:UrlShortener&url=https%3A%2F%2Fwikitech.wikimedia.org%2Fwiki%2FData_Platform%2FData_Lake%2FContent%2FMediawiki_content_history_v1) | |||
| − | - [Switch to legacy parser](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&useparsoid=0) | |||
| − | ||||
| − | Print/export | |||
| − | ||||
| − | - [Create a book](https://wikitech.wikimedia.org/w/index.php?title=Special:Book&bookcmd=book_creator&referer=Data+Platform%2FData+Lake%2FContent%2FMediawiki+content+history+v1) | |||
| − | - [Download as PDF](https://wikitech.wikimedia.org/w/index.php?title=Special:DownloadAsPdf&page=Data_Platform%2FData_Lake%2FContent%2FMediawiki_content_history_v1&action=show-download-screen) | |||
| − | - [Printable version](javascript:print(); "Printable version of this page [p]") | |||
| − | ||||
| − | Appearance | |||
| − | ||||
| − | move to sidebar | |||
| − | hide | |||
| − | ||||
| − | From Wikitech | |||
| − | ||||
| − | < [Data Platform](https://wikitech.wikimedia.org/wiki/Data_Platform "Data Platform") | [Data Lake](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake "Data Platform/Data Lake") | [Content](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content "Data Platform/Data Lake/Content") | |||
| − | ||||
| `wmf_content.mediawiki_content_history_v1` is a dataset available in the [Data Lake](https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake "Analytics/Data Lake") that provides the full content of *all revisions*, past and present, from all Wikimedia wikis. | `wmf_content.mediawiki_content_history_v1` is a dataset available in the [Data Lake](https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake "Analytics/Data Lake") that provides the full content of *all revisions*, past and present, from all Wikimedia wikis. | |||
| The schema of this table is similar to that of [Mediawiki wikitext history](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_wikitext_history "Data Platform/Data Lake/Content/Mediawiki wikitext history"). However, this table's source data comes primarily from event streams from the [Event Platform](https://wikitech.wikimedia.org/wiki/Event_Platform "Event Platform"), allowing us to update it on a daily basis. The content under this table's `revision_content_slots['main']` is typically unparsed [Wikitext](https://www.mediawiki.org/wiki/Wikitext "mediawikiwiki:Wikitext"), and [Multi-Content Revisions](https://www.mediawiki.org/wiki/Multi-Content_Revisions "mediawikiwiki:Multi-Content Revisions") content is also included, which as of this writing is only being used by `commonswiki`. | The schema of this table is similar to that of [Mediawiki wikitext history](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_wikitext_history "Data Platform/Data Lake/Content/Mediawiki wikitext history"). However, this table's source data comes primarily from event streams from the [Event Platform](https://wikitech.wikimedia.org/wiki/Event_Platform "Event Platform"), allowing us to update it on a daily basis. The content under this table's `revision_content_slots['main']` is typically unparsed [Wikitext](https://www.mediawiki.org/wiki/Wikitext "mediawikiwiki:Wikitext"), and [Multi-Content Revisions](https://www.mediawiki.org/wiki/Multi-Content_Revisions "mediawikiwiki:Multi-Content Revisions") content is also included, which as of this writing is only being used by `commonswiki`. | |||
| ⋯ 144 unchanged lines ⋯ | ||||
| This page also has some nice pipeline diagrams. | This page also has some nice pipeline diagrams. | |||
| Retrieved from "<https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&oldid=2395782>" | Retrieved from "<https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&oldid=2395782>" | |||
| − | ||||
| − | - This page was last edited on 25 March 2026, at 14:52. | |||
| − | - Page was rendered with [Parsoid](https://www.mediawiki.org/wiki/Special:MyLanguage/Parsoid "mw:Special:MyLanguage/Parsoid"). | |||
| − | - Text is available under the [Creative Commons Attribution-ShareAlike License](https://creativecommons.org/licenses/by-sa/4.0/); | |||
| − | additional terms may apply. | |||
| − | See [Terms of Use](https://foundation.wikimedia.org/wiki/Special:MyLanguage/Policy:Terms_of_Use) for details. | |||
| − | ||||
| − | - [Privacy policy](https://foundation.wikimedia.org/wiki/Special:MyLanguage/Policy:Privacy_policy) | |||
| − | - [About Wikitech](https://wikitech.wikimedia.org/wiki/Main_Page) | |||
| − | - [Disclaimers](https://foundation.wikimedia.org/wiki/General_disclaimer) | |||
| − | - [Code of Conduct](https://www.mediawiki.org/wiki/Special:MyLanguage/Code_of_Conduct) | |||
| − | - [Developers](https://developer.wikimedia.org) | |||
| − | - [Statistics](https://stats.wikimedia.org/#/wikitech.wikimedia.org) | |||
| − | - [Cookie statement](https://foundation.wikimedia.org/wiki/Special:MyLanguage/Policy:Cookie_statement) | |||
| − | - [Mobile view](https://wikitech.wikimedia.org/w/index.php?title=Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1&mobileaction=toggle_view_mobile) | |||
| − | ||||
| − | Search | |||
| − | ||||
| − | Search | |||
| − | ||||
| − | Toggle the table of contents | |||
| − | ||||
| − | Data Platform/Data Lake/Content/Mediawiki content history v1 | |||
| − | ||||
| − | [Add topic](https://wikitech.wikimedia.org/wiki/Data_Platform/Data_Lake/Content/Mediawiki_content_history_v1) | |||