Advanced Mobile Contributions Metrics - Final Report

Megan Neisler
November 22, 2019

Project summary

As part of efforts to improve the mobile contribution experience, the Web team deployed the Advanced Mobile Contributions (AMC) mode. This is an opt-in feature set that adds more contributor capabilities to the mobile web experience. Please see the (project page) for more details about the background, changes and goals of the project.

The feature was was first deployed as an opt-in setting to identified target wikis including Arabic, Indonesian, Spanish, Italian, Japanese, Persian, and Thai Wikipedias due to their relatively large populations of existing mobile editors. After testing and feedback, AMC for deployed and promoted the feature set to all Wikimedia projects.

Timeline

  • March 20, 2019 - AMC released as opt-in setting on Arabic, Indonesian, and Spanish Wikipedias
  • June 17, 2019 - the team released a second set of features and included additional Wikipedias for testing and feedback (Italian, Japanese, Persian, and Thai).
  • August 7, 2019- AMC deployed to all Wikipedias.
  • October 10, 2019 - AMC deployed everywhere.

This report shows the status of the key performance indicators (KPIs) identified in the Annual Plan following the deployment of AMC to all Wikimedia Projects. Results from first progress report, showing the status of the KPIs as of the end of FY18-19 (June 2019), are available in the FY 2018/2019 AMC Metrics Status Report. We reviewed metrics overall, on english wikipedia, and on all of the target Wikipedia projects.

Metrics

In the annual plan, the Readers Web team defined the following KPIs:

Mobile web edit rate.

  • Rate of edits on mobile web coming from AMC mode and overall rate.
  • Target: 10% increase from last year (overall metric). Measured using the new AMC edits tag (done in T212959) to see if they reach 1/11th of total mobile web edits, defined using the existing edit tag. AMC tag was created on Jan 16, 2019

Retention rate for opt-in advanced mobile mode amongst medium and high-volume editors (100+ edits (medium-volume), 500+ edits (high volume) )

  • The proportion of editors who opt-in and stay opted-in to AMC mode.
  • Target: At least 60% retention.
  • Measured using the opt-in/opt-out button (done in T211197 using the PrepUpdate mf_amc_optin). This is set to true each time someone opts out.

Moderation actions on mobile web

  • Rate of moderation actions on mobile web coming from AMC mode and the overall rate.
  • Target: 10% increase from last year.
  • Moderation actions are defined in T213461
  • Measured using the AMC edit tag as for edits (above).

Other Metrics

  • Rates of access to special pages overall with the proportion of AMC requests measured using the X-Analytics tag for AMC (done in T212961.
  • Rates of access and edits to article talk pages with the proportion of AMC edits measured using on AMC X-Analytics tag and AMC edit tag

For more links to implementation tasks and technical details, see this overview task T210660

Key observations

  • Mobile Web Edit Rate: The mobile web edit rate across all Wikipedia projects has been increasing steadlily over the past year. This rate did not change signficantly following AMC deployment; however, the proportion of mobile web edits made in AMC mode has been increasing. In September 2019, there was a 22.7% year over year increase in the mobile web edit across all Wikpedias. 26% of these edits were made by users in AMC mode. The highest proportion of AMC tagged mobile web edits are made by high volume editors (500+ cumulative edits).
  • Retention Rate: There has been an 87.7% overall retention rate of the opt-in AMC mode across all Wiki projects with significant increases in the number of AMC opt-ins following the central notice banner deployed on July 15, 2019, the deployment of AMC on all Wikipedias on August 7, 2019, and also following the deployment across all Wikipedia projects on October 10, 2019. The retention rate of AMC was higher for medium to high volume editors compared to low volume editors.
  • Moderation actions on mobile web: There was a significant increase in the number of moderation actions following AMC deployment on all Wikipedia projects. Moderation actions on mobile web increased by 31% across all Wikipedias and 37.6% on English Wikipedia from the month August 2019 (first month of deployment to all Wikipedia) to the September 2019. The thank action is the most commonly used moderation action on mobile web. However, the number of blocks and approves has both seen signficant increases since AMC was deployed on all wikis.
  • Rate of access to special pages : Requests to special pages has remained relatively flat (there was only a 3% month over month change between September 2019 and October 2019) and views from mobile web in AMC mode represent about only 2% of all mobile web views to these pages. However, there has been an increase in the proportion of mobile web requests to special pages coming from AMC mode since it was deployed on all Wikipedias on August 7, 2018. The proportion of AMC requests increased from September to October 2019 by 15.9%. The Mobile Diff, Watchlist, Contributions, and Search are the most viewed special pages from users in AMC mode on all Wikipedias.
  • Rate of access to talk pages : There was a 10.6% year over year increase in the number of views to article talk pages from mobile web in October 2019. About 42% of these views came from users in AMC mode. The rate of edits to talk pages have also continued to increase following the July and August deployment dates. While other variables such as changes in the number of active edtiors may also lead to these increases, the proportion of talk page edits made by users in AMC mode has been increasing each month following deployment. AMC edits accounted for 42.1% of all talk page edits made by logged-in users on mobile web in October 2019.
In [2046]:
library(IRdisplay)

display_html(
'<script>  
code_show=true; 
function code_toggle() {
  if (code_show){
    $(\'div.input\').hide();
  } else {
    $(\'div.input\').show();
  }
  code_show = !code_show
}  
$( document ).ready(code_toggle);
</script>
  <form action="javascript:code_toggle()">
    <input type="submit" value="Click here to toggle on/off the raw code.">
 </form>'
)
In [ ]:
vertical_lines <- as.numeric(as.Date(c("2019-03-20", "2019-06-17", "2019-08-07")))

Mobile web edit rate

Methodology

The mobile web edit rate is based on edits on all Wikipedias between June 1, 2018 through September 30, 2019 recorded in the mediawiki_history dataset.

We reviewed the both the rate of overall mobile web edits and the rate of edits on mobile web coming from AMC mode (Measured using the an AMC edits tag (done in T212959 on January 16, 2016).

At the time of this analysis, we did not review any changes on non-Wikipedia projects since AMC was not deployed on those projects until October 10, 2019.

In [1631]:
shhh <- function(expr) suppressPackageStartupMessages(suppressWarnings(suppressMessages(expr)))
shhh({
    library(magrittr); library(zeallot); library(glue); library(tidyverse); library(zoo); library(lubridate)
    library(scales)
})
In [ ]:
#Collect all mobile web edits and mobile web edits tagged as AMC from all target wikis where AMC was deployed 
#grouped by wiki and user edit count

# In terminal
# spark2R --master yarn --executor-memory 2G --executor-cores 1 --driver-memory 4G

query <- "SELECT
    date_format(event_timestamp, 'yyyy-MM-dd') as date,
    wiki,
    user_edit_count,
    sum(cast(other_mobile_web_edit as int)) as other_mobile_web_edits,
    sum(cast(amc_edit as int)) as amc_edits,
    sum(cast(mobile_web_edit as int)) as mobile_web_edits
FROM (
    SELECT
        wiki_db as wiki,
        event_timestamp,
        (array_contains(revision_tags, 'mobile web edit') and not
        array_contains(revision_tags, 'advanced mobile edit')) as other_mobile_web_edit, 
        (array_contains(revision_tags, 'advanced mobile edit') and
        array_contains(revision_tags, 'mobile web edit')) as amc_edit,
        array_contains(revision_tags, 'mobile web edit') as mobile_web_edit,
        CASE
            WHEN event_user_revision_count is NULL THEN 'undefined'
            WHEN event_user_revision_count < 100 THEN 'under 100'
            WHEN event_user_revision_count >=100 AND event_user_revision_count < 500 THEN '100-499'
            ELSE '500+'
    END AS user_edit_count
    FROM wmf.mediawiki_history mwh
    INNER JOIN canonical_data.wikis cd
        ON wiki_db = database_code 
    WHERE
        mwh.event_entity = 'revision' and
        mwh.event_type = 'create' and
        cd.database_group = 'wikipedia' and
        mwh.event_timestamp IS NOT NULL and
        mwh.event_timestamp between '2018-06-01' and '2019-09-30' and 
        mwh.snapshot = '2019-10'
) edits
GROUP BY wiki, date_format(event_timestamp, 'yyyy-MM-dd'), user_edit_count"

results <- collect(sql(query))
save(results, file="Readers-Web-AMC-metrics/Data/mobile_web_edit_counts.RData")
In [579]:
load("Data/mobile_web_edit_counts.RData")
mobile_web_edit_counts <- results
In [581]:
mobile_web_edit_counts$date <- as.Date(mobile_web_edit_counts$date, format = "%Y-%m-%d")

mobile_web_edit_counts_clean <-  mobile_web_edit_counts %>%
gather(edit_type, edit_count, 4:6) %>%
    arrange(desc(date))

Overall mobile web edit rate

In [1741]:
##Overall monthly web edit counts and yoy change
mobile_web_edit_monthly_overall_yoy <- mobile_web_edit_counts_clean %>%
filter(edit_type == 'mobile_web_edits') %>%   # filter to all overall mobile web edits (both AMC and non-AMC)
mutate(date = floor_date(date, "month")) %>%
  group_by(date) %>%
  summarise(total_mobile_edits = sum(edit_count, na.rm = TRUE)) %>%
  arrange(date) %>%
mutate(yearOverYear= (total_mobile_edits/lag(total_mobile_edits,12) -1)*100)

tail(mobile_web_edit_monthly_overall_yoy)
A tibble: 6 × 3
datetotal_mobile_editsyearOverYear
<date><dbl><dbl>
2019-04-011180291 NA
2019-05-011247127 NA
2019-06-01122187824.57948
2019-07-01128703526.34613
2019-08-01134672826.30888
2019-09-01122036622.79424
In [2005]:
##Plot time series of mobile edits rate.


p <- mobile_web_edit_monthly_overall_yoy %>%
 ggplot(aes(x=date, y = total_mobile_edits, color = edit_type)) + 
    geom_line(color = 'blue', size = 1.5 ) +
geom_vline(xintercept = vertical_lines,
             linetype = "dashed", color = "black") +
  geom_text(aes(x=as.Date('2019-03-20'), y=1.15E6, label="AMC deployed on Arabic, Indonesian, and Spanish Wikipedias"), size=3.7, vjust = -1.2, angle = 90, color = "black") +
  geom_text(aes(x=as.Date('2019-06-17'), y=1.15E6, label="AMC deployed on Italian, Japanese, Persian, and Thai Wikipedias"), size=3.7, vjust = -1.2, angle = 90, color = "black") +
   geom_text(aes(x=as.Date('2019-08-07'), y=1.15E6, label="AMC deployed on all Wikipedias"), size=3.7, vjust = -1.2, angle = 90, color = "black") +
    scale_y_continuous("Number of mobile web edits per month", labels = polloi::compress) +
    scale_x_date("Date", labels = date_format("%b %Y"), date_breaks = "1 month") +
    labs(title = "Mobile web edits on all Wikipedia projects") +
    ggthemes::theme_tufte(base_size = 12, base_family = "Gill Sans") +
    theme(axis.text.x=element_text(angle = 45, hjust = 1),
        plot.title = element_text(hjust = 0.5),
        panel.grid = element_line("gray70"))

p
     
ggsave("Figures/mobile_web_edits_overall_monthly.png", p, width = 18, height = 9, units = "in", dpi = 150)

There was a steady increase in total mobile web edits the past 15 months, which has been occuring prior to the deployment of AMC on target wikis. This is likely partly due to a sustained increase in overall active editors. In September 2019, there was a 22.7% year over year increase in overall mobile web edits. We reviewed the number of these edits made while the user was in AMC mode to determine the impact of AMC on this increase.

Proportion of Mobile Web Edits Made in AMC Mode

Since August deployment Date through September 2019

In [1753]:
# across all Wikipedias for logged in users since August deployment Date
amc_edits_prop_overall <- mobile_web_edit_counts %>%
    filter(date >= "2019-08-07", #deployment date across all wikis 
           user_edit_count != 'undefined') %>% #limit only to logged in users
         summarise(mobile_web_edits = sum(mobile_web_edits, na.rm = TRUE),
                 amc_edits = sum(amc_edits, na.rm = TRUE)) %>%
         mutate(amc_prop = amc_edits/mobile_web_edits *100)

amc_edits_prop_overall
A data.frame: 1 × 3
mobile_web_editsamc_editsamc_prop
<dbl><dbl><dbl>
110808019160917.29198

Per Month Since Deployment

In [1756]:
# across all Wikipedias for logged in users per month since deployment

amc_edits_prop_overall_bymonth <- mobile_web_edit_counts %>%
    filter(user_edit_count != 'undefined',
          date >= '2019-03-01')%>%  #since first March deployment
    mutate(date = floor_date(date, "month")) %>%
      group_by(date) %>%
        summarise(mobile_web_edits = sum(mobile_web_edits, na.rm = TRUE),
                 amc_edits = sum(amc_edits, na.rm = TRUE)) %>%
         mutate(prop = amc_edits/mobile_web_edits *100)

amc_edits_prop_overall_bymonth
A tibble: 7 × 4
datemobile_web_editsamc_editsprop
<date><dbl><dbl><dbl>
2019-03-01538779 693 0.1286242
2019-04-01521036 1701 0.3264650
2019-05-01568578 2351 0.4134877
2019-06-01559685 3089 0.5519176
2019-07-01609794 12180 1.9973958
2019-08-01647386 45795 7.0738323
2019-09-0158228214909725.6056344
In [2058]:
#Plot yoy of mobile web edits
p <- mobile_web_edit_counts_clean %>%
    filter(date >= '2019-03-17', #date of first deployment to target wikis
         date <= '2019-09-28', #remove last week due to incomplete data
        edit_type != 'mobile_web_edits',
         user_edit_count != 'undefined') %>%
    mutate(date = floor_date(date, "week")) %>%
    group_by(date, edit_type) %>%
    summarise(total_mobile_edits = sum(edit_count, na.rm = TRUE)) %>%
    ggplot(aes(x= date, y= total_mobile_edits, fill = edit_type)) +
    geom_col() + 
    geom_vline(xintercept = vertical_lines,
             linetype = "dashed", color = "black") +
    geom_text(aes(x=as.Date('2019-03-20'), y=80E3, label="AMC deployed on Arabic, Indonesian, and Spanish Wikipedias"), size=3.6, vjust = -1.2, angle = 90, color = "black") +
    geom_text(aes(x=as.Date('2019-06-17'), y=80E3, label="AMC deployed on Italian, Japanese, Persian, and Thai Wikipedias"), size=3.6, vjust = -1.2, angle = 90, color = "black") +
    geom_text(aes(x=as.Date('2019-08-07'), y=80E3, label="AMC deployed on all Wikipedias"), size=3.6, vjust = -1.2, angle = 90, color = "black") +
    scale_y_continuous("Number of edits per week", labels = polloi::compress) +
    scale_x_date("Date", labels = date_format("%b %d %Y"), date_breaks = "2 weeks") +
    labs(title = "Mobile web edits on all Wikipedia projects by edit mode") +
     ggthemes::theme_tufte(base_size = 14, base_family = "Gill Sans") +
     theme(axis.text.x=element_text(angle = 45, hjust = 1),
        panel.grid = element_line("gray70"),
        legend.position="bottom",
        legend.title=element_blank(),
        legend.text=element_text(size=14))

p
ggsave("Figures/mobile_web_edits_overall_amc_prop.png", p, width = 18, height = 9, units = "in", dpi = 150)

The proportion of AMC tagged mobile web edits have increased following each wiki deployment. Since deployment of AMC on all Wikipedias on August 7, 2019, 17.3% of all mobile web edits by logged-in users were made while in AMC mode. In September 2019, 26% of all mobile web edits were made while in AMC mode.

Mobile web edit rate by user experience

In [2007]:
## Plot of overall mobile web edit rate by user edit count

p <- mobile_web_edit_counts_clean %>%
    filter(edit_type == 'mobile_web_edits', #look at all mobile web edits
          user_edit_count != 'undefined', #remove undefined user edit counts
) %>% 
    mutate(date = floor_date(date, "month")) %>%
    group_by(date, user_edit_count) %>%
    summarise(total_mobile_edits = sum(edit_count, na.rm = TRUE))%>%
    ggplot(aes(x=date, y = total_mobile_edits, color = user_edit_count, linetype = user_edit_count)) + 
    geom_line(size = 1.5)+
    geom_text(aes(x=as.Date('2019-03-20'), y=200E3, label="AMC deployed on Arabic, Indonesian, and Spanish Wikipedias"), size=3.5, vjust = -1.2, angle = 90, color = "black") +
  geom_text(aes(x=as.Date('2019-06-17'), y=200E3, label="AMC deployed on Italian, Japanese, Persian, and Thai Wikipedias"), size=3.5, vjust = -1.2, angle = 90, color = "black") +
   geom_text(aes(x=as.Date('2019-08-07'), y=200E3, label="AMC deployed on all Wikipedias"), size=3.5, vjust = -1.2, angle = 90, color = "black") +
    scale_y_continuous("Number of edits per month", labels = polloi::compress) +
    scale_x_date("Date", labels = date_format("%b %Y"), date_breaks = "2 months", limits = c()) +
    labs(title = "Mobileweb edits by user experience on all Wikipedia project") +
geom_vline(xintercept = vertical_lines,
             linetype = "dashed", color = "black") +
    ggthemes::theme_tufte(base_size = 12, base_family = "Gill Sans") +
    theme(axis.text.x=element_text(angle = 45, hjust = 1),
        plot.title = element_text(hjust = 0.5),
        panel.grid = element_line("gray70"),
        legend.position="bottom")

ggsave("Figures/mobile_web_edits_byeditcount.png",p, width = 18, height = 9, units = "in", dpi = 150)

p
In [1834]:
##Calculate overall YOY increase for 100+ and 500+ editors across all wikis

mobile_web_edit_under100 <- mobile_web_edit_counts_clean %>%
    filter(user_edit_count == 'under 100') %>%
    mutate(date = floor_date(date, "month")) %>%
  group_by(date) %>%
  summarise(total_mobile_edits = sum(edit_count, na.rm = TRUE)) %>%
  arrange(date) %>%
mutate(yearOverYear= (total_mobile_edits/lag(total_mobile_edits,12) -1)*100)


mobile_web_edit_100 <- mobile_web_edit_counts_clean %>%
    filter(user_edit_count == '100-499') %>%
    mutate(date = floor_date(date, "month")) %>%
  group_by(date) %>%
  summarise(total_mobile_edits = sum(edit_count, na.rm = TRUE)) %>%
  arrange(date) %>%
mutate(yearOverYear= (total_mobile_edits/lag(total_mobile_edits,12) -1)*100)


mobile_web_edit_500 <- mobile_web_edit_counts_clean %>%
    filter(user_edit_count == '500+') %>%
    mutate(date = floor_date(date, "month")) %>%
  group_by(date) %>%
  summarise(total_mobile_edits = sum(edit_count, na.rm = TRUE)) %>%
  arrange(date) %>%
mutate(yearOverYear= (total_mobile_edits/lag(total_mobile_edits,12) -1)*100)

Overall year over year change in mobile web edits by editor experience

In [1835]:
# yoy table
edit_count <- c('under 100', '100+', '500+')
mobile_web_editcount_yoy <- rbind(mobile_web_edit_under100[16,], mobile_web_edit_100[16,], mobile_web_edit_500[16,])

mobile_web_editcount_yoy$edit_count= edit_count

mobile_web_editcount_yoy
A tibble: 3 × 4
datetotal_mobile_editsyearOverYearedit_count
<date><dbl><dbl><chr>
2019-09-0139735814.94700under 100
2019-09-0116943024.25016100+
2019-09-0159777644.12715500+

In September 2019, there was a year over year increase in mobile web edits for all user edit count groups but the highest increase (44%) was seen for logged-in editors with over 500 cumulative edits on Wikipedia projects. This is an increase from the 37% year over year increase in June 2019 for the same editor group.

Proportion of mobile web edits tagged with AMC by experience

Since August deployment Date through September 2019

In [1760]:
amc_edits_prop_overall_byeditcount <- mobile_web_edit_counts %>%
    filter(date >= "2019-08-07", #deployment date across all wikis
          user_edit_count != 'undefined') %>% 
         group_by(user_edit_count) %>% 
        summarise(mobile_web_edits = sum(mobile_web_edits, na.rm = TRUE),
                 amc_edits = sum(amc_edits, na.rm = TRUE)) %>%
        mutate(prop = amc_edits/mobile_web_edits *100)

amc_edits_prop_overall_byeditcount
A tibble: 3 × 4
user_edit_countmobile_web_editsamc_editsprop
<chr><dbl><dbl><dbl>
100-499 165873 3095018.658853
500+ 56243414770826.262281
under 100379773 12951 3.410195

**In September 2019

In [594]:
amc_edits_prop_overall_byeditcount_Sept <- mobile_web_edit_counts %>%
    filter(date >= "2019-09-01",
           date <= '2019-09-30', #deployment date across all wikis
          user_edit_count != 'undefined') %>% 
         group_by(user_edit_count) %>% 
        summarise(mobile_web_edits = sum(mobile_web_edits, na.rm = TRUE),
                 amc_edits = sum(amc_edits, na.rm = TRUE)) %>%
        mutate(prop = amc_edits/mobile_web_edits *100)

amc_edits_prop_overall_byeditcount_Sept
A tibble: 3 × 4
user_edit_countmobile_web_editsamc_editsprop
<chr><dbl><dbl><dbl>
100-499 84715 2364227.907690
500+ 29888811769539.377626
under 100198679 7760 3.905798

We are also seeing the highest proportion of AMC mobile web edits completed by high volume editors and the lowest proportion by low volume editors. From August 7, 2019 (deployment date on all wikis) to the end of September 2019, 39.43% of all logged-in mobile web edits by high volume editors (500+) were made while in AMC.

Mobile web edit rate for English Wikipedia

In [2008]:
##Plot of mobile web edits for enwiki.

p <- mobile_web_edit_counts_clean %>%
     filter(edit_type == 'mobile_web_edits',
           wiki == 'enwiki')%>%
     mutate(date = floor_date(date, "month")) %>%
    group_by(date, wiki)%>%
    summarise(monthly_edits = sum(edit_count)) %>%
    ggplot(aes(x=date, y = monthly_edits)) + 
    geom_line(size = 1.5, color = "blue") +
    geom_vline(xintercept = as.numeric(as.Date(c("2019-08-07"))),
             linetype = "dashed", color = "black") +
  geom_text(aes(x=as.Date('2019-08-08'), y=4.6E5, label="AMC deployed on all Wikipedias"), size=3.7, vjust = -1.2, angle = 90, color = "black") +
    scale_y_continuous("Number of edits per month", labels = polloi::compress) +
    scale_x_date("Date", labels = date_format("%b %Y"), date_breaks = "2 months", limits = c()) +
    labs(title = "Mobile web edits on English Wikipedia") +
    ggthemes::theme_tufte(base_size = 10, base_family = "Gill Sans") +
    theme(axis.text.x=element_text(angle = 45, hjust = 1),
        plot.title = element_text(hjust = 0.5),
        panel.grid = element_line("gray70"),
        legend.position= "bottom",
        legend.text=element_text(size = 12))

p

ggsave("Figures/mobile_web_edits_enwiki.png", p, width = 18, height = 9, units = "in", dpi = 150)

Proportion of mobile web edits tagged with AMC on English Wikipedia

Since deployment through September 2019

In [596]:
#Overall Proportion of mobile web edits tagged with AMC on English Wikipedia since deployment

amc_edits_prop_enwiki <- mobile_web_edit_counts %>%
    filter(date >= "2019-08-07", #deployment date across all wikis
          wiki == 'enwiki',
          user_edit_count != 'undefined') %>% 
        summarise(mobile_web_edits = sum(mobile_web_edits),
                 amc_edits = sum(amc_edits)) %>%
        mutate(prop = amc_edits/mobile_web_edits *100)

amc_edits_prop_enwiki
A data.frame: 1 × 3
mobile_web_editsamc_editsprop
<dbl><dbl><dbl>
4232246859416.20749

Per month since deployment

In [1763]:
amc_edits_prop_enwiki_permonth <- mobile_web_edit_counts %>%
    filter(date >= "2019-08-01" ,#deployment date across all wikis
          wiki == 'enwiki',
          user_edit_count != 'undefined') %>% 
    mutate(date = floor_date(date, "month")) %>%
      group_by(date) %>%
        summarise(mobile_web_edits = sum(mobile_web_edits, na.rm = TRUE),
                 amc_edits = sum(amc_edits, na.rm = TRUE)) %>%
         mutate(prop = amc_edits/mobile_web_edits *100)

amc_edits_prop_enwiki_permonth
A tibble: 2 × 4
datemobile_web_editsamc_editsprop
<date><dbl><dbl><dbl>
2019-08-0124721611701 4.733108
2019-09-012218405689325.645961
In [2009]:
p <- mobile_web_edit_counts_clean %>%
  filter(date >= '2019-08-07',
         date <= '2019-09-28', #remove last week due to incomplete data
        edit_type != 'mobile_web_edits',
         wiki == 'enwiki',
         user_edit_count != 'undefined') %>%
 mutate(date = floor_date(date, "week")) %>%
  filter(date != '2019-08-04') %>% #remove incomplete week
  group_by(date, edit_type) %>%
  summarise(total_mobile_edits = sum(edit_count, na.rm = TRUE)) %>%
  ggplot(aes(x= date, y= total_mobile_edits, fill = edit_type)) +
  geom_col() + 
 geom_vline(xintercept = as.Date('2019-08-07'),
             linetype = "dashed", color = "black") +
   geom_text(aes(x=as.Date('2019-08-07'), y=6E3, label="AMC deployed on all Wikipedias"), size=4, vjust = -1.2, angle = 90, color = "black") +
    scale_y_continuous("Number of edits per week", labels = polloi::compress) +
    scale_x_date("Date", labels = date_format("%b %d %Y"), date_breaks = "2 weeks") +
    labs(title = "Mobile web edits on English Wikipedia by edit mode") +
     ggthemes::theme_tufte(base_size = 14, base_family = "Gill Sans") +
     theme(axis.text.x=element_text(angle = 45, hjust = 1),
        panel.grid = element_line("gray70"),
        legend.position="bottom",
        legend.title=element_blank(),
        legend.text=element_text(size=14))

p
ggsave("Figures/mobile_web_edits_enwiki_amc_prop.png", p, width = 18, height = 9, units = "in", dpi = 150)

AMC edits account for about 16.2% of all mobile web edits made on English Wikipedia by logged-in users since deployment on August 8, 2019. The proportion of mobile web edits made while in AMC mode increased from about 4.7% the first month of deployment to 25.6% of mobile web edits from logged-in users in September.

In [2011]:
# Plot of overall mobile web edit rate by user edit count

p <- mobile_web_edit_counts_clean %>%
    filter(edit_type == 'mobile_web_edits',
           wiki == 'enwiki',
          user_edit_count != 'undefined') %>% ### remove undefined user edit counts
    mutate(date = floor_date(date, "month")) %>%
    group_by(date, user_edit_count) %>%
    summarise(total_mobile_edits = sum(edit_count, na.rm = TRUE))%>%
    ggplot(aes(x=date, y = total_mobile_edits, color = user_edit_count, linetype = user_edit_count)) + 
    geom_line(size = 1.5)+
    scale_y_continuous("Number of edits per month", labels = polloi::compress) +
    scale_x_date("Date", labels = date_format("%b %Y"), date_breaks = "2 months", limits = c()) +
    labs(title = "Mobile web edits by user edit count on English Wikipedia") +
geom_vline(xintercept = as.numeric(as.Date(c("2019-08-08"))),
             linetype = "dashed", color = "black") +
  geom_text(aes(x=as.Date('2019-08-08'), y=7E4, label="AMC deployed on all Wikipedias"), size=3.7, vjust = -1.2, angle = 90, color = "black") +
    ggthemes::theme_tufte(base_size = 12, base_family = "Gill Sans") +
    theme(axis.text.x=element_text(angle = 45, hjust = 1),
        plot.title = element_text(hjust = 0.5),
        panel.grid = element_line("gray70"),
        legend.position="bottom")

ggsave("Figures/mobile_web_edits_enwiki_byeditcount.png", p , width = 18, height = 9, units = "in", dpi = 150)

p

Proportion of mobile web edits tagged with AMC on English Wikipedia by editor experience

Since deployment through September 2019

In [1782]:
amc_edits_prop_enwiki_byeditcount <- mobile_web_edit_counts %>%
    filter(date >= "2019-08-07", #deployment date across all wikis
          wiki == 'enwiki',
          user_edit_count != 'undefined') %>% 
         group_by(user_edit_count) %>% 
        summarise(mobile_web_edits = sum(mobile_web_edits),
                 amc_edits = sum(amc_edits)) %>%
        mutate(prop = amc_edits/mobile_web_edits *100)

amc_edits_prop_enwiki_byeditcount
A tibble: 3 × 4
user_edit_countmobile_web_editsamc_editsprop
<chr><dbl><dbl><dbl>
100-499 631261187618.813167
500+ 2090135207524.914718
under 100151085 4643 3.073105

Similar to the trends seen across all Wikipedia projects, the highest proportion of AMC edits are made by high volume editors on English Wikipedia. From August 7, 2019 (deployment date on all wikis) to the end of September 2019, 24.9% of all logged-in mobile web edits by high volume editors (500+) were made while in AMC.

Mobile web edit rate on target wikis

In [2013]:
##Plot of mobile web edits by target wiki.

p <- mobile_web_edit_counts_clean %>%
     filter(edit_type == 'mobile_web_edits',
           wiki %in% c('eswiki', 'arwiki', 'idwiki', 'itwiki', 'jawiki', 'fawiki', 'thwiki'))%>%
     mutate(date = floor_date(date, "month")) %>%
    group_by(date, wiki)%>%
    summarise(monthly_edits = sum(edit_count)) %>%
    ggplot(aes(x=date, y = monthly_edits, color = wiki)) + 
    geom_line(size = 1.5) +
    geom_vline(xintercept = vertical_lines,
             linetype = "dashed", color = "black") +
  geom_text(aes(x=as.Date('2019-03-20'), y=6E4, label="AMC deployed on Arabic, Indonesian, and Spanish Wikipedias"), size=3.7, vjust = -1.2, angle = 90, color = "black") +
  geom_text(aes(x=as.Date('2019-06-17'), y=6E4, label="AMC deployed on Italian, Japanese, Persian, and Thai Wikipedias"), size=3.7, vjust = -1.2, angle = 90, color = "black") +
   geom_text(aes(x=as.Date('2019-08-07'), y=6E4, label="AMC deployed on all Wikipedias"), size=3.7, vjust = -1.2, angle = 90, color = "black") +
    scale_y_continuous("Number of edits per month", labels = polloi::compress) +
    scale_x_date("Date", labels = date_format("%b %Y"), date_breaks = "2 months", limits = c()) +
    labs(title = "Monthly mobile web edits on target Wikipedia projects ") +
    ggthemes::theme_tufte(base_size = 10, base_family = "Gill Sans") +
    theme(axis.text.x=element_text(angle = 45, hjust = 1),
        plot.title = element_text(hjust = 0.5),
        panel.grid = element_line("gray70"),
        legend.position= "bottom",
        legend.text=element_text(size = 12))

p

ggsave("Figures/mobile_web_edits_bytargetwiki.png", p, width = 18, height = 9, units = "in", dpi = 150)
In [1831]:
##Calculate YOY change for target wikis 
#Arwiki
mobile_web_edit_arwiki <- mobile_web_edit_counts_clean %>%
    filter(wiki == 'arwiki',
          edit_type == 'mobile_web_edits') %>%
    mutate(date = floor_date(date, "month")) %>%
  group_by(date) %>%
  summarise(total_mobile_edits = sum(edit_count)) %>%
  arrange(date) %>%
mutate(yearOverYear= (total_mobile_edits/lag(total_mobile_edits,12) -1)*100)


#EsWiki
mobile_web_edit_eswiki <- mobile_web_edit_counts_clean %>%
    filter(wiki == 'eswiki',
          edit_type == 'mobile_web_edits') %>%
    mutate(date = floor_date(date, "month")) %>%
  group_by(date) %>%
  summarise(total_mobile_edits = sum(edit_count)) %>%
  arrange(date) %>%
mutate(yearOverYear= (total_mobile_edits/lag(total_mobile_edits,12) -1)*100)


#idwiki
mobile_web_edit_idwiki <- mobile_web_edit_counts_clean %>%
    filter(wiki == 'idwiki',
          edit_type == 'mobile_web_edits') %>%
    mutate(date = floor_date(date, "month")) %>%
  group_by(date) %>%
  summarise(total_mobile_edits = sum(edit_count)) %>%
  arrange(date) %>%
mutate(yearOverYear= (total_mobile_edits/lag(total_mobile_edits,12) -1)*100)


#itwiki
mobile_web_edit_itwiki <- mobile_web_edit_counts_clean %>%
    filter(wiki == 'itwiki',
          edit_type == 'mobile_web_edits') %>%
    mutate(date = floor_date(date, "month")) %>%
  group_by(date) %>%
  summarise(total_mobile_edits = sum(edit_count)) %>%
  arrange(date) %>%
mutate(yearOverYear= (total_mobile_edits/lag(total_mobile_edits,12) -1)*100)


#jawiki
mobile_web_edit_jawiki <- mobile_web_edit_counts_clean %>%
    filter(wiki == 'jawiki',
          edit_type == 'mobile_web_edits') %>%
    mutate(date = floor_date(date, "month")) %>%
  group_by(date) %>%
  summarise(total_mobile_edits = sum(edit_count)) %>%
  arrange(date) %>%
mutate(yearOverYear= (total_mobile_edits/lag(total_mobile_edits,12) -1)*100)


#fawiki
mobile_web_edit_fawiki <- mobile_web_edit_counts_clean %>%
    filter(wiki == 'fawiki',
          edit_type == 'mobile_web_edits') %>%
    mutate(date = floor_date(date, "month")) %>%
  group_by(date) %>%
  summarise(total_mobile_edits = sum(edit_count)) %>%
  arrange(date) %>%
mutate(yearOverYear= (total_mobile_edits/lag(total_mobile_edits,12) -1)*100)

#thwiki
mobile_web_edit_thwiki <- mobile_web_edit_counts_clean %>%
    filter(wiki == 'thwiki',
          edit_type == 'mobile_web_edits') %>%
    mutate(date = floor_date(date, "month")) %>%
  group_by(date) %>%
  summarise(total_mobile_edits = sum(edit_count)) %>%
  arrange(date) %>%
mutate(yearOverYear= (total_mobile_edits/lag(total_mobile_edits,12) -1)*100)
In [1833]:
# Create YoY Table
wiki_list <- c('arwiki', 'eswiki', 'idwiki', 'itwiki', 'jawiki', 'fawiki', 'thwiki')
mobile_web_edit_yoy <- rbind(mobile_web_edit_arwiki[16,], mobile_web_edit_eswiki[16,],
                            mobile_web_edit_idwiki[16,], mobile_web_edit_itwiki[16,],
                            mobile_web_edit_jawiki[16,], mobile_web_edit_fawiki[16,], mobile_web_edit_thwiki[13,])

mobile_web_edit_yoy
A tibble: 7 × 3
datetotal_mobile_editsyearOverYear
<date><dbl><dbl>
2019-09-01 22123 1.332906
2019-09-01114102 1.370837
2019-09-01 1957470.520080
2019-09-01 7112433.571214
2019-09-01 7721348.372406
2019-09-01 3292755.389335
2019-06-01 1379529.676631

Similar to overall trends, there was a steady increase in total mobile web edits the past 15 months for the all of the target Wikipedia projects.

The table below shows a comparison of year over year rates seen in June 2019 and September 2019 for all of the target wikis. In September 2019, there was a year over year increase for all target wikis ranging from 1.3% on Arabic Wikipedia to 70.5% on Indonesia Wikipedia.

As noted, these increases has been occuring prior to the deployment of AMC on target wikis and cannot be attributed to the deployment of AMC alone. Part of these changes are partly due to a sustained increase in overall active editors seen on these wikis.

Year over year changes in mobile web edit rates on target wikis

Wiki June 2019 September 2019
Arabic Wiki -7.4% 1.3%
Spanish Wiki 16.7% 1.4%
Indonesian Wiki 22.1% 70.5%
Italian Wiki 27.1% 33.6%
Japanese Wiki 37.9% 48.4%
Persian Wiki 57.9% 55.4%
Thai Wiki 23.3% 29.7%

Proportion of mobile web edits tagged with AMC on target wikis

Arabic, Spanish and Indonesian Target Wikis (Since March deployment through end of September 2019)

In [277]:
amc_edits_prop_target <- mobile_web_edit_counts %>%
    filter(date >= "2019-03-20", #deployment date
          wiki %in% c('arwiki', 'idwiki', 'eswiki'),
          user_edit_count != 'undefined') %>% 
        group_by(wiki) %>%
        summarise(mobile_web_edits = sum(mobile_web_edits),
                 amc_edits = sum(amc_edits)) %>% 
  mutate(prop = amc_edits/mobile_web_edits *100)

amc_edits_prop_target
A tibble: 3 × 4
wikimobile_web_editsamc_editsprop
<chr><dbl><dbl><dbl>
arwiki 977001337513.689867
eswiki25549922791 8.920191
idwiki 76099 6731 8.845057
In [2014]:
p <- mobile_web_edit_counts_clean %>%
  filter(date >= '2019-03-30',
         date <= '2019-09-28', #remove last week due to incomplete data
        edit_type != 'mobile_web_edits',
         wiki %in% c('arwiki', 'idwiki', 'eswiki'),
         user_edit_count != 'undefined') %>%
mutate(date = floor_date(date, "week")) %>%
  group_by(date, wiki, edit_type) %>%
  summarise(total_mobile_edits = sum(edit_count, na.rm = TRUE)) %>%
  ggplot(aes(x= date, y= total_mobile_edits, fill = edit_type)) +
  geom_col() + 
  facet_wrap(~ wiki, nrow = 3, scale = "free_y") +
    scale_y_continuous("Number of edits per week", labels = polloi::compress) +
    scale_x_date("Date", labels = date_format("%b %d %Y"), date_breaks = "2 weeks") +
    labs(title = "Mobile web edits on target wikipedias",
         subtitle = "Where AMC deployed on March 20, 2019") +
     ggthemes::theme_tufte(base_size = 14, base_family = "Gill Sans") +
     theme(axis.text.x=element_text(angle = 45, hjust = 1),
        panel.grid = element_line("gray70"),
        legend.position="bottom",
        legend.title=element_blank(),
        legend.text=element_text(size=14))

amc_edits_prop_targetwiki_stacked_chart_March
ggsave("Figures/mobile_web_edits_March-target_amc_prop.png", p, width = 18, height = 9, units = "in", dpi = 150)