Tech

Meta oversight board flags due process gaps in social media account bans

A recent pilot case involving a banned Instagram account has prompted Meta’s Oversight Board to call for clearer appeals processes and greater transparency in how the company disables user accounts.

Author
Owen Mercer
Markets and Finance Editor
Published
Draft
Source: Engadget · original
Even Meta's Oversight Board thinks its rules for banning accounts are baffling
Independent review body highlights opaque rules and lack of human oversight in automated penalties

Meta’s Oversight Board has raised significant due process concerns regarding the opacity and inconsistency of account disabling rules on Facebook and Instagram. The review was triggered by a referral concerning the ban of an Instagram account with 70,000 followers for threatening posts targeting a journalist. While the Board confirmed the ban was justified, it described the current penalty system as a "confusing patchwork" that lacks transparency and sufficient human oversight.

The Board noted strikingly different processes for the two platforms. On Facebook, accounts may receive temporary suspensions for repeated violations before an outright ban. In contrast, Instagram relies on restrictions such as removing accounts from recommendations, a practice known as a "shadowban," or restricting access to livestreaming. The Board highlighted that restricting livestreaming is an "intermediate" penalty, despite the feature requiring a minimum of 1,000 followers, making it inaccessible to many users.

Public feedback on the case was substantial, with the Board receiving more than 750 comments and "innumerable" complaints from individual board members. Common grievances included systems failing to work, an inability to appeal disabling decisions, a lack of explanation for why accounts were disabled, and the inability to download content. Users also noted that many decisions appeared to be made automatically without human review, even for longstanding accounts.

In its analysis, the Board suggested several improvements to address these issues. These include establishing a better appeals process that allows users to provide written explanations, notifying users when artificial intelligence is used to penalise their account, and including ban data in Meta’s transparency reports. The Board also advised Meta to create a dedicated channel for high-risk targets of violence and their representatives to report serious threats.

Despite the critique, the Board described the case as a "pilot" or "test case," meaning it is not making formal recommendations to Meta at this stage. It remains unclear whether the company plans to implement substantial policy changes in response. However, the Board indicated it plans to accept more cases dealing with account disabling in the future to influence reforms.

Over the last five years, Meta’s Oversight Board has reviewed high-profile cases, including the suspension of Donald Trump and issues surrounding AI deepfakes. The independent body was established to provide oversight of the social media giant’s content moderation decisions, addressing long-simmering frustration among users regarding opaque processes.

Continue reading

More from Tech

Read next: Apple opens developer access to iOS, iPadOS and macOS 27 betas
Read next: Apple confirms macOS 27 Golden Gate requires Apple Silicon, ending Intel support
Read next: Apple unveils watchOS 27 with Siri AI integration and hardware restrictions