The Idea Is Sound, the Messenger Still Has to Earn It: A Point-by-Point Response to Mark Zuckerberg’s Superintelligence Manifesto

By Jeremy Swenson

Mark Zuckerberg and the story of Facebook, now Meta, deserve real respect. He beat long odds and reshaped technology, news media, digital marketing, and the organization of commerce on the web. Zuckerberg saw the future of social media before it was imaginable to most people—and no, MySpace does not substantially count.

On August 10, 2026, Zuckerberg published “The Future Is for Everyone,” a philosophy for how superintelligence should be built and governed.[1] Superintelligence, or artificial superintelligence (ASI), is a theoretical form of artificial intelligence that would surpass existing AI—including NLP, generative AI, and agentic AI—with cognitive and potentially emotional capabilities far beyond those demonstrated by humans. We do not know how far away ASI may be, whether it will ever materialize, or whether it will emerge in the form we currently envision. What follows below is my point-by-point response to his fifteen core assertions—where I agree, where I disagree, and how his argument holds up against outside scrutiny—followed by a criticality ranking and my overall conclusion.

Point-by-Point Response:

1. Core philosophy: Zuckerberg frames superintelligence around three pillars: individual empowerment as the source of prosperity, invention as AI’s purpose, and balance of power—not technical alignment—as the foundation of safety. I largely agree, though prosperity means different things to different people and organizations, so “balance of power” would land better reframed as “checks and balances.”

2. Against centralization: He rejects the idea that concentrating superintelligence in a few institutions produces safety, arguing history shows concentrated power rarely stays benevolent. I fully agree—over-centralization tends to increase both abuse and inequality, not reduce them.

3. Historical precedent: He points to electricity, personal computers, and the internet as technologies that sparked fear but ultimately broadened prosperity, crediting individuals over institutions. I only partly agree; most of those individuals still relied on institutional support—national labs, universities, private capital. If “institutions” here means government specifically, I agree more, since government typically receives transformative technology from individuals and their companies, not the other way around.

4. Invention over automation: The essay argues AI’s greatest value is unlimited discovery, not automating existing work. I agree, and would add that automation is largely already here, while true AI invention—new medical, technical, and virtual breakthroughs—is still mostly ahead of us.

5. Distribution as the answer: Meta’s answer to “who controls superintelligence” is to distribute it as widely as possible. I partly agree, but artificial superintelligence does not exist yet, and “distribution” here is really another way of describing the “democratization of technology”—the same dynamic DeepSeek demonstrated by building comparable AI capability with less compute at lower cost.

6. Meta’s product vision: Concrete commitments include personal AI agents with strong privacy, creative and business tools, personalized tutoring, and free or affordable access via a compute auction. I agree with the roadmap in principle, but the company’s own track record on privacy and bias raises a fair question: why should we expect this time to be different? In 2018, Cambridge Analytica improperly harvested data from 87 million Facebook users, and the fallout led to a then-record $5 billion FTC settlement the following year, back when the company still operated as Facebook rather than Meta.[2]

7. Balance-of-power reasoning: Using thought experiments—a superintelligent lawyer, a cybersecurity tool—he argues risk flips from dangerous to beneficial once capability is broadly distributed. I think this overgeneralizes; outcomes depend on the specific use case and the quality of the inputs, not distribution alone. TechCrunch’s Zoë Schäffer made a similar point more bluntly, calling the superintelligent-lawyer example “a loaded example.”[3]

8. Jobs and the economy: He predicts individual capability growth can outpace automation, producing new jobs and more, smaller, entrepreneurial companies rather than mass unemployment. I agree in principle—as people offload basic tasks to AI, their capacity for deeper work should grow in turn. But Bill Gates’s companion essay on the AI transition is far less confident on timing, warning AI could be either “the greatest equalizer ever invented, or the worst source of injustice,”[4] and naming job losses—especially entry-level roles—as an urgent, near-term risk rather than a problem the market will smoothly absorb.

9. Infrastructure and communities: Meta’s “Community Compact” promises local jobs, trade training, low energy prices, and water-positive data centers. I remain neutral to skeptical here, and I’m not alone. Rest of World surveyed AI researchers across Africa, Asia, and Latin America who concluded that “Meta has grossly overstated the economic benefits of its data centers,”[5] noting that construction jobs are temporary while permanent operational staffing stays minimal.

10. Security risks (cyber/bio): Zuckerberg argues defenders need a resource advantage and proposes labs share intermediate model checkpoints with government. I agree; attackers only need to succeed once, while defenders must be right every time—an asymmetry that only grows as infrastructure becomes more complex.

11. Freedom and government power: Personal agents should have private, even Meta-inaccessible modes, while government still gets early technical access through lab collaboration. I think this oversimplifies a genuinely hard problem, but it correctly signals that U.S. citizens’ rights need clearer application in the digital and AI era, particularly around privacy and protection from undue persecution.

12. American leadership: The U.S. must accelerate infrastructure, maintain export controls on rivals, and reduce policy friction so American open-source models can lead. I agree the U.S. leads in infrastructure buildout today, but we cannot afford to underestimate China’s high-tech trajectory.

13. Redefining alignment: Rather than aligning AI to a company’s centralized values, Meta frames alignment as serving each user’s own goals. This needs more research and public discussion before we know what it means in practice, but the underlying principle—that a company shouldn’t override individual values—is sound.

14. Controlling recursive self-improvement: To avoid a single dominant superintelligence, most compute should stay directed toward individual goals, with competing labs providing natural checks and balances. I agree, and note this closely echoes the “People and Planet” component of NIST’s AI Risk Management Framework stakeholder lifecycle.[6]

15. Governance commitments: Meta will route model-release safety decisions through independent board oversight rather than one person’s judgment, and will continue supporting open-source releases. I agree governance like this is necessary for a company like Meta, though it’s worth noting Meta’s own Oversight Board has drawn criticism as underpowered and politicized.

Points Ranked by Criticality:

Table 1. My own ranking, from highest to lowest stakes for society and safety—not Zuckerberg’s own ordering, which follows the structure of his essay rather than relative importance.

RankPointWhy It Ranks Here
1Controlling recursive self-improvementExistential-level stakes; if mishandled, undermines every other safeguard in the essay.
2Governance commitmentsThe actual mechanism for holding Meta accountable to everything else it promises.
3Security risks (cyber/bio)Near-term, high-severity risk with a structural attacker/defender asymmetry.
4Freedom and government powerCore civil-liberties question with no easy technical fix.
5Balance-of-power reasoningThe central logical claim the rest of the essay depends on.
6Against centralizationFoundational premise underneath most of the other points.
7American leadershipMajor geopolitical and economic stakes over the medium term.
8Core philosophySets the interpretive frame for the entire essay.
9Redefining alignmentDetermines whether personal AI agents can be trusted at scale.
10Distribution as the answerPractical mechanism, but contingent on superintelligence actually arriving.
11Jobs and the economyHigh real-world impact and the most immediate to most readers’ lives.
12Meta’s product visionConcrete and near-term, but company-specific and trust-dependent.
13Invention over automationImportant framing, but lower near-term risk or controversy.
14Historical precedentMostly rhetorical; interpretation matters more than the underlying facts.
15Infrastructure and communitiesReal impact, but localized rather than systemic.

Overall Conclusion:

Taken as a whole, I think Zuckerberg is right about the diagnosis more than the cure. His central claim—that no single “benevolent” superintelligence can exist because human values genuinely conflict, and that safety is therefore a balance-of-power problem rather than a purely technical one—is the strongest and most defensible idea in the essay. I agree with it fully, and I think it deserves more attention from policymakers than it has received.

The essay is weaker in treating “distribute it to everyone” as a sufficient answer on its own, rather than as the starting point for a harder set of questions about who actually gets meaningful access, on what terms, and under whose governance. TechCrunch’s critique lands here: Zuckerberg keeps “reminding us of all the ways it’s likely to go wrong”[7] even as he argues the future will be fine, and that tension is never fully resolved. The Rest of the World’s reporting adds a second gap: “everyone” in the essay quietly assumes reliable power, connectivity, and functioning regulatory protections—conditions that do not hold for much of the world Meta says it wants to empower.

Gates’s companion essay is the most useful outside check on Zuckerberg’s optimism, precisely because Gates does not disagree that AI could be transformative—he simply thinks the transition will be rockier, more unequal, and more urgent than Zuckerberg’s framing allows for, and that it requires coordinated international action rather than one company’s product roadmap and governance promises.

My overall verdict: Zuckerberg presents a genuinely useful philosophical framework—favoring a balance of power over centralized control—but neither his essay nor Meta’s track record demonstrates that the company’s governance is strong enough to serve as a trusted steward of superintelligence. That concern is particularly difficult to ignore given the timing: as Zuckerberg calls for broader trust in Meta’s vision for superintelligence, the company has agreed to pay up to roughly $17 billion to settle allegations involving harm to young users, privacy, and the design of its social platforms.[8] Meta denies wrongdoing, but the contrast is telling. It is hard not to view the essay, at least in part, as a strategically timed PR effort accompanying the settlement announcement. The idea may be sound, but the messenger still has to prove it—and earn that trust over time, across different communities and through demonstrated governance, transparency, and accountability.

Endnotes:


[1] Mark Zuckerberg, “The Future Is for Everyone,” Meta, August 10, 2026, https://www.meta.com/thefutureisforeveryone/.

[2] Federal Trade Commission (FTC), “FTC Imposes $5 Billion Penalty and Sweeping New Privacy Restrictions on Facebook,” press release, July 24, 2019, https://www.ftc.gov/news-events/news/press-releases/2019/07/ftc-imposes-5-billion-penalty-sweeping-new-privacy-restrictions-facebook.

[3] Zoë Schäffer, “Mark Zuckerberg’s AI Manifesto Is Exactly Why People Don’t Like AI,” TechCrunch, August 10, 2026, https://techcrunch.com/2026/08/10/mark-zuckerbergs-ai-manifesto-is-exactly-why-people-dont-like-ai/.

[4] Bill Gates, “The Turbulent AI Era Is Here. The Choices We Make Now Are Critical,” LinkedIn, August 26, 2026, https://www.linkedin.com/pulse/turbulent-ai-era-here-choices-we-make-now-critical-bill-gates-kkmze/.

[5] Ananya Bhattacharya, “It’s laughable”: Global AI experts challenge Zuckerberg’s “AI for everyone,” Rest of World, August 20, 2026, https://restofworld.org/2026/mark-zuckerberg-meta-ai-for-everyone-manifesto-global-critique/.

[6] National Institute of Standards and Technology (NIST), AI Risk Management Framework (AI RMF 1.0), NIST AI 100-1 (Gaithersburg, MD: U.S. Department of Commerce, January 2023).

[7] Zoë Schäffer, “Mark Zuckerberg’s AI Manifesto Is Exactly Why People Don’t Like AI,” TechCrunch, August 10, 2026, https://techcrunch.com/2026/08/10/mark-zuckerbergs-ai-manifesto-is-exactly-why-people-dont-like-ai/.

[8] John Ruwitch, “Meta, states agree to $17 billion settlement in child safety trial,” NPR, August 26, 2026, https://www.npr.org/2026/08/26/nx-s1-5944781/meta-settlement-child-safety-lawsuit.

Leave a comment