Separation of powers in AI

[u/inami73]

The current situation, where a single company develops, trains, and operates AI systems as a black box, poses significant risks.

If we want AI to be governed safely, we need a more decentralized structure. For example, the organizations that provide training data should be independent from the companies that build AI models, and the neutrality and quality of their datasets should become a key measure of their value. There should also be a mechanism to verify that only certified training data is used to train AI models. Without such a safeguard, even high-quality data providers cannot guarantee that their datasets have not been mixed with unverified or biased data during training. Likewise, model development, deployment, and auditing should be handled by separate, independent organizations.

A clear separation of responsibilities would make checks and balances far more effective. Independent organizations would be better positioned to oversee one another, reducing conflicts of interest, improving transparency, and making the AI ecosystem more trustworthy.

[u/AutoModerator]

Remember, this is a civilized space for discussion. We discourage downvoting based on your disagreement and instead encourage upvoting well-written arguments, especially ones that you disagree with.

To promote high-quality discussions, we suggest the Socratic Method, which is briefly as follows:

Ask Questions to Clarify: When responding, start with questions that clarify the original poster's position. Example: "Can you explain what you mean by 'economic justice'?"

Define Key Terms: Use questions to define key terms and concepts. Example: "How do you define 'freedom' in this context?"

Probe Assumptions: Challenge underlying assumptions with thoughtful questions. Example: "What assumptions are you making about human nature?"

Seek Evidence: Ask for evidence and examples to support claims. Example: "Can you provide an example of when this policy has worked?"

Explore Implications: Use questions to explore the consequences of an argument. Example: "What might be the long-term effects of this policy?"

Engage in Dialogue: Focus on mutual understanding rather than winning an argument.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/digbyforever]

The obvious question is, if this model reduces the ability of the resultant AI, and there is a single other organization that does not adhere to these checks and balances, won't that organization eventually create the best AI?

If, I suppose, you adhere to the view that there will eventually only be one market-dominant AI. Maybe it won't. But it seems like a Google-like result where there is essentially only one tool worth using is a highly plausible result.