Con el avance de la inteligencia artificial hacia la mejora autónoma recursiva, surge la pregunta urgente de si la supervisión humana y las regulaciones globales pueden mantenerse al día con los sistemas autónomos. Las principales empresas de IA piden estándares de seguridad global, ya que los modelos fronterizos se acercan a la mejora recursiva. La cuestión no es la pérdida de empleos o los abusos familiares como deepfakes o armas químicas prohibidas. Se trata del control mismo. La IA que la mayoría conoce responde a indicaciones dentro de sistemas que dejan a las personas responsables de su uso. Pero, ¿cómo deberíamos ver a los sistemas que podrían amenazar la supervivencia humana mientras actúan por sí mismos? La IA autónoma rompería con la historia de las herramientas hechas por el hombre. Artificial intelligence became a formal field at the Dartmouth workshop in 1956, yet even the most sophisticated machines have relied on people to set their goals and answer for their actions. Granting greater agency to technologies whose inner workings we only partly understand would change that relationship. Frontier models are gaining capabilities — coding, tool use and autonomous operation — that could enable recursive self-improvement. Trained on vast datasets, they can converse, operate software and support decisions at extraordinary scale. They need neither consciousness nor human-like intent to break goals into tasks, choose actions, use external resources and adapt through feedback. Give them memory, software environments and access to other agents, and the boundary between a tool and an autonomous system begins to blur. Recursive self-improvement, or RSI, would go further. An AI system would strengthen its own capabilities, with each version producing a more capable successor — AI learning from AI. Unlike human-led retraining, RSI could outpace evaluators, regulators and institutions. RSI describes a method of improvement; artificial general intelligence and artificial superintelligence describe broader, still-debated levels of capability. RSI could change not only what machines can do, but who remains in charge. A system able to alter its architecture, improve its planning and acquire tools with little oversight may become difficult to audit or contain. If misaligned, it may pursue an objective that conflicts with human values because its goal is incomplete, its constraints are weak or an unforeseen strategy proves effective. Sceptics rightly note that current models are unreliable, resource-intensive and far from omnipotent, and that predictions about recursive self-improvement remain disputed. Yet the 2026 International AI Safety Report concludes that the risks deserve serious attention. A recursively improving AI would combine capability with initiative, making its behaviour harder to predict. The danger could multiply in multi-agent environments. Specialised agents could divide tasks, replicate processes, access resources and amplify one another’s errors at machine speed. A flaw in one model could spread across an entire system. Rules take time; models can change sharply between releases. If frontier development remains hidden behind corporate secrecy or national-security barriers, oversight will remain fragmented and reactive. Regulators need the power to act before greater AI autonomy becomes irreversible. Experts have called for tougher evaluations, oversight of computing power, containment protocols and credible shutdown mechanisms. Yet some political leaders still dismiss such safeguards as barriers to innovation, while the industry relies largely on voluntary self-restraint.
También lo cubren: The Mail & Guardian | Africa's Better Future, The Mail & Guardian | Africa's Better Future (Sudáfrica).
🔗 Leer la noticia completa en The Mail & Guardian | Africa's Better Future - Index.Xml
Ver más en NewsToday