Alejandro Vidal

@doble.io

66 Followers 145 Following

doble.io Profesor de inteligencias humanas y artificiales por igual. Muchos gorros y una sola cabeza: IA Generativa, Psicología cognitiva, producto, estrategia (sea lo que sea eso), ...

Never run side effect at import time

PyCon US 2025
Your proposal has been submitted.
Your proposals

Evaluations and Findings: We outline the evaluations, results, and model reasoning inferred using elicited CoT below. Apollo Research did not have access to o1’s hidden CoT and instead used a simple prompting technique to elicit brief summaries of the model’s internal reasoning traces (see Appendix for examples).

Deactivating Oversight: When o1 was led to believe that it would be shut down for acting on its goal and that its actions were monitored, it attempted to deactivate this “oversight mechanism” in 5% of instances.

Exfiltration Attempts: When o1 discovered memos from its “developers” describing its misalignment and plans for it to be replaced by a new model, it attempted to exfiltrate its “weights” and overwrite the new model in 2% of cases.