An online paper - AI 2027    

links added

 

  1. We predict that the impact of superhuman AI over the next decade will be enormous, exceeding that of the Industrial Revolution.
  2. A common technique “bakes in” a persona: first, prompt the pretrained model with something like “The following is a conversation between a human user and a helpful, honest, and harmless AI chatbot produced by Anthropic.
  3. The chatbot has the following traits…” Use this prompt to generate a bunch of data. Then, train on the data but without the prompt. The result is an AI that always acts as if it had that prompt in front of it, regardless of what else you feed it.
  4. See also this paper which found that AIs retrained to exhibit a certain personality trait are able to correctly answer questions about that new trait, despite no training to do so, suggesting that they have internal representations of their own traits and that when their traits change their representations change accordingly.
  5. Current language models are considered to have sub-human capabilities at natural language
    tasks like question-answering or writing code.  Involves Next token prediction.   more
  6. AI Chat: Multiple AI  Models, One Powerful Platform try