What is intelligent life?
Massive effort is currently directed towards trying to understand intelligence, and build vastly more of it, under the umbrella of artificial intelligence (AI) programs.
Massive effort is currently directed towards trying to understand intelligence, and build vastly more of it, under the umbrella of artificial intelligence (AI) programs.
Here we go again. Chatbot fails are now a familiar meme. The tendency to make things up is holding chatbots back. But that’s just what they do.
“Aidan and I also talked a lot about what AI can and can’t do. We agreed that it’s definitely not “there” yet. It’s not ready, whatever you think the future might hold.”
The simple fact of the matter is that interacting with the most significant technology of our time—language models like GPT-4 and Gemini—is far closer to interacting with a human, compared to how we have historically interacted with machines.
“The slightly bold theory I put forward in this talk is that we’re on a verge of a golden age of local, home-cooked software and a new kind of developer – what I’ve called the barefoot developer.”
What kind of a company creates fake authors for a famous newspaper or magazine and operates them like sock puppets? Did AdVon have other clients? And was it being truthful that the reviews had been created by humans rather than AI?
How can these powerful systems beat us in chess but falter on basic math? This paradox reflects more than just an idiosyncratic design quirk. It points toward something fundamental about how large language models think.
OpenAI has made no commitment to make any “democratic inputs” binding upon its own decision-making processes. In fairness, at this stage, it would be strange if it had. “We’re focusing on the quite narrow context of, how could we even do it credibly?”
The big takeaway from all these research efforts is that scientists are hard at work trying to find ways of compressing and dividing the work of training to make it feasible on battery-operated devices with less memory and less processing power…
OpenAI’s competitors have no choice but to speed up development to stay in the race as the leader sheds the cautious governance structure and welcomes a new board of directors who stand for commercialization and deregulation.
OpenAI’s charter—a document so sacred that employees’ pay is tied to how well they adhere to it—further declares that OpenAI’s “primary fiduciary duty is to humanity.”
Large-scale compute is also environmentally unsustainable: chips are highly toxic to produce and require an enormous amount of energy to manufacture: for example, TSMC on its own accounts for 4.8 percent of Taiwan’s national energy consumption, more than the entire capital city of Taipei. Running data centers is likewise environmentally very costly: estimates equate every prompt run on ChatGPT to the equivalent of pouring out an entire bottle of water.