The ‘large language models’ driving AI chatbots get smaller and more powerful. Will they land in your palm? Yes, according to ZDNet:

The big takeaway from all these research efforts is that scientists are hard at work trying to find ways of compressing and dividing the work of training to make it feasible on battery-operated devices with less memory and less processing power than workstations and servers. 

Whether this research effort breaks through in 2024 remains to be seen. However, what’s already clear is that the training of neural networks is going to move out of the cloud and, quite possibly, into the palm of your hand.

This is a great longread, filled with good research findings.