AI chatbots have limits on the amount of text they can digest – something known as the ‘context window’. On Bing Chat and Windows Copilot, the limit is set at around 4000 characters – less than 1000 words. Good news from WinBuzzer – Microsoft is set to double that:

Microsoft has recently announced plans to expand the character limit for Bing Chat. This change, which will affect both consumer and Bing Chat Enterprise, is set to double the current limit from 4,000 characters to 8,000. In other words, Bing Chat is now able to provide longer answers to prompts.

The decision to increase the character limit came after feedback from users, particularly from the enterprise sector. A notable mention was a tweet from a company representative who pointed out that while they found Bing Chat Enterprise beneficial, the character limit posed a challenge.

Mikhail Parakhin, Vice President of Search at Microsoft, addressed this concern in a tweet. He acknowledged the need for expansion but also highlighted the complexities involved. “The algorithms that power Bing Chat are quadratic in context size,” Parakhin mentioned, indicating that the expansion to 8,000 characters would make the process four times more resource-intensive.

Read the full article here.