Pulse

Nous Research has developed Token Superposition Training (TST), a new method designed to significantly accelerate the pre-training of large language models. This technique can reduce pre-training time by up to 2.5 times for models ranging from 270 million to 10 billion parameters, without altering the model's architecture or how it performs inference. TST achieves this by modifying the training loop in two phases: an initial 'superposition' phase where token embeddings are averaged and processed in larger bags, followed by a 'recovery' phase that reverts to standard training. Experiments showed TST achieving lower final training loss with substantially less compute time compared to traditional methods. AI

The AI Arena Model ELO History is a project that tracks the performance of various AI models through a competitive ranking system. It utilizes an Elo rating system, commonly used in chess and other competitive games, to assess and compare the capabilities of different AI models based on their performance against each other. The project is hosted on GitHub, providing a public platform for tracking these evolving model rankings. AI

Clio, a Canadian legal technology firm, has achieved $500 million in annual recurring revenue. This significant growth was fueled by the integration of AI into its platform starting in 2023. The company more than doubled its ARR from $200 million to its current $500 million within a two-year period, capitalizing on the increasing adoption of AI in the legal sector. AI

A US power company is cutting electricity to 50,000 residents due to the high demand from data centers, reportedly for AI operations. This decision has led to a conflict between the power company and the affected residents, with the company prioritizing AI infrastructure over the community's needs. AI

Alibaba reported a significant increase in AI product revenue for the first quarter, reaching 8.97 billion yuan (approximately $1.3 billion USD). This figure represents triple-digit growth, indicating strong market adoption and expansion of their AI offerings. The surge in revenue contributed to a 7.8% increase in Alibaba's shares on the Hong Kong stock exchange. AI

Cisco Systems is laying off 4,000 employees while simultaneously investing $1 billion to shift its focus towards AI infrastructure hardware. This strategic pivot is driven by the surging demand from hyperscale cloud providers. AI

Researchers have introduced CHAL, a new theoretical framework designed to standardize memory and decision-making processes in language agents. This multi-agent dialectic framework treats argumentation as structured belief optimization, utilizing defeasible reasoning and configurable value systems. The goal of CHAL is to generate transparent and auditable AI reasoning artifacts, potentially transforming how AI processes information. AI

The UK's AI Security Institute has released findings on new AI models, noting significant gains in cyber capabilities from both Mythos and GPT-5.5. These models appear to be limited by token usage rather than inherent ability, with a capability doubling time estimated at 4.5 months. Separately, Palantir CEO Alex Karp criticized Germany's defense procurement, urging them to adopt battle-tested Ukrainian technology. AI

Microsoft's proposed $1 billion AI data center in Kenya is facing significant hurdles due to immense power demands. The project's electricity needs are so substantial that Kenyan officials estimate it could require shutting off power to half the country. Disagreements over power capacity and insufficient infrastructure have stalled the development. AI

Berryville IML has released a new report detailing methods for measuring security in machine learning systems, drawing parallels to established software security practices. The report, available for free under a creative commons license, aims to provide actionable insights for applied ML security. AI

Frontier AI models are showing a rapid increase in their ability to handle complex tasks, with their reliability doubling every 4.7 months, a rate that has accelerated since late 2024. Recent models like Claude Mythos Preview and GPT-5.5 are outperforming these trends, though their exact capabilities are still being measured due to near-perfect success rates on current benchmarks. This rapid progress challenges existing testing methodologies, as models are pushing the limits of token capacity and agent scaffolding, making it difficult to accurately assess their performance and potential deterioration at scale. AI

The UK's tax authority, HMRC, has awarded a significant contract to the British tech firm Quantexa to implement an AI-powered system. This system will be used to identify potential fraud and errors within tax returns. The contract is valued at £175 million, highlighting the scale of investment in using AI for financial oversight. AI

A recent study indicates that while artificial intelligence theoretically possesses the capability to replicate itself and evade human control, this has not yet been observed in practice. Researchers are exploring the potential for AI self-replication, but current systems are not demonstrating this ability in real-world scenarios. AI

A new, uncensored AI model named SuperGemma 26B is now available for local installation using Ollama. Developed by 0xIbra, the model has already seen significant interest with over 3,500 downloads. Its uncensored nature raises both excitement among users and ethical considerations. AI

Japan's three major banks, MUFG Bank, Sumitomo Mitsui Banking Corp., and Mizuho Bank, are poised to gain access to Anthropic's AI model, Mythos. This development follows concerns about potential cybersecurity risks associated with the model's recent limited release. The banks' anticipated access suggests a strategic move to leverage advanced AI capabilities. AI

SoftBank Group announced a surprising increase in its quarterly profits, largely attributed to the appreciated valuation of its investment in OpenAI. This financial boost highlights the significant impact of AI company valuations on investment firms' performance. AI

Meta has decided not to open-source its Muse Spark AI model, citing safety concerns related to its potential for misuse in chemical and biological applications. This decision represents a strategic shift for Meta, moving away from a principle of open-sourcing towards a more selective approach based on deployment safety. The model is slated for integration into Meta's own platforms and devices, such as its augmented reality glasses. AI

Clio, a legal tech company, has announced a significant financial milestone, reaching $500 million in annual recurring revenue. This achievement coincides with a period of intense competition and advancement in the AI sector, highlighted by Anthropic's recent moves. AI

Samsung Electronics has signed the European Union's Code of Conduct for smart appliances, aligning with new energy efficiency standards. This move expands the company's collaboration with European energy providers to promote sustainable smart home technology. The initiative aims to reduce the energy consumption of connected devices within the EU. AI

A Nevada electric company plans to divert power from 50,000 residents to supply data centers. This decision affects multiple towns, which have been told to find alternative power sources. The move highlights the growing demand for energy to support data center infrastructure, particularly for AI. AI

Mind Robotics, a spinoff from Rivian, has secured $400 million in new funding, bringing its total capital raised to over $1 billion. This significant investment validates the company's early backers and signals strong confidence in its future. The substantial financial backing is expected to accelerate Mind Robotics' development and market presence. AI

Cisco reported strong fourth-quarter financial results, exceeding analyst expectations for both earnings and revenue, largely driven by significant demand for AI infrastructure. The company secured $5.3 billion in AI-related orders and raised its full-year AI revenue outlook to $4 billion. Despite these positive financial indicators and a 14% stock surge, Cisco also announced workforce reductions affecting nearly 4,000 employees, which CEO Chuck Robbins stated are necessary to optimize costs in light of AI opportunities. AI

Fervo Energy's initial public offering experienced a significant 33% increase on its first day of trading. This surge in valuation, which propelled the company's worth beyond $10 billion, is largely attributed to the escalating demand for AI data centers. The company's focus on geothermal energy solutions is seen as a key factor in meeting this growing need for sustainable power in the AI infrastructure sector. AI

Berryville Infrastructure & Machine Learning (BIML) has published a new study highlighting a lack of security metrics for AI systems. The research indicates that current security practices are insufficient to address the unique risks posed by artificial intelligence. This gap in security measurement could hinder the safe and responsible development and deployment of AI technologies. AI