A Meta exec on Monday denied a rumor that the company trained its new AI models to present well on specific benchmarks while concealing the models weaknesses.The executive, Ahmad Al-Dahle, VP of generative AI at Meta, said in a post on X that its simply not true that Meta trained its Llama 4 Maverick and Llama 4 Scout models on test sets. In AI benchmarks, test sets are collections of data used to evaluate the performance of a model after its been trained. Training on a test set could misleadingly inflate a models benchmark scores, making the model appear more capable than it actually is.Over the weekend, an unsubstantiated rumor that Meta artificially boosted its new models benchmark results began circulating on X and Reddit. The rumor appears to have originated from a post on a Chinese social media site from a user claiming to have resigned from Meta in protest over the companys benchmarking practices.Reports that Maverick and Scout perform poorly on certain tasks fueled the rumor, as did Metas decision to use an experimental, unreleased version of Maverick to achieve better scores on the benchmark LM Arena. Researchers on X haveobserved starkdifferences in the behaviorof the publicly downloadable Maverick compared with the model hosted on LM Arena.Al-Dahle acknowledged that some users are seeing mixed quality from Maverick and Scout across the different cloud providers hosting the models.Since we dropped the models as soon as they were ready, we expect itll take several days for all the public implementations to get dialed in, Al-Dahle said. Well keep working through our bug fixes and onboarding partners.