Atomfall tops 1.5m players | News-in-briefRebellion's survival game released on March 27, 2025, is most successful launch in developer's historyImage credit: Rebellion News by Sophie McEvoy Staff Writer Published on April 2, 2025 This is a News-in-brief article, our short format linking to an official source for more information. Read more about this story by following the link below:Atomfall tops 1.5m players

Large Language Models (LLMs) significantly benefit from attention mechanisms, enabling the effective retrieval of contextual information. Nevertheless, traditional attention methods primarily depend on single token attention, where each attention weight is computed from a single pair of query and key vectors. This design inherently constrains the models ability to discern contexts requiring the integration of multiple token signals, thereby limiting its effectiveness on complex linguistic dependencies. For example, identifying sentences simultaneously containing both Alice and rabbit is challenging because conventional attention mechanisms struggle to integrate multiple separate attention signals efficiently without substantially increasing model complexity.Meta AI addresses this limitation by introducing Multi-Token Attention (MTA), an advanced attention mechanism that conditions attention weights simultaneously on multiple query and key vectors. MTA integrates convolution operations over queries, keys, and attention heads, thus enhancing the precision and efficiency of contextual information retrieval. Specifically, the MTA framework consists of two convolutional components: key-query convolution, which aggregates multiple token signals within individual attention heads, and head mixing convolution, which facilitates information sharing among different attention heads. Additionally, the implementation employs group normalization with depth-dependent scaling to stabilize gradient flow, further improving model training stability and efficacy.At a technical level, MTA modifies conventional attention calculations by incorporating a two-dimensional convolution operation on the attention logits prior to softmax normalization. This convolution allows adjacent queries and keys to influence attention scores mutually, thus enabling the attention mechanism to identify contextual relationships involving multiple tokens more precisely. Consequently, the model efficiently aggregates local token interactions without substantially increasing the number of parameters or the dimensionality of attention vectors. Moreover, head convolution promotes effective knowledge transfer among attention heads, selectively amplifying relevant context signals while mitigating less pertinent information. Collectively, these enhancements yield a more robust attention mechanism capable of capturing complex multi-token interactions.Empirical evaluations validate the efficacy of MTA across several benchmarks. In a structured motivating task explicitly designed to illustrate the shortcomings of single-token attention mechanisms, MTA demonstrated near-perfect performance, achieving an error rate of only 0.1%, in contrast to standard Transformer models that exhibited error rates above 50%. Further large-scale experiments involving an 880M-parameter model trained on 105 billion tokens showed MTA consistently outperforming baseline architectures. MTA achieved superior validation perplexity scores across datasets such as arXiv, GitHub, and Wikipedia. Specifically, in tasks requiring extended context comprehension, such as Needle-in-the-Haystack and BabiLong benchmarks, MTA significantly exceeded the performance of standard Transformer models. In the Needle-in-the-Haystack task with 4K token contexts containing multiple needles, MTA attained accuracies ranging from 67% to 97.6%, surpassing standard models by substantial margins.In summary, Multi-Token Attention (MTA) presents a refined advancement in attention mechanisms by addressing fundamental limitations of traditional single-token attention. Leveraging convolutional operations to concurrently integrate multiple query-key interactions, MTA enhances the ability of language models to handle intricate contextual dependencies. These methodological improvements facilitate more precise and efficient performance, particularly in scenarios involving complex token interactions and long-range contextual understanding. Through targeted modifications to standard attention mechanisms, MTA contributes meaningfully to the evolution of more sophisticated, accurate, and computationally efficient language models.Check outthe Paper.All credit for this research goes to the researchers of this project. Also,feel free to follow us onTwitterand dont forget to join our85k+ ML SubReddit. [Register Now] miniCON Virtual Conference on OPEN SOURCE AI: FREE REGISTRATION + Certificate of Attendance + 3 Hour Short Event (April 12, 9 am- 12 pm PST) + Hands on Workshop [Sponsored]The post Meta AI Proposes Multi-Token Attention (MTA): A New Attention Method which Allows LLMs to Condition their Attention Weights on Multiple Query and Key Vectors appeared first on MarkTechPost.

Apr 02, 2025Ravie LakshmananRansomware / Email SecurityThe financially motivated threat actor known as FIN7 has been linked to a Python-based backdoor called Anubis (not to be confused with an Android banking trojan of the same name) that can grant them remote access to compromised Windows systems."This malware allows attackers to execute remote shell commands and other system operations, giving them full control over an infected machine," Swiss cybersecurity company PRODAFT said in a technical report of the malware.FIN7, also called Carbon Spider, ELBRUS, Gold Niagara, Sangria Tempest, and Savage Ladybug, is a Russian cybercrime group known for its ever-evolving and expanding set of malware families for obtaining initial access and data exfiltration. In recent years, the threat actor is said to have transitioned to a ransomware affiliate.In July 2024, the group was observed using various online aliases to advertise a tool called AuKill (aka AvNeutralizer) that's capable of terminating security tools in a likely attempt to diversify its monetization strategy.Anubis is believed to be propagated via malspam campaigns that typically entice victims into executing the payload hosted on compromised SharePoint sites.Delivered in the form of a ZIP archive, the entry point of the infection is a Python script that's designed to decrypt and execute the main obfuscated payload directly in memory. Once launched, the backdoor establishes communications with a remote server over a TCP socket in Base64-encoded format.The responses from the server, also Base64-encoded, allow it to gather the IP address of the host, upload/download files, change the current working directory, grab environment variables, alter Windows Registry, load DLL files into memory using PythonMemoryModule, and terminate itself.In an independent analysis of Anubis, German security company GDATA said the backdoor also supports the ability to run operator-provided responses as a shell command on the victim system."This enables attackers to perform actions such as keylogging, taking screenshots, or stealing passwords without directly storing these capabilities on the infected system," PRODAFT said. "By keeping the backdoor as lightweight as possible, they reduce the risk of detection while maintaining flexibility for executing further malicious activities."Found this article interesting? Follow us on Twitter and LinkedIn to read more exclusive content we post.SHARE

This years competition, again with a prize purse of 25,000, seeks inventive design proposals to transform any site in the UK into a cohesive and integrated community of at least 300 new homes.The brief responds to the governments ambitious goal of building 1.5 million homes over the next five years. Concepts will be expected to zoom in on the experiential aspects of typical living spaces and provide solutions to ensure quality as well as quantity remains part of the outcome.The 16-strong longlist (see full details below) includes Ash Sakula, Patch Collective, Clifton Emery Design, daab Design Architects, Morris+Company, RCKa, Studio Woodroffe Papa, and The Place Bureau.AdvertisementThe annual prize recognises the best of transformative architecture of the home. It is open to multidisciplinary teams featuring at least one ARB or RIAI-registered architect. Each year, three shortlisted teams receive 5,000, while the overall winner takes home a further 10,000.The award is named after architect, visualiser and Hayes Davidson founder Alan Davidson, who died of motor neurone disease in 2018. For 2025, The Davidson Prize is partnering with leading visualisation studio Hayes Davidson, which will provide creative consultation and provide the winner with an additional week of support to help them engage with key decision makers.Jury chair Pooja Agrawal architect, planner and chief executive of Public Practice said: One of the great things about The Davidson Prize is the way it brings together multidisciplinary teams. For me thats not just about bringing together different professional skill sets, but also peoples lived experiences after all housing is about peoples homes.The range of proposals we assessed were varied, tackling finance, typologies and planning. There were so many interesting ideas to learn from and collectively they provided a vision for what the future of housing in the UK could look like.Akil Scafe-Smith, jury member and director of Resolve Collective said:This year's submissions creatively addressed a variety of contexts in responseto The Davidson Prize's challenge. It was particularly moving to see the vision and feel the energy of the non-London and Northern England based proposals and I'm excited to get into choosing the three finalists.AdvertisementThis years theme is Streets Ahead: The Race to Build 1.5M Homes. It asks collaborative teams to draw up compelling visual arguments for a minimum of 300 new homes on a site of their choice anywhere in the UK or Ireland.Last years Davidson Prize was won by The Apartment Store a concept to reinvent empty retail space as homes designed by Studio Saar with Landstory, Stories, BAS and Megaphone. The 2023 Davidson Prize was won by Helping Hands, drawn up by a team led by Liverpools Studio MUTT and collaborative research outfit Neighbourhood.The inaugural contest in 2021 was won by a team led by Haptic Architects under the banner HomeForest and featuring poet Lionheart, designer Yaoyao Meng, digital designers Squint/Opera and musicians Coda to Coda. The teams biophilic design aimed to bring the restorative effects of nature inside, [and] playfully blend digital and physical worlds to soften the constraints of working from home.Alongside Agrawal and Scafe-Smith, the judging panel includes Jonny Buckland, creative partner at Studio Saar and 2024 Davidson Prize winner; Lucy Watson, commissioning editor, House & Home at The Financial Times; and Jonathan Falkingham, founder and director of Urban Splash.The next stage will see three teams shortlisted and paid5,000 each to further develop their concept. The overall winner will be announced in June.daab Design Architects, HomeGrown Plus, Expedition Engineering, Robert Bird Group, Third Revolution Projects, Atelier Crescendo Between the Lines - Living with IndustryThe Davidson Prize 2025 longlistF.U.N.N.E.L by A IS FOR ARCHITECTURE, WSP, SpacehubHardworking Landscapes by AOMD, Edit, Periscope, Dion Barrett, Ruth Lang1 House, 2 Homes... make a neighbourhood by Ash Sakula with Human NatureWearWork by CARD Projects, PATCH Collective, and System of Systems300 Homes within a Union Street Mile by Clifton Emery Design, Nudge Community Builders, Millfields Trust, Plymouth Energy Community, Devon and Cornwall Planning ConsultantsBetween the Lines Living with Industry by daab Design Architects, HomeGrown Plus, Expedition Engineering, Robert Bird Group, Third Revolution Projects, Atelier CrescendoPermitted Development + by Elephant in the City Morris+Company, Hub, Stantec / Hydrock, Studio Knight StokoePositive Disturbance Realising Brownfield Potential by FLOC, MAZi, Hyem, Stef Leach, Broaden, Thurston Illustration, SHED, Artis, Henna AsikainenMetroland by Harper Perry, Urban Design Works and Studio Mint with North East Combined Authority and NEXUS Tyne and Wear MetroThe Rail Belt by James Waddington with Nathaniel Welham and WSPBeta Boroughs How Could Better Data Help Us Beat the Housing Crisis? by RCKaKommuna Palace by Studio Woodroffe Papa, Lawrence Barth, Almitra Roosevelt and Anagha Othalur of AA Housing and Urbanism, Whitby Wood, XCO2Forever Island A New Model for Young Islanders by The Place BureauGrowing Places by University of West England StudentsLiving in the Landscape A community for all ages by William Burgess & Oliver BurgessRUN! by Yolande Barnes Consulting & Space SyntaxWilliam Burgess & Oliver Burgess Living in the Landscape - A community for all ages

The Wandsworth tower, called Nest Battersea, would provide 147 flats, as well as 500m of commercial space near to the London Heliport.It would be built close to the Thames, on the site of Heliport House, a vacant five-storey office block, and two industrial garages, which would all be demolished to make way for the new plans.The building is earmarked for the same site as Will Alsops planned 15-storey Heliport Heights tower block, which gained planning permission in 2014.AdvertisementThe mixed-use scheme on stilts, which would have been the late Alsops last in London, was never built.The Alsop plan was for 14 flats one on each floor with a duplex at the top none of which would have been designated affordable. A third of the homes in HTAs scheme will be affordable. About 15 will be wheelchair-accessible.The building will be fitted with air-source heat pumps and solar panels, and will also use a waste water heat recovery system.The architects aim to minimise emissions by reusing demolition waste on site, as well as using 100 per cent recycled rebar and window frames with high recycled aluminium content. The building will also be fitted with centralised ambient loop air heating conditioning systems and mechanical ventilation with heat recovery.The scheme will also feature some improvements to the local public realm, including new planting and signage on the riverfront. Also included within the block itself will be a roof garden and childrens play area.AdvertisementDevelopers said that they were breathing new life into a part of Battersea thats been under-utilised for too long. Despite the marketings focus on local regeneration, a promotional video for the scheme uses imagery from the South Bank and Westminster Bridge Road, several miles away.London heliport bosses said they wanted to look at more detailed plans before commenting. The developers said they had consulted with aviation experts and did not foresee any issues.Consultation on the initial plans took place in February this year. Planning consultants told the AJ that 20,000 people had visited the portal.Concrete Amsterdam worked as concept architects, with HTA drawing up more detailed designs.The project team hopes to get through the planning phase in the next two years.HTA, the AJ100 Employer of the Year, delivered the masterplan for the nearby Winstanley estate regeneration for Wandsworth Council and Taylor Wimpey.The private developers exited the 2,250 home scheme in January, with HTAs role in the future of the project left unclear.Will Alsop's RA Summer Exhibition-winning model of his Heliport Heights scheme

The Switch 2's most mysterious button has been teased by Nintendo, ahead of the new console's full unveiling in just a few hours. Read more

cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.

Subscribe to Nintendo Life on YouTube801kAccessory manufacturer Genki which became infamous for its Switch 2 teases earlier this year is hosting its own 'Direct' presentation later today at 9am PT / 12pm ET / 5pm BST / 6pm CEST / 2am AET (Thursday), promising roughly just one minute of accessory reveals for the Nintendo Switch 2.At first, we thought this was some elaborate April Fool's joke, but it seems that it's merely a fun way for Genki to present its wares after the upcoming Switch 2 Direct from Nintendo. A link is attached to the video that takes you to the 'NS2 Accessories' page on Genki's website, but it's currently empty at the time of writing.Needless to say, we reckon we'll be seeing products such as Joy-Con grips, carry cases, screen protectors, and maybe even a Bluetooth controller or two.Either way, the flood gates are about to open, and you can bet that Genki won't be the only brand looking to promote its Switch 2 accessories once Nintendo is done with its highly-anticipated Direct. Speaking of which, we'll have our live blog going up at 5am PT / 8am ET / 1pm BST / 2pm CEST / 10pm AET, with the presentation itself kicking off one hour later. Be sure to join us, if you can. It's time for Switch 2We're getting close...What kind of accessories will you be looking to pick up for your Switch 2? Let us know with a comment in the usual place.[source youtube.com]See AlsoShare:00 Nintendo Lifes resident horror fanatic, when hes not knee-deep in Resident Evil and Silent Hill lore, Ollie likes to dive into a good horror book while nursing a lovely cup of tea. He also enjoys long walks and listens to everything from TOOL to Chuck Berry. Hold on there, you need to login to post a comment...Related ArticlesNintendo Switch 2 Direct: Time, Where To Watch, What To ExpectIt's time for Switch 2Rumour: Nintendo Switch 2 To Launch In June With 3-Phase Software PlanGoing through phaazesThe Duration Of Tomorrow's Nintendo Switch 2 Direct Has Been ConfirmedIt's gonna be a long one