• WWW.TECHRADAR.COM
    ChatGPT Plus subscribers just got a surprise free gift unlimited OpenAI Sora access for the holidays
    You'll get unlimited access to Sora this holiday season if you're a ChatGPT Plus subscriber.
    0 Comments 0 Shares 8 Views
  • VFXEXPRESS.COM
    Let the Dragons Soar: Virtual Production on House of the Dragon Season 2 by PXO
    House of the Dragon Season 2 work with PXO on virtual production marked a breakthrough in the art of the scenes about dragon riding. Integrating real-time visualization with advanced motion control and Unreal Engine, the team made seamless, immersive sequences transport the viewer to the skies of Westeros. Buck rigging to give realistic motion of riders and BoltX camera robots for dynamic angles, meant every shot had the power of being visually stunning.The use of LED wall technology provided interactive lighting and synchronized environments, allowing real-time creative adjustments on set. Such an adaptable approach streamlined the workflow while also fostering close collaboration with directors, DOPs, and VFX supervisors to ensure artistic visions were achieved with precision.The result is a series of breathtaking scenes that blend technical innovation with storytelling, showcasing PXOs expertise in delivering visually stunning and efficient production solutions for House of the Dragon.The post Let the Dragons Soar: Virtual Production on House of the Dragon Season 2 by PXO appeared first on Vfxexpress.
    0 Comments 0 Shares 8 Views
  • WWW.FASTCOMPANY.COM
    The greatest keyboard never sold
    Even as the latest phones and wearables tout speech recognition with unprecedented accuracy and spatial computing products flirt with replacing tablets and laptops, physical keyboards remain beloved for their efficiency. Earlier this year, for example, sci-fi novelist Robert J. Sawyer created a comprehensive archive of files that enables modern PCs to run WordStar 7, the DOS programs final version. He favors the once-dominant word processor, also used by Game of Thrones author George R. R. Martin, in part because of its effective use of home row keyboard shortcuts to speed navigation and editing.The keyboard is also a vibrant target for tinkering. Crowdfunding campaigns over the past year or so have included Mobile Pixels Tetra, a split keyboard with a repositionable screen; Naya Create, a sloping, modular keyboard; the Clevetura CLV1, which integrates trackpad functionality into the keys themselves; and the Flux, a keyboard that combines control modules and a display under the keys for infinite combinations of appearance and function.The TextBlade setup, including a stand that could prop up a phone or tablet.Alas, neither WordStar nor these daring designs are well-suited to mobile usage. On that front, Michael Fisher (aka Mr Mobile) and Kevin Michalu (aka Crackberry Kevin)two tech media veterans with keyboard phone nostalgia coursing through their thumbsteamed up to launch the Clicks keyboard for iPhones this year. While a well-designed accessory, it adds significant height to what can already be a large phone. And like the Blackberry keyboards that inspired it, it can be uncomfortable for extended text-entry sessions.Such have long been the compromises of typing on the go. But in 2015, a keyboard that looked and worked like nothing before or since went up for pre-order. It claimed to capture the holy grail of a comfortable and familiar typing experience in a pocket-friendly package. It promised to turn phones into text-entry powerhouses and halve the thickness of tablets paired with keyboard covers. And as it got close to release, the company solicited feedback from a community of passionate testers who loved the product and pleaded with the company to release it. But this breakthrough device never shipped to customers.TextBlade managed to squeeze a remarkably pleasant typing experience into three gum-stick-sized slivers of hardware.WayTools TextBlade consisted of three rectangular sections, each about the size of a stick of gum. Its KeyBlades which split the letters of a QWERTY layout, attached magnetically to each other and an oversized space bar called the SpaceBlade. The heart of the product, the SpaceBlade included the devices battery, Bluetooth radio, and a line of 10 LEDs that indicated the devices status and modes. When not in use, the three sticks neatly stacked magnetically, sliding into a plastic brace that doubled as a stand for a smartphone or tablet.WayTools even sweated the details when it came to charging the TextBlade. Lightly knocking the SpaceBlade against a surface such as the side of your hand dislodged a half-height USB nano charger adapter with metal contacts that connected to the SpaceBlade. After charging, the adapter could be docked back into the SpaceBlade like the stylus in a Samsung Galaxy Note or S24 Ultra.But the TextBlades Voltron-like assembly setup was just the beginning of its bag of tricks. Despite being a fraction of the size of a standard laptop keyboard with its segments all connected, it offered a shockingly comfortable typing experience that included 19 mm key width for most keys and a competitive 1.5 mm of key travel, Instead of each key sitting atop a separate switch, vertically adjacent keys shared a butterfly switch, and the TextBlade detected which character was being typed.Layers and chordsThe TextBlade also defied expectations with its functionality. Despite having only 37 keys (including the space bar) on nine switches, it could produce far more characters by combining layers and chords. Layers (modes) expanded the concept of modifier keys (like the Macs Option key that changes the output of the G key to a copyright symbol). Chords, long used by stenographs, assistive text input devices, and gamers looking to maximize on-screen actions while minimizing finger movements, allowed triggering different outputs when multiple keys are held down at the same time. For example, when using the TextBlade with an Apple device, holding down C and V together before pressing F would enter Command-F. And holding down Z, X and V equated to pressing Control and Alt together on a larger keyboard.Activating the TextBlades Edit layer turned the I, J, K, and L keys into gaming-style cursor keys. This layer also included one-key shortcuts for Clipboard operations, undo and redo. Adding S in this mode turned text cursor movements into cursor-based selection. And adding the space bar to the mix allowed you to navigate or select by paragraph or even across a whole document. Holding down A, S, D, and F activated a Media layer that turned other keys into controls playback and volume. Adding the space bar activated an App layer that allowed switching among windows or apps. Pressing K and L activated the Function layer, enabling other keys to act as up to 20 function keys, the ones typically located above the number row on a desktop keyboard. And holding down the J and K keys activated a Macro layer that could enter snippets of text triggered by any other TextBlade key.While elegant and powerful, mastering layers and chords did have something of a learning curve. To help with the journey, WayTools developed an iOS on-screen keyboard that reflected the dynamic functions changing in response to chord presses. It also developed a companion iOS app that included a guide, a way to tweak many settings, and the ability to update the keyboards firmware. The app saved settings, macros and custom keymaps in a cloud account so that they wouldnt be lost if the TextBlade was lost or damaged.Living up to the hypeFor months after the preorder launch, a calendar on waytools.com kept shifting when orders from which batch would ship. Then, in 2016, WayTools welcomed some customers to test TextBlades in development through a program called TREG (Test RElease Group) along with an online forum to discuss feedback. I joined TREG late in the game in 2019. Admittance included a one-hour tour of the TextBlade in a phone call with the companys founder and CEO, Mark Knighton, who clearly relished peeling back each layer of cleverness that had gone into the products design. His infectious enthusiasm notwithstanding, the proof was in the pressing.The TextBlade lived up to the hype. I took it everywhere and found myself typing things into my phone in locations such as a small cafe table where a keyboard simply wouldnt fit. Nonetheless, when I checked in with Knighton by phone after a few weeks, he seemed disappointed that I wasnt using the TextBlade as my primary keyboard. He firmly believed that the TextBlade was not just the best mobile keyboardwhich it clearly wasbut so superior to other options that users would want to use it with all of their devices. After all, it could switch among six paired devices on the fly.I would also visit the TREG message boards, which were filled with discussions about bugs and potential features. But by far the most prevalent sentiment offered there was that the TextBlade was amazing, even revolutionary, and that WayTools should ship the damn thing already. Trace Rogers, a former TREG participant who produced an exhaustive two-hour YouTube tour of the TextBlade in 2020 after more than three years in the program, wraps up his presentation by saying, I love my TextBlade. I use it all the time. I wish it was for sale right now at Best Buy. Despite also crediting the TextBlade with relieving his carpal tunnel pain, he says in the video that he wouldnt recommend pre-purchasing it until it shipped, given the unclear release timeline.Such a timeline would never arrive. WayTools continued to add and revise software features, so much so that it ran out of room in the TextBlades firmware. Its solution was to rewrite the firmware completely, a huge engineering effort coming years after accepting preorders from people who hadnt received the device. The rewrite would open the door to even more advanced capabilities, a head-scratching possibility for a product that already had far more features than many of its users would ever discover. More of those who had preordered the product took the company up on its promise of an unconditional refund and some who criticized WayTools had their preorders refunded involuntarily.Missing in actionUnlike some device startups, WayTools survived COVID and the pandemics supply chain havoc overhang. At some point, though, the WayTools TREG forum disappeared, followed by the rest of the website. The Wayback Machines last snapshot of a functioning waytools.com was taken on February 24, 2023.Theories abound on why WayTools refused to ship a product that clearly exceeded the expectations of its testers and which it could have improved over time via firmware updates. A former employee with whom I spoke refuted the notion that WayTools never wanted to sell the TextBlade and instead wanted to sell or license the intellectual property behind it, noting that the company rebuffed multiple acquisition offers in the early days.Rather, he notes, an undisclosed fire at a supplier that wiped out much of WayTools inventory was the most significant blow to the company, which had already spent much of its funding to develop the product. A former staffer notes, We lost a lot of people and talent after that. It was heartbreaking to work so hard on a product and be so close and then have a natural disaster come and basically wipe it out.However, former WayTools staffers also lay some blame at the feet of Knighton, whom I was unable to reach for comment. One described him as a perfectionist who cared deeply about the customer experience but who lost sight of customers patience. Knighton, who admired icons like Steve Jobs and Elon Musk, would reportedly wax on about his positive experience as a Tesla owner and not wanting to risk a disappointing first impression. Indeed, like Musk with Tesla and SpaceX and Jobs with Apple and Pixar, Knighton was also running a second company, a developer of 3D scanners called NextEngine that met the same fate as WayTools after much of the formers inventory was destroyed in the same fire.Knighton also felt the heat of legal issues. Since 2009, Knighton and NextEngine have been embroiled in litigation with an investor, Bigfoot Ventures. Last year, Bigfoot Ventures sued Knighton for personal injury and included WayTools as a defendant. According to one of the former staffers I contacted, the lawsuits crippled Knightons ability to do creative work.While the delay needed to recreate inventory prompted the decision to rewrite the firmware, the impact of the fire and the distraction and expense of the litigation ultimately proved overwhelming.Final cutWhile theres little evidence that WayTools still exists, Knighton never acknowledged the end of the company. There were no farewell web pages or Medium mea culpas about lessons learned. But nine years after TextBlade promised to reinvent the mobile typing experience, nothing has come close to capturing its geeky genius. One former Waytools employee who still uses a TextBlade calls it an incredibly useful product [that] was ready to ship. It would have made a lot of people very happy. Like others with whom I spoke, he hopes some party will one day bring the TextBlade to market, adding, I would love to see this come to the world.Today, the closest product in spirit to the TextBlade is the CharaChorder X, a crowdfunded and shipping USB dongle that lets any external keyboard become a chording keyboard. CharaChorder, a company that uses the slogan typing at the speed of thought, has also created its own text input devices. All use CharaChorder Engine, an operating system for input devices it hopes to license to laptop makers. But while CharaChorder X shares many of the TextBlades nods to efficiency and customization and preserves the standard QWERTY layout, it doesnt provide the integration and extreme portability of the TextBlade.Theres also the TapXR, a wrist-worn Bluetooth text input and XR controller device that generates characters via chords generated by finger-tapping combinations. Its small and even allows one-handed input but isnt nearly as efficient as the TextBlade was and has a steeper learning curve.I still have my TextBlade TREG unit, which developed an issue that caused it to type garbled text after being paired to a device; repeating the pairing process fixes the issue. Its three stacked layers remain a brilliantly engineered sandwich of efficiency and execution. Its a shame WayTools couldnt serve it to a hungry user base.
    0 Comments 0 Shares 21 Views
  • WWW.DEZEEN.COM
    Architecture Discipline unveils India's first mass-timber home
    New Delhi-based studio Architecture Discipline has created a sea-facing, mass-timber home covered in charred-wood cladding in Goa, India.The linear home was constructed using 11 glued laminated timber (glulam) portal frames, which according to the practice is "a first in India".Architecture Discipline claims to have created India's first mass-timber houseGlued laminated timber, more commonly known as glulam, is a form of high-strength mass-timber with a low carbon footprint."The decision to use mass-timber stemmed from a desire to push the boundaries of sustainable construction in India," Architecture Discipline principal architect Akshat Bhatt told Dezeen.The house is located in GoaThe linear block stands at the highest point of a steep site near the edge of the Chapora River in Vagator, Goa.The team intended to construct the house in a minimally invasive manner and perched it on a foundation of stilts and concrete retaining walls. Raising the floor plate above the ground also gave protection from moisture and capillary action.The house is perched on stiltsAbove this, the glulam portal frames, which were prefabricated in Delhi and assembled on-site in Goa, form the house's structure."The prefabrication process allowed for incredible precision, and assembling the structure on-site was faster than traditional methods," Bhatt commented."The finished structure feels progressive yet rooted, reflecting the ability of mass-timber to achieve both sustainability and aesthetics."Read: Lemay creates mass-timber chalet with sloped green roof in QuebecThe living area is arranged in an open plan on the lower level, culminating in two guest suites at the rear.It is lined with glazing on three sides, allowing natural light to flood the space. The glazing, along with an open deck extending from the front of the living room, provides unobstructed views of the lush surroundings.A kitchen garden has been added to the landscapingAs a result of the client's minimal lifestyle, the team selected simple furniture pieces upholstered in leather, including an Eames chair .A mezzanine level overlooks the living space, connected by a metal staircase. The team designed a gallery space here to display the client's art collection, leading into the master bedroom.The practice chose a pared-back palette for the interiors, intending to express the raw form of the timber frames. The walls are painted white, coupled with black granite flooring.The interior scheme is pared-backThe stilted volume on the ground level houses a glass-lined space use by the client as a wood workshop.The exterior surface is covered with charred timber cladding created using an age-old Japanese preservation technique called Yakisugi. The material was chosen for its durability and moisture resistance, ideal for Goa's tropical climate.The living room extends into a deckBhatt believes that mass-timber will become a key material in redefining how homes are built in India."Mass-timber has the potential to revolutionise residential design in India by offering a sustainable alternative to conventional materials," he said."As awareness grows around the environmental impact of construction, mass-timber's carbon-sequestering properties and renewable nature make it an ideal solution," he continued."It is time for a revolution. Bold design must be realised with sustainable technology and small-scale experiments like this can be a catalyst for change."The house features a private wood workshopOther glulam buildings recently featured on Dezeen include a demountable timber sports hall at the University of Zurich by Itten+Brechbhl and a wood-clad visitor centre on the Beskydy Mountains ridge in the Czech Republic by Henkai Architekti.The photography is by Studio Charuau and Ranjan Sharma.The post Architecture Discipline unveils India's first mass-timber home appeared first on Dezeen.
    0 Comments 0 Shares 12 Views
  • WWW.CREATIVEBLOQ.COM
    Asus ProArt Display PA27JCV review: a studio display without the Apple
    The Asus ProArt Display PA27JCV packs an awful lot of pixels into a small space: is it the best monitor for graphic designers?
    0 Comments 0 Shares 8 Views
  • WWW.NYTIMES.COM
    Why Mergers of Carmakers Like Honda and Nissan Often Falter
    The Japanese companies are considering joining forces to survive in a rapidly changing auto industry, but auto history is filled with troubled and failed marriages.
    0 Comments 0 Shares 8 Views
  • GAMINGBOLT.COM
    S.T.A.L.K.E.R. 2: Heart of Chornobyl Dev Says There Are No Current Plans for a PS5 Port
    It may have launched with its fair share of technical issues, butS.T.A.L.K.E.R. 2: Heart of Chornobylis undoubtedly ending the years as one of its most notable releases, and at least for the foreseeable future, theres no telling how long PlayStation audiences will be waiting to get their hands on the game.The open world first-person shooter launched last month as an Xbox console exclusive, and for now, developer GSC Game World has no plans of bringing the game to PS5. Speaking with Tech4Gamers, game director Ievgen Grygorovych stated that for now, the studio is focused on post-launch support for the horror shooters PC and Xbox versions.We were fully focused on developing (and now supporting) the PC and Xbox Series X/S versions, he said.One would assume thatS.T.A.L.K.E.R. 2will eventually be making its way over to PS5, though theres no telling how long the wait will be. Back in 2021, leaked documents suggested that the Xbox exclusivity window for the title would be three months long, though if thatisaccurate, that doesnt necessarily have to mean a PS5 version is certain to arrive as soon as that window is over.GSC Game World has released a couple of updates forS.T.A.L.K.E.R. 2since its release, with plenty more to come. Two expansions are also in the works, with finer details on post-launch support set to be shared in early 2025.S.T.A.L.K.E.R. 2: Heart of Chornobylis available on Xbox Series X/S and PC. Read our review of the game through here.
    0 Comments 0 Shares 9 Views
  • GAMINGBOLT.COM
    Pine Harbor Early Access Review We Dont Go to Pine Harbor
    While there are quite a few horror games out these days, the genre still maintains quite a bit of popularity among indie game developers, where small studios are doing their best to come up with fun ways to reinvent the genre. The latest such attempt is Pine Harbor by Vision Forge Team, which in some ways feels like a retread of older ideas, but in other ways, also feels like an interesting new take on horror games. It is worth noting, however, that Pine Harbor is still in Early Access at the time of writing this review, and will undoubtedly go through quite a few changes before it hits its final release.At its core, Pine Harbor is an incredibly simple game: it melds mechanics that would be more at home in a genre like survival or even extraction shooters with a heavy dose of horror-based tension for its core gameplay loop. As the games description on Steam will aptly tell you, the entire gameplay loop revolves around scavenging for supplies and materials during the day, which in turn will help you out with surviving the following night. And while this core gameplay loop always exists in the background, theres also a story that tries to give players more structure with how they go about achieving their goals."Shortly after getting separated from Richard, its up to the players to try and figure out what kind of mysterious secret he was uncovering, and why a corporation might want to shut him up."The setup is rather simple: Pine Harbor is a small town where some sort of accident caused a factory to blow up. This, for some reason, has essentially caused the town to become infected with zombie-like enemies all over the place, in turn leading the town to get abandoned by most of its regular populace. Players take on the role of Josh, who hitches a bus ride to the eponymous town at the seeming behest of his father. Shortly after meeting his father, Richard, Josh discovers that the letter wasnt sent by him, and that darker forces, and maybe even a conspiracy might be at play.Shortly after getting separated from Richard, its up to the players to try and figure out what kind of mysterious secret he was uncovering, and why a corporation might want to shut him up. It also doesnt help that the zombie-like skinners also seem hellbent on taking him, and by extension, you down. Throughout the plot, youll be sent all over Pine Harbor on missions, ranging from looking for some supplies for some fellow surviving humans that might be looking forward to escaping, to following the cryptic instructions left behind by your father.Generally speaking, Pine Harbor feels like its inspired quite a bit by classic survival horror titles like Silent Hill. The titular town is constantly covered in fog, which does a great job in adding to the general atmosphere of the game. The general nature of the narrative also feels like its lifting a page right out of Silent Hill, thanks to its creepy atmosphere, weird-looking enemies, and strange-acting NPCs."Pine Harbor feels like its inspired quite a bit by classic survival horror titles like Silent Hill"Interestingly, the NPCs behaving strangely might actually be the result of the game still being in Early Access. Right from the get go, its quite evident theres still a lot of work left to be done on Pine Harbor. Among other things, just about every animation in the whole game feels incredibly stiff, with some standout examples being Richard being incredibly still while talking to you in a moving car, or how enemies generally tend to behave. The generally strange behavior of the NPCs also goes beyond just stiff animations, and crosses right over into the bad voice acting category.Most quests tend to have you running between two distant parts of the town on simple fetch quests, and sometimes taking on some enemies along the way. While this has the great effect of getting you intimately familiar with the town over a long period of play, unfortunately, this also has the side-effect of making the game feel incredibly repetitive. The quests needed a lot more variety in them than just simply being sent to a building on the other side of town to either talk to a survivor, or to find some supplies that you then have to bring all the way back.While the core structure of Pine Harbor shows that a fun game might be somewhere in there, just about everything else throughout your time with the title will prove to be tedious, frustrating, or outright boring. For example, there isnt really much in the way of combat options when it comes to dealing with enemies. You either shoot them if you have a gun, or you keep spamming a basic melee attack until they go down. This issue is further exacerbated by the fact that enemies dont really tend to react in any interesting way to your actions, aside from coming to you when they hear you getting close. This isnt, for example, like Resident Evil where you have a ton of options in combat by choosing to shoot different body parts on zombies. Rather, all you can really do to deal with them is keep spamming left click and wait for them to eventually go down."You either shoot them if you have a gun, or you keep spamming a basic melee attack until they go down."Pine Harbor quite obviously still has a long road ahead of it, and in its current state, keeping it in Early Access is definitely the right call. While the background setting is pretty interesting, the main story is bland because of the lack of quality voice acting or even decent writing. NPC characters will often act like theyre either students acting on stage for the first time, or aliens that are failing miserably in their attempts to sound like actual human beings. Couple that with the fact that the gameplay is pretty boring, and the missions are just simple fetch quests, and there really isnt much here.The game really starts to come alive at night, when youre shacked up in your house and have to make some decisions about how youre going to deal with skinners that will be gunning straight for your head. Unfortunately, the bad enemy AI rears its ugly head once again, and you never really have to employ much in the way of strategy aside from finding a good place to hide and having plenty of ammo to survive the night.Somewhere inside Pine Harbor, there is an intriguing game. The fact that its an Early Access release also means that theres nowhere for the games quality to go but up. The foundations are decent, and the general vibes of the game is pretty spot-on when it comes to instilling a sense of horror in the player. Unfortunately, the roughness around the edges, the lack of any real combat options, bland quests, and terrible voice acting hold the game back quite a bit.As it currently stands, Pine Harbor isnt really worth your time, even if you are a horror fan. There are a few good ideas there, however, and with time, there are definitely hopes that it goes on to become a decent addition to the horror genre.This game was reviewed on PC.
    0 Comments 0 Shares 8 Views
  • GAMINGBOLT.COM
    No Rest for the Wicked Announcement Set for January 2025
    Among the early access titles released this year, Moon Studios No Rest for the Wicked had a rough start with stuttering, inventory management, janky movement, and difficulty spikes. However, its improved significantly with more patches. In a Steam Community post, the development team teased whats coming up in 2025. These include The Breach, the next major update, and subsequent Content and Feature updates.We know weve been quiet a lot has been happening for us at Moon Studios this year, and we will finally be able to share all about it very soon! There will be better and more frequent communication in 2025, starting with an announcement in January.No Rest for the Wicked is exclusive to PC via Steam Early Access, with console versions in the works. You can check out our review for the launch version. While previously published by Private Division, Take-Two Interactive has taken over since selling the label last month.Alongside improvements to combat and performance, Moon Studios last major update reworked the Cerim Crucible, adding new chambers, more randomization for the arenas, Echoes for customizing runs, and The Gloam, a new enemy type. Besides The Breach, the team is working on updates to farming and other features.
    0 Comments 0 Shares 8 Views
  • WWW.MARKTECHPOST.COM
    Meet OREO (Offline REasoning Optimization): An Offline Reinforcement Learning Method for Enhancing LLM Multi-Step Reasoning
    Large Language Models (LLMs) have demonstrated impressive proficiency in numerous tasks, but their ability to perform multi-step reasoning remains a significant challenge. This limitation becomes particularly evident in complex scenarios such as mathematical problem-solving, embodied agent control, and web navigation. Traditional Reinforcement Learning (RL) methods, like Proximal Policy Optimization (PPO), have been applied to address this issue but often come with high computational and data costs, making them less practical. Likewise, methods such as Direct Preference Optimization (DPO), while effective for aligning models with human preferences, struggle with multi-step reasoning tasks. DPOs reliance on pairwise preference data and uniform token treatment undermines its capacity to assign credit effectively in situations with sparse rewards. These obstacles highlight the need for more targeted and efficient solutions to enhance LLM reasoning capabilities.Introducing OREO: Offline Reasoning OptimizationOREO (Offline REasoning Optimization) is an offline RL approach specifically designed to address the shortcomings of existing methods in improving multi-step reasoning for LLMs. Developed collaboratively by researchers from UC San Diego, Tsinghua University, Salesforce Research, and Northwestern University, OREO builds on insights from maximum entropy reinforcement learning. It trains a policy model and a value function concurrently by optimizing the soft Bellman Equation. This methodology removes the dependency on pairwise preference data, making it possible to utilize unpaired datasets with sparse rewards. Furthermore, OREO enables precise credit assignment across reasoning trajectories, which is especially beneficial when success depends on a few critical steps. The framework can also be extended to iterative exploration setups and incorporates a learned value function to enhance inference through tree search during testing.Technical Details and BenefitsOREOs core innovation lies in optimizing the soft Bellman Equation to simultaneously train policy and value models. This strategy ensures accurate credit assignment across reasoning steps, addressing the limitations of methods like DPO. Additionally, OREO offers step-level and response-level objectives, providing flexibility for different granularities of reasoning tasks. During test-time inference, the value function supports advanced search techniques, such as beam search, improving accuracy. Unlike baseline methods like supervised fine-tuning (SFT) or rejection sampling, OREO excels at leveraging failed trajectories to enhance model robustness and adaptability. This capacity to learn from failures makes it particularly valuable for iterative multi-step reasoning tasks.Results and InsightsOREOs performance has been rigorously evaluated on benchmarks such as GSM8K and MATH for mathematical reasoning, and ALFWorld for embodied agent control. Key findings include:On GSM8K, OREO delivered a 5.2% relative improvement in accuracy using a 1.5B parameter model compared to SFT, alongside a 10.5% improvement on MATH.52.5% on MATH with 1.5B LLM (w/o using augmented problem set)In ALFWorld, OREO achieved a 17.7% relative improvement in performance in unseen environments, underscoring its ability to generalize beyond training data.Iterative training further amplified OREOs effectiveness, showing consistent accuracy gains over multiple iterations. While approaches like rejection sampling exhibited diminishing returns, OREO continued to improve by incorporating insights from failed attempts. Test-time search using OREOs value function resulted in up to a 17.9% relative improvement over greedy decoding on the MATH dataset, highlighting its impact on inference quality.ConclusionOREO provides a practical and effective solution for enhancing multi-step reasoning in LLMs through offline RL. By addressing the limitations of existing approaches, it offers a scalable method for improving reasoning capabilities. Its integration of detailed credit assignment, iterative training, and test-time search makes it a versatile tool for addressing complex reasoning challenges. The results demonstrate OREOs potential for application across a range of domains requiring sophisticated problem-solving, contributing to the evolution of AI systems capable of deeper reasoning.Check out the Paper. All credit for this research goes to the researchers of this project. Also,dont forget to follow us onTwitter and join ourTelegram Channel andLinkedIn Group. Dont Forget to join our60k+ ML SubReddit. Asif RazzaqAsif Razzaq is the CEO of Marktechpost Media Inc.. As a visionary entrepreneur and engineer, Asif is committed to harnessing the potential of Artificial Intelligence for social good. His most recent endeavor is the launch of an Artificial Intelligence Media Platform, Marktechpost, which stands out for its in-depth coverage of machine learning and deep learning news that is both technically sound and easily understandable by a wide audience. The platform boasts of over 2 million monthly views, illustrating its popularity among audiences. [Download] Evaluation of Large Language Model Vulnerabilities Report (Promoted)
    0 Comments 0 Shares 14 Views