Access to high-quality textual data is crucial for advancing language models in the digital age. Modern AI systems rely on vast datasets of token trillions to improve their accuracy and efficiency. While much of this data is from the internet, a significant portion exists in formats such as PDFs, which pose unique challenges for content extraction. Unlike web pages, which are structured for easy parsing, PDFs prioritize visual layout over logical text flow, making it difficult to extract coherent textual representations. Traditional optical character recognition (OCR) tools have attempted to address these challenges, but their limitations have hindered large-scale adoption in language model training.A main issue with PDF processing is that these documents store information optimally for visual presentation rather than logical reading order. Many PDFs encode text at the character level, recording each letters position and font attributes without preserving sentence structure. This makes it difficult to reconstruct a coherent narrative in multi-column layouts or documents with embedded tables, images, and equations. Also, scanned PDFs introduce additional challenges, as they contain text in image format rather than machine-readable characters. Extracting structured and meaningful content from such documents requires specialized tools to understand textual and visual elements.Several approaches have previously been developed to tackle the problem of extracting text from PDFs. Early OCR technologies like Tesseract provided basic character recognition but struggled with complex layouts. More recent methods include pipeline-based systems, which combine extraction into multiple machine-learning tasks, such as section segmentation and table recognition. These include tools like Grobid and VILA, which are designed for scientific papers. On the other hand, end-to-end models like Nougat and GOT Theory 2.0 attempt to convert entire PDF pages into readable text using deep learning. However, many systems are expensive, unreliable, or inefficient for large-scale applications.Researchers at the Allen Institute for AI introduced olmOCR, an open-source Python toolkit designed to efficiently convert PDFs into structured plain text while preserving logical reading order. This toolkit integrates text-based and visual information, allowing for superior extraction accuracy compared to conventional OCR methods. The system is built upon a 7-billion-parameter vision language model (VLM), which has been fine-tuned on a dataset of 260,000 PDF pages collected from over 100,000 unique documents. Unlike traditional OCR approaches, which treat PDFs as mere images, olmOCR leverages the embedded text and its spatial positioning to generate high-fidelity structured content. The system is optimized for large-scale batch processing, enabling cost-efficient conversion of vast document repositories. One of its most notable advantages is its ability to process one million PDF pages for just $190 USD, 32 times cheaper than GPT-4o, where the same task would cost $6,200 USD.The core innovation behind olmOCR is document anchoring, a technique that combines textual metadata with image-based analysis. Unlike end-to-end OCR models that rely solely on rasterized images, this method extracts textual elements directly from the PDFs embedded data. It aligns them with their corresponding visual representations. This enhances the models ability to recognize complex document structures, reducing errors and improving overall readability. The extracted content is formatted using Markdown, preserving structured elements like headings, lists, tables, and equations. Also, the system employs fine-tuning techniques to improve extraction accuracy, utilizing a dataset curated specifically for diverse document layouts. The model training process involved 10,000 optimization steps, using a four-batch size and an adaptive learning rate of 1e-6. olmOCR has been designed to operate seamlessly with inference frameworks such as vLLM and SGLang.The system achieves an alignment score of 0.875 with its teacher model, surpassing smaller-scale models like GPT-4o Mini. In direct comparison with other OCR tools, olmOCR consistently outperforms competitors in accuracy and efficiency. When subjected to human evaluation, the system received the highest ELO rating among leading PDF extraction methods. Also, when olmOCR-extracted text was used for mid-training on the OLMo-2-1124-7B language model, it resulted in an average accuracy improvement of 1.3 percentage points across multiple AI benchmark tasks. Specific performance gains were observed in datasets such as ARC Challenge and DROP, where olmOCR-based training data contributed to notable improvements in language model comprehension.Several Key Takeaways from the Research on olmOCR include:olmOCR is built on a 7-billion-parameter vision-language model and fine-tuned on 260,000 pages from 100,000 PDFs, ensuring robust extraction across diverse document types.Utilizes document anchoring to combine textual metadata with image-based information, significantly improving the extraction accuracy for structured content.Processes one million PDF pages for just $190, compared to $6,200 using GPT-4o, making it 32 times more cost-efficient for large-scale applications.Achieves an alignment score of 0.875, surpassing smaller models and demonstrating superior accuracy in reconstructing logical reading order.It outperforms traditional OCR tools in structured data recognition and large-scale processing and has the highest ELO score in human evaluations.Improves language model training by increasing accuracy by 1.3 percentage points on AI benchmark datasets like ARC Challenge and DROP.Compatible with inference engines like vLLM and SGLang, allowing flexible deployment on various hardware setups.Check outthe Training and toolkit code and Hugging Face collection.All credit for this research goes to the researchers of this project. Also,feel free to follow us onTwitterand dont forget to join our80k+ ML SubReddit. Asif RazzaqWebsite| + postsBioAsif Razzaq is the CEO of Marktechpost Media Inc.. As a visionary entrepreneur and engineer, Asif is committed to harnessing the potential of Artificial Intelligence for social good. His most recent endeavor is the launch of an Artificial Intelligence Media Platform, Marktechpost, which stands out for its in-depth coverage of machine learning and deep learning news that is both technically sound and easily understandable by a wide audience. The platform boasts of over 2 million monthly views, illustrating its popularity among audiences.Asif Razzaqhttps://www.marktechpost.com/author/6flvq/DeepSeek AI Releases DeepGEMM: An FP8 GEMM Library that Supports both Dense and MoE GEMMs Powering V3/R1 Training and InferenceAsif Razzaqhttps://www.marktechpost.com/author/6flvq/Convergence Releases Proxy Lite: A Mini, Open-Weights Version of Proxy Assistant Performing Pretty Well on UI Navigation TasksAsif Razzaqhttps://www.marktechpost.com/author/6flvq/DeepSeek AI Releases DeepEP: An Open-Source EP Communication Library for MoE Model Training and Inference Recommended Open-Source AI Platform: IntellAgent is a An Open-Source Multi-Agent Framework to Evaluate Complex Conversational AI System' (Promoted)

Comparing language models effectively requires a systematic approach that combines standardized benchmarks with use-case specific testing. This guide walks you through the process of evaluating LLMs to make informed decisions for your projects.Table of contentsStep 1: Define Your Comparison GoalsBefore diving into benchmarks, clearly establish what youre trying to evaluate: Key Questions to Answer:What specific capabilities matter most for your application?Are you prioritizing accuracy, speed, cost, or specialized knowledge?Do you need quantitative metrics, qualitative evaluations, or both?Pro Tip: Create a simple scoring rubric with weighted importance for each capability relevant to your use case.Step 2: Choose Appropriate BenchmarksDifferent benchmarks measure different LLM capabilities:General Language UnderstandingMMLU (Massive Multitask Language Understanding)HELM (Holistic Evaluation of Language Models)BIG-Bench (Beyond the Imitation Game Benchmark)Reasoning & Problem-SolvingGSM8K (Grade School Math 8K)MATH (Mathematics Aptitude Test of Heuristics)LogiQA (Logical Reasoning)Coding & Technical AbilityHumanEval (Python Function Synthesis)MBPP (Mostly Basic Python Programming)DS-1000 (Data Science Problems)Truthfulness & FactualityTruthfulQA (Truthful Question Answering)FActScore (Factuality Scoring)Instruction FollowingAlpaca EvalMT-Bench (Multi-Turn Benchmark)Safety EvaluationAnthropics Red Teaming datasetSafetyBenchPro Tip: Focus on benchmarks that align with your specific use case rather than trying to test everything.Step 3: Review Existing LeaderboardsSave time by checking published results on established leaderboards:Recommended LeaderboardsStep 4: Set Up Testing EnvironmentEnsure fair comparison with consistent test conditions:Environment ChecklistUse identical hardware for all tests when possibleControl for temperature, max tokens, and other generation parametersDocument API versions or deployment configurationsStandardize prompt formatting and instructionsUse the same evaluation criteria across modelsPro Tip: Create a configuration file that documents all your testing parameters for reproducibility.Step 5: Use Evaluation FrameworksSeveral frameworks can help automate and standardize your evaluation process:Popular Evaluation FrameworksFrameworkBest ForInstallationDocumentationLMSYS Chatbot ArenaHuman evaluationsWeb-basedLinkLangChain EvaluationWorkflow testingpip install langchain-evalLinkEleutherAI LM Evaluation HarnessAcademic benchmarkspip install lm-evalLinkDeepEvalUnit testingpip install deepevalLinkPromptfooPrompt comparisonnpm install -g promptfooLinkTruLensFeedback analysispip install trulens-evalLinkStep 6: Implement Custom Evaluation TestsGo beyond standard benchmarks with tests tailored to your needs:Custom Test CategoriesDomain-specific knowledge tests relevant to your industryReal-world prompts from your expected use casesEdge cases that push the boundaries of model capabilitiesA/B comparisons with identical inputs across modelsUser experience testing with representative usersPro Tip: Include both expected scenarios and stress test scenarios that challenge the models.Step 7: Analyze ResultsTransform raw data into actionable insights:Analysis TechniquesCompare raw scores across benchmarksNormalize results to account for different scalesCalculate performance gaps as percentagesIdentify patterns of strengths and weaknessesConsider statistical significance of differencesPlot performance across different capability domainsStep 8: Document and Visualize FindingsCreate clear, scannable documentation of your results:Documentation TemplateStep 9: Consider Trade-offsLook beyond raw performance to make a holistic assessment:Key Trade-off FactorsCost vs. performance is the improvement worth the price?Speed vs. accuracy do you need real-time responses?Context window can it handle your document lengths?Specialized knowledge does it excel in your domain?API reliability is the service stable and well-supported?Data privacy how is your data handled?Update frequency how often is the model improved?Pro Tip: Create a weighted decision matrix that factors in all relevant considerations.Step 10: Make an Informed DecisionTranslate your evaluation into action:Final Decision ProcessRank models based on performance in priority areasCalculate total cost of ownership over expected usage periodConsider implementation effort and integration requirementsPilot test the leading candidate with a subset of users or dataEstablish ongoing evaluation processes for monitoring performanceDocument your decision rationale for future reference NikhilNikhil is an intern consultant at Marktechpost. He is pursuing an integrated dual degree in Materials at the Indian Institute of Technology, Kharagpur. Nikhil is an AI/ML enthusiast who is always researching applications in fields like biomaterials and biomedical science. With a strong background in Material Science, he is exploring new advancements and creating opportunities to contribute.Nikhilhttps://www.marktechpost.com/author/nikhil0980/Researchers from Moonshot AI Introduce Muon and Moonlight: Optimizing Large-Scale Language Models with Efficient Training TechniquesNikhilhttps://www.marktechpost.com/author/nikhil0980/This AI Paper from Menlo Research Introduces AlphaMaze: A Two-Stage Training Framework for Enhancing Spatial Reasoning in Large Language ModelsNikhilhttps://www.marktechpost.com/author/nikhil0980/Getting Started with GitHub: Upload, Clone, and Create a READMENikhilhttps://www.marktechpost.com/author/nikhil0980/Getting Started with Google Colab: A Beginners Guide to Free Cloud Computing Recommended Open-Source AI Platform: IntellAgent is a An Open-Source Multi-Agent Framework to Evaluate Complex Conversational AI System' (Promoted)

LatestMachine LearningBeyond the API 0 like February 26, 2025Share this postAuthor(s): Vita Haas Originally published on Towards AI. Lets bust a myth right off the bat: building AI chatbots isnt just about hooking up to an API and calling it a day. Oh, how I wish it were that simple! Ive watched too many bright-eyed developers learn this lesson the hard way.Photo by Arian Darvishi on UnsplashPicture this: Youve cobbled together a nifty little chatbot over the weekend. It works beautifully when you demo it to your friends. Fast forward to launch day youve got a hundred users hammering your creation, and suddenly your sleek AI assistant transforms into a stuttering mess of error messages and timeout warnings.Welcome to the school of hard knocks, where works on my machine meets the brutal reality of production.Just Call the API A Recipe for DisasterI once mentored a startup founder who insisted his teams architecture was fine. Look, its just pinging OpenAIs API how complicated could it get? Six hours after their product hunt launch, I got a panicked call. Their system was crumbling under the weight of wait for it just 87 concurrent users.The typical rookie setup goes something like this:The user types something straight into OpenAIs APIThe response comes back straight to the userEvery single message dumped into your databaseSeems logical enough, right? And it is until it absolutely isnt. Heres why this house of cards tumbles:Rate limits will bite you in the rear OpenAI doesnt care about your launch day. Hit their request cap, and your users start seeing those lovely rate limit exceeded messages.Your database turns into molasses Try writing every message in real-time with a few hundred chatty users. Watch your once-zippy database transform into a bottleneck of epic proportions.Your server gasps for air Without some breathing room between requests, your backend starts resembling a marathon runner at mile 25 technically moving but ready to collapse at any second.Its like trying to funnel Niagara Falls through a garden hose. Sure, water moves through a hose just fine until youre dealing with Niagara Falls.Building Something That Wont Collapse Under Its Own WeightA real system that can handle the chaos of actual users isnt rocket science, but it does require a bit more thought than API go brrrr. Here are some thoughts:Message Queues (Your Traffic Cop) Instead of letting requests flood your system like Black Friday shoppers, a queue (using RabbitMQ, Kafka, or even Redis Streams) creates order from chaos. Each message waits its turn patiently.Caching (Your Memory Upgrade) Why ask the same question twice? If your bot gets asked Whats your name? fifty times an hour, store that response! Your users get snappier responses, and your API bill gets smaller. Win-win.Load Balancing (Your Traffic Director) When youre handling serious traffic, one server just wont cut it. Load balancers spread the love across multiple servers, making sure no single machine bears the full brunt of user enthusiasm.Batch Database Writing (Your Efficiency Expert) Instead of frantically scribbling down every message as it arrives, jot notes in your short-term memory (Redis), then transfer them to your permanent record (database) in neat batches. Your database will thank you.Rate Limiting (Your Bouncer) Some users will hammer your system with requests sometimes maliciously, sometimes just because theyre impatient. A good rate limiter keeps the eager beavers from ruining the experience for everyone else.With these pieces in place, magic happens. Suddenly, 1,000 users feel like a normal Tuesday, not a five-alarm fire. Your database purrs contentedly instead of screaming in agony. Users get responses in milliseconds, not eventually.When Things Get Really Serious: MicroservicesAs your user base grows from hundreds to thousands to millions, you might need to break things up a bit. Microservices let you split your monolithic application into specialized parts:One service just for handling chat messagesAnother focused solely on database operationsA third managing user sessions and contextIts like upgrading from a Swiss Army knife to a full toolbox each tool does one job really well instead of many jobs adequately.But hold your horses microservices bring their own headaches. Debugging across services can feel like hunting for a needle in a haystack while the haystack is spread across multiple farms. Dont jump to microservices just because it sounds fancy. If your monolith is handling the load, stick with it.When the Queue Gets Too Long: Advanced TacticsEven with a queue in place, what happens when too many people show up to the party? Users hate waiting (shocking, I know). Heres how the big players handle the crush:Priority lanes Just like theme parks, some queries get to skip ahead (billing questions jump past general chit-chat)Divide and conquer Split your processing across multiple worker nodesCrystal ball scaling Study your traffic patterns and scale up before the rush, not during itSpeed Demon OptimizationsFor the performance obsessed (you know who you are), here are some tricks to squeeze every last drop of speed from your system:Ditch bloated JSON for Protocol Buffers its like compressing your messages before sending themSqueeze your data with actual compression smaller payloads mean faster transfersKeep connections open instead of constantly reconnecting its the difference between leaving the door ajar versus knocking every timeEach optimization might only save milliseconds, but those milliseconds add up when youre handling thousands of messages per minute.The Million-User QuestionCan your system handle 10x your current traffic without major changes? If youre breaking a sweat just thinking about it, youve got work to do.Try this little exercise: Take your basic setup, add a queue, slap on some caching, batch those database writes, and watch what happens. The difference will blow your mind and potentially save your launch day.The Hard TruthLook, I get it. When youre racing to build your AI application, architecture feels like tomorrows problem. But take it from someone whos seen the just an API call approach implode spectacularly planning for scale isnt optional, its essential.Next time someone tells you to just use the API, smile politely and remember: the difference between a toy and a tool isnt the idea its the infrastructure. Your users wont care about your clever prompts if theyre staring at timeout errors.Build it right. Your future self (and your users) will thank you.Join thousands of data leaders on the AI newsletter. Join over 80,000 subscribers and keep up to date with the latest developments in AI. From research to projects and ideas. If you are building an AI startup, an AI-related product, or a service, we invite you to consider becoming asponsor. Published via Towards AITowards AI - Medium Share this post

For a limited time, you can pick up a digital copy of The Wild Robot in 4K UHD at Amazon for only $4.99. That's 75% of the normal list price of $19.99 and the same cost as renting it. If you haven't yet watched this movie, you're missing out. This is a fantastic film for movie watchers of all ages and a worthy addition to your digital library.The Wild Robot (4K UHD) for $5The Wild Robot (4K UHD Digital)The Wild Robot is a 2024 DreamWorks animated movie about a robot named Roz who embarks on a journey of self-discovery and meets a bunch of eccentric animals along the way. This movie is great for both adults and kids alike (it's rated PG) and has been favorably reviewed by most critics. This movie was nominated for four Golden Globes and is currently nominated for three Oscars, including Best Animated Feature.The Wild Robot Review by Siddhant Adlakha"The Wild Robot finds humanity in unexpected places, via its story of adoption and veering off the path others have laid for us. Lupita Nyong'o's Roz is a wonderfully imagined machine, who expresses herself through "tasks" like motherhood and protection, as she raises an orphaned gosling (Kit Connor) to spread his wings and leave the nest. Despite feeling rushed at times, its dazzling, tear-jerking moments put it metallic-shoulder-to-metallic-shoulder with classics like WALL-E and The Iron Giant."This is a pretty deep discount for a relatively recent movie release and I don't expect this deal to last too much longer. The sale started on February 25 at a discounted price of $10, so the extra 50% off on top of that comes as a welcome surprise. If you're interested in adding this great family flick to your library, then don't hesitate.The Wild Robot and More Physical Releases Also on SalePrefer to buy physical? Right now, you can also save 40% on the Collector's Edition of the The Wild Robot. Feel free to scroll through Amazon's current Blu-ray deals to check out all the discounts. The Wild RobotSee it at AmazonWickedSee it at AmazonTransformers OneSee it at AmazonEverything Everywhere All At OnceSee it at AmazonNosferatuSee it at AmazonThe SubstanceSee it at AmazonWhy Should You Trust IGN's Deals Team?IGN's deals team has a combined 30+ years of experience finding the best discounts in gaming, tech, and just about every other category. We don't try to trick our readers into buying things they don't need at prices that aren't worth buying something at. Our ultimate goal is to surface the best possible deals from brands we trust and our editorial team has personal experience with. You can check out our deals standards here for more information on our process, or keep up with the latest deals we find on IGN's Deals account on Twitter.Eric Song is the IGN commerce manager in charge of finding the best gaming and tech deals every day. When Eric isn't hunting for deals for other people at work, he's hunting for deals for himself during his free time.

2025 is shaping up to be a huge year for DC Comics, and perhaps no upcoming project is bigger than the long-awaited Batman: Hush 2. It's not every day that DC's President, Publisher, and Chief Creative Officer Jim Lee takes the reins of a monthly Batman comic. Kicking off in March's Batman #158, this storyline acts as a direct sequel to the critically acclaimed Hush saga that originally ran from 2002 to 2004.DC has released a new extended preview of Batman #158, along with an early look at Batman #159 and a glimpse of the many variant covers appearing as part of Hush 2 (or H2sh, if you prefer). Check it all out in the slideshow gallery below:Batman: Hush 2 Preview GalleryWhile DC has published several Hush-centric storylines in the years since the original wrapped, Batman: Hush 2 is the first to be handled by the original creative team. Hush 2 reunites writer Jeph Loeb and artist Jim Lee, along with inker Scott Williams, colorist Alex Sinclair, and letterer Richard Starkings.Hush 2 builds on the recent epilogue story printed in Batman: Hush 20th Anniversary Edition. The Dark Knight has discovered proof that his childhood friend Tommy Elliot survived their final battle, paving the way for a new mystery as Hush manipulates the Dark Knight's circle of allies and enemies.Hush 2 will be published in the pages of Batman #158-163, with issue #158 hitting stores on March 26. We recently learned that DC will then relaunch the series with a new #1 issue and new costume, as writer Matt Fraction and artist Jorge Jimenez begin a new era for the Dark Knight.PlayFor more on DC's upcoming slate, check out what to expect from DC in 2025 and see our most anticipated comics of 2025.Jesse is a mild-mannered staff writer for IGN. Allow him to lend a machete to your intellectual thicket byfollowing @jschedeen on BlueSky.

For better or for worse, Kathleen Kennedy is often the one ultimately held responsible for the highs and lows of this era of Star Wars. The sequel trilogy she shepherded introduced a new generation to a galaxy far, far away while still giving longtime fans a (mostly) fulfilling end to this saga. And yet in the nearly six years since that saga ended with Star Wars Episode IX: The Rise of Skywalker, Lucasfilm has struggled to figure out its next chapter on the big screen. With Kathleen Kennedys rumored exit from Lucasfilm, it doesnt seem likely that these struggles will resolve themselves anytime soon.A number of films from an impressive slate of filmmakers have been announced over the years. Creatives like Taika Waititi, Patty Jenkins, Rian Johnson, Kevin Feige, and more all elected to throw their hats in the ring to mold their own corner of the Star Wars universe. And yet, nearly all of them have been scrapped or reworked in one way or another. The only Star Wars film to make it from conception to production in the last six years is the upcoming The Mandalorian & Grogu.As far as we know, James Mangolds currently titled Dawn of the Jedi and the upcoming Rey solo film New Jedi Order (directed by Sharmeen Obaid-Chinoy) are still moving forward. But with the writer shake ups that New Jedi Order has already faced, a change in leadership doesnt bode well for either of these projects.No matter who takes Kennedys place, they are likely going to have their own vision for how Star Wars should move forward. Whether or not current projects fit into that vision is still to be determined. Its doubtful that Dave Filoni and Jon Favreaus ever-expanding Mando-verse is in jeopardy. The New Republic era has so far proven to be popular and lucrative for the franchise its nearly impossible to enter any kind of big name store nowadays without seeing at least one Grogu-themed item.This isnt necessarily a bad thing. Theres a lot of fun to be had in the New Republic era. But at the same time, theres not really a lot of envelope pushing happening here.With the number of film projects that have been outright canceled over the last few years, Lucasfilm is already coming across as unsure of their own future. They dont seem to know what they want Star Wars to be outside of Filonis sandbox.However, it feels almost cruel to put all of the blame for this confused era of Star Wars solely on Kennedy. Shes had to push through a lot of road blocks over the last six years, from COVID-19 shutting things down to the SAG-AFTRA and WGA work stoppages of 2023 also shutting productions down to Disney leadership changes to increasingly loud internet personalities claiming that Star Wars has suddenly become woke as if the entire franchise isnt about fighting against a fascist regime.Whoever takes Kennedys place has a lot of work to do to figure out what Star Wars films should be outside of the Skywalker Saga. Hopefully the next era isnt just a bunch of nostalgia or money grabs, but well believe it when we see it.

SummaryOne of the lead developers for Undermine(d) joins us to talk about the latest chapter for World of Warcraft.This new city is unlike any weve seen before in Azeroth, bustling with life, with streets made for speed!Find out more about how youll drive and drift around city streets in brand new hot rods.Imagine taking New York and smashing it into a steampunk vibe where safety doesnt matter. Thats the feeling you get when you step into Undermine, the new zone that went live this week in World of Warcraft. I had the pleasure of leading this zones design alongside my super talented teammates on the WoW team and Id love to tell you more about this never-before-seen goblin city and its wild, driveable vehicles.Deep Dive, Then D.R.I.V.E.Adding a dynamic twist to the World of Warcraft experience, this new update introduces the D.R.I.V.E. feature, also known as our Dynamic and Revolutionary Improvement to Vehicular Experiences (we took that acronym and manifested it into that mouthful, youre welcome! Its sick).This new feature allows players to travel on the ground with a mechanically intriguing G-99 Breakneck otherwise known as WoWs take on a hot rod. You will unlock this car pretty early while questing complete Eyes from Above in the main campaign, then accept No More Walkin Here and progress through the Breaknecks tutorial. The design philosophy behind these vehicles is rooted in the art style of World of Warcraft goblins, where everything looks cobbled together yet oddly ingenious. The G-99 Breakneck has exaggerated featureslike massive flames shooting from the scoopwhich fit perfectly within the chaotic streets of Undermine.One of the key aspects we wanted to bring to this feature was the ability to drift, which is a classic mechanic in older racing games. Bringing this to World of Warcraft was a challenge, but it ignited excitement across the team. Our goal was to capture that feeling of freedom and control, akin to the sensation of getting your first car and the newfound access it brings.The car isnt just for getting around; its also a passenger mount, allowing friends to join in and explore the streets of Undermine together. Players can participate in races, testing their skills on both regular and reverse courses. For those who might get motion sick or find the speed too much, weve ensured that the experience is accessible, offering options to customize with a lower top-speed engine immediately after unlocking the car, or to use regular ground mounts insteadwhichever you prefer.Take to the StreetsBut your new car would be nothing without somewhere interesting to drive it. In Undermine, youll see these cars racing around you, providing both a vibrant backdrop to your adventures and an invitation to join in the chaos. Tasks like delivering hot towels, or fighting a ghostly tiger that is rudely scaring children, allow you to become a true part of the fabric of the city.As you can probably tell, Undermine is full of life. As you drift your car around the streets (above sewers with fighting rings in them!), you will encounter pirates, mobsters, people who want to break your ankles, the best cooks youve ever met, and so much more.Beneath Undermines false sky is a city that bustles with energy, a hub of commerce and culture for goblins. This diverges from the usual city landscapes youd see in World of Warcraftthis is a densely populated city thats very much lived in, bustling with life as people go about their day-to-day business.The zone itself is a testament to the possibility of more. With features like Slam Central Station, which can take you anywhere your imagination permits, Undermine stands as a beacon of goblin ingenuity and ambition. The city is filled with cleverly named landmarks like the Incontinental Hotel and the Gallagio, reflecting a unique society driven by growth.The narrative of Undermine is all about bettering ones circumstances. It ties into the main storyline of The War Within, with characters like Orweyna introducing players to the Ringing Deeps and the initial chapters of the story. Youll meet (or be reintroduced to, if youve played in the past) characters like Renzik and Gazlowe, who provide a window into the lives of those who call Undermine home. While some characters, like Gazlowe, left to find something different, others see Undermine as their homefor some, theres anywhere but home. For others, theres no place like home.As the story unfolds, Gazlowe undergoes a change of heart, leading to a revolution where players can take down dictators and liberate the streets. This narrative of reclaiming the city highlights the power of the people over oppressive forces.Join us in Undermine, a city of fast wheels and dark deals. It doesnt matter if you drift an inch or a yard, driftings drifting!The Undermine(d) update is live now in World of Warcraft, available on PC via Battle.net. To learn more, visit WorldOfWarcraft.com.

As we gear up for the Game Developers Conference (GDC) 2025, we couldnt be more excited to meet up with our friends and colleagues in the industry and explore the many incredible new opportunities that await us, together. This year, GDC takes place from March 17-21 at the Moscone Convention Center in San Francisco, California. We will host partner meetings, participate in conference sessions, sponsor events like the IGF Awards and the ESA Foundations Nite to Unite.As Xbox expands to any screen on any device, were opening doors and making it easier for anyone to play with any friends they want whether they choose to play with Xbox console, PC, Smart TV or mobile. At GDC, were inviting game developers to go behind the scenes to better understand the significance and impact of what it means for Xbox to be on every screen. We're committed to empowering game developers to tap into that opportunity by building games that take advantage of Xbox across devices. Our presence at GDC 2025 will reveal the many ways game developers can reach more players with Xbox and showcase success stories of developers who are maximizing the opportunity.One of the highlights of this year's GDC will be our sessions and demos of AI for Gaming. These sessions will provide valuable insight and inspiration for developers looking for ways to make their games more easily discoverable, more engaging and to help their teams do more real-time experimentation and visualization, more easily.Microsoft Gaming AI Sessions at GDC 2025The Future of Gaming Supported by AI: How Xbox is Empowering Players and Creators (Presented by Microsoft)Speaker: Fatima Kardar (Microsoft), Sonali Yadav (Microsoft)Date: Monday, March 17Time: 9:30am - 10:30amLocation: Room 3011, West HallDiscover how Xbox is using AI to unlock new opportunities across the Xbox ecosystem for both players and game creators. This session provides an overview of Xbox's AI vision and a sneak peek of cutting-edge AI technology across the platform that will enhance player experiences and support game development for creators. Learn about innovative features that will help players discover their new favorite games, deliver personalized support, and get an exclusive preview of upcoming AI-powered tools and services designed to enrich gaming experiences on Xbox. Whether you're a player, developer, or industry enthusiast, this session offers a glimpse into the future of gaming supported by AI.AI Innovation for Game Experiences: From Research to Prototyping (Presented by Microsoft)Speaker: Haiyan Zhang (Xbox), Katja Hofmann (Microsoft)Date: Monday, March 17Time: 10:50am - 11:50amLocation: Room 3011, West HallHow can AI drive the next wave of dynamic and immersive game experiences? In this panel, game developers and researchers come together to discuss the cutting-edge AI techniques being explored and prototyped to enhance player experiences and support developer creativity. From adaptive gameplay systems to new tools for game creators, this session dives into the intersection of research and product experimentation. Panelists will showcase prototypes and share insights into how AI can, with the guidance of game creators and players, push the boundaries of what's possible in gaming. This exploratory conversation is for anyone curious about how AI is shaping the future of game development.Machine Learning Summit: Fitting Armor Assets in World of Warcraft with Deep LearningSpeaker: Zhen Zhai (Blizzard Entertainment)Date: Monday, March 17Time: 5:30pm - 6:00pmLocation: Room 3018, West HallThis talk will introduce Deepforge, a deep neural network designed to transform armor pieces for various races in World of Warcraft (WoW). This technology drastically reduces the time required for artists to fit 3D armors from days and weeks to mere minutes. By automating the fitting process, our tool empowers artists to focus more on fine-tuning the details and enhancing the quality of their work. We will explore the model design, training, and deployment, showcasing its unique features and practical applications on mesh fitting for WoW. The primary goal for this project is to ensure high-quality mesh generation suitable for production use, from preprocessing to postprocessing, combined with a robust infrastructure for efficient and reliable model performance. Attendees will gain insights into how Deepforge enhances game asset creation, making it a valuable tool for developers.AI Executive Panel: Exploring What's Next in AI for Gaming (Presented by EPAM)Speaker: Stef Corazza (Roblox) Vitalli Vashchuk (EPAM) Haiyan Zhang (Xbox), Craig Nowell, DatabricksDate: Wednesday, March 19Time: 10:30am - 11:30amLocation: Room 2020, West HallAt GDC 2024, EPAM brought together industry leaders to discuss the future of AI in gaming. Continuing the conversation, we will be exploring the role AI has played and what's to come. In this executive panel we will discuss the practical use cases for developers, creators and players alike. Learn how AI can influence gameplay experience and developers' productivity along with the associated benefits and potential hurdles of utilizing this evolving technology. Hear from gaming experts as they share exclusive insights and actionable takeaways from their hands-on experiences with generative AI. This session offers a glimpse into the future of game development and the real-world impact it will have in 2025.Inclusive Gaming AI: Red Teaming for Accessibility and DisabilitySpeaker: Brannon Zahand (Microsoft)Date: Thursday, March 20Time: 11:00am - 12:00pmLocation: Room 3005, West HallArtificial Intelligence (AI) has the potential to improve gaming for everyone. This is especially true for those of us in the gaming and disability community. However, without proper design, development, and testing of AI gaming experiences, it can create new barriers for gamers with disabilities. Unfortunately, applying traditional techniques for developing and testing accessible content is not sufficient in these cases. As such, this talk will discuss how designers, testers, and accessibility subject matter experts can utilize red teaming to create inclusive AI experiences in games and gaming services. It will discuss what red teaming is, why it is extra important when it comes to creating accessible and enjoyable experiences for gamers with disabilities, numerous strategies to prevent and catch a myriad of issues that could impact them, and how to engage the gaming and disability community to help you validate such experiences.Amplifying Player Voices with LLMs in Game DevelopmentSpeaker: Joshua Koen (Blizzard Entertainment), Ian Livingston (Blizzard Entertainment)Date: Thursday, March 20Time: 1:30pm - 2:00pmLocation: Room, 2010, West HallOur players dedicate tens, hundreds, or even thousands of hours to the experiences that we craft for them. Players have valuable feedback about how we can improve those experiences, but it can be challenging for developers to quickly parse vast amounts of feedback and identify ways to improve experiences. The presenters will explore the benefits and risks of using Large Language Models (LLMs) for analyzing player feedback. LLMs offer a way to efficiently analyze feedback at depth and scale that has not been previously possible. However, there are dangers of producing incorrect outcomes that are easy to overlook without a careful approach. Prompt structure, game terminology, and data complexity can easily trip up LLMs. The session will present ways that Blizzard has been validating the use of LLMs for this type of analysis. We will illustrate workflows for using LLMs to enhance processes for analyzing feedback from players.How to Engage with Us at GDC 2025For us, GDC 2025 is as much about showcasing the Xbox developer experience as it is about fostering collaboration with partners and driving our shared gaming future. We're excited to connect, demystify our vision, and explore new possibilities together. If you are attending GDC in person, whether you're an indie developer, a seasoned professional, or someone passionate about the gaming industry, weve got a line-up of sessions for everyone. If you will be engaging remotely, you can learn more about development and publishing decisions that maximize the full Xbox opportunity by visiting our Game Development Resource Hub here and to learn more about AI for Gaming, check out our Gaming AI Resource Hub here. If you have immediate questions or want to connect with other developers building for Xbox, join our Discord here.Heres a selection of additional conference talks featuring speakers from across Xbox:Monday, March 17UX Summit: UX Writing: A New(ish) Craft in Mobile GamesSpeaker: Patricia Gomez (King)Date: Monday, March 17Time: 9:30am - 10:30amLocation: Room 2010, West HallCommunity Management Summit: Social Media Microtalks: Authenticity from You and the Business WeSpeaker: Cindy Tran (Obsidian Entertainment), Antonio Cara (DeNA Corp.), Harper Jay MacIntyre (Double Fine Productions Inc), Livvy Hall (Xbox Game Studios Publishing), Megan Spurr (Microsoft)Date: Monday, March 17Time: 10:50am - 11:50amLocation: Room 2014, West HallLive Service Games Summit: Reinventing Candy Crush Soda for the Next 10 yearsSpeaker: Abigail Rindo (King), Paul Hellier (King)Date: Monday, March 17Time: 10:50am - 11:50amLocation: Room 2006, West HallAnimation Summit: 'Diablo 4': Bringing to Life the Priestess of HatredSpeaker: Chad Waldschmidt (Blizzard Entertainment)Date: Monday, March 17Time: 3:50 pm - 4:20 pmLocation: Room 2018, West HallUX Summit: Making the World Playful: The Importance of Accessible Mobile Games Speaker:Date: Monday, March 17Time: 5:30pm - 6:00pmLocation: Room 2010, West HallTuesday, March 18Live Service Games Summit: Mass Engagement Winning Strategies: The 15M Player Tournament of 'Candy Crush Saga'Speaker: Margaux Diaz (King), Roberto Kusabbi (King)Date: Tuesday, March 18Time: 9:30am - 10:30amLocation: Room 2006, West HallThriving Players Summit: Prosocial Design Workshop Speaker:Date: Tuesday, March 18Time: 9:30am - 11;50amLocation: Room 3005, West HallThe Climate Crisis WorkshopSpeaker: Grant Shonkwiler (Shonkventures LLC), Trevin York (Dire Lark), Paula Angela Escuadra (Microsoft / Xbox), Jennifer Estaris (ustwo games), Arnaud Fayolle (Ubisoft)Date: Tuesday, March 18Time: 10:00am - 6:00pmLocation: Room 204, South HallGaming Reimagined: Mobiles Impact on Play Today (Presented by King)Speaker: Todd Green (King), Paula Ingvar (King), Peiwen Yao (Blizzard Entertainment)Date: Tuesday, March 18Time: 10:50am - 11:50amLocation: Room 2000, West HallUnpacking Anti-Toxicity Strategy in "Call of Duty" (Presented by Community Clubhouse)Speaker: Mark Frumkin (Modulate), Grant Cahill (Activision)Date: Tuesday, March 18Time: 2:40pm - 3:40pmLocation: Esplanade 158, South HallLive Service Games Summit: Game Designer's NotebookSpeakers: Marta Cortias (King), Kenny Dinkin (King)Time: 2:40pm - 3:40pmLocation: Room 2006, West HallWednesday, March 19Opening a Billion Doors with Xbox (Presented by Microsoft)Speaker: Leo Olebe (Microsoft), Chris Charla (Microsoft)Date: Wednesday, March 19Time: 12:30pm - 1:30pmLocation: Room 3022, West HallAccelerating Your Inner Loop with Visual Studio and GitHub Copilot AI (Presented by Microsoft)Speaker: David Li (Microsoft), Michael Price (Microsoft)Date: Wednesday, March 19Time: 12:30pm - 1:30pmLocation: GDC Industry Stage, Expo Floor, South HallGrow Your Audience with the Updated Xbox Experience on PC (Presented by Microsoft) Speaker:Date: Wednesday, March 19Time: 2:00pm - 3:00pmLocation: GDC Industry Stage, Expo Floor, South HallMake your Game Available ANYWHERE with Xbox Cloud Gaming (Presented by Microsoft)Speaker: Harrison Hoffman (Microsoft), Jordan Cohen (Microsoft)Date: Wednesday, March 19Time: 2:00pm - 3:00pmLocation: Room 2000, West HallMasterworking Systems: Lessons Learned from the Engineering of Season of Loot Reborn in 'Diablo IV'Speaker: Patrick Ferland (Blizzard Entertainment)Date: Wednesday, March 19Time: 2:00pm - 3:00pmLocation: Room 2006, West HallAsk Game Lawyers Anything Roundtable Day 1Speaker: Ryan Black (DLA Piper (Canada) LLP), Brandon Huffman (Odin Law and Media), Angelo Alcid (Microsoft Corp.), Yan Perng (Netflix)Date: Wednesday, March 19Time: 3:30pm - 4:30pmLocation: Room 308, South HallXbox Game Studios Panel: Scaling Cross-Platform Development Across Xbox and PC (Presented by Microsoft)Speaker: Kate Rayner (Microsoft), Soren Hannibal Nielsen (Microsoft, Chuck Rozhon (Obsidion Entertainment), Chad Dawson (Double Fine Productions) Phil Cousins (Microsoft), Magnus Auvinen (Machine Games)Date: Wednesday, March 19Time: 3:30pm - 4:30pmLocation: Room 2000, West HallThursday, March 20DirectX State of the Union: Raytracing and PIX Workflows (Presented by Microsoft)Speaker: Claire Andrews (Microsoft), Austin Kinross (Microsoft)Date: Thursday, March 20Time: 9:30am - 10:30amLocation: Room 2009, West HallVFX Storytelling: How "Hearthstone" Breathes Life Into Hundreds of CardsSpeaker: Alex Cortes (Blizzard Entertainment)Date: Thursday, March 20Time: 11:00am - 12:00pmLocation: Room 2006, West HallStrategies for Indie Devs: How to Succeed with Xbox (Presented by Microsoft)Speaker: James Lewis (Microsoft)Date: Thursday, March 20Time: 11:30am - 12:30pmLocation: GDC Industry Stage, Expo Floor, South HallG.A.N.G. Demo Derby: Sound DesignSpeaker: Nick Hartman (Sound Lab), Scott Gershin (Sound Lab), Charles Deenen (Source Sound Inc), Gary Miranda (Injected Senses Audio), Brian Farr (Blizzard Entertainment)Date: Thursday, March 20Time: 12:15pm - 1:45pmLocation: Room 3018, West HallFrom Idea to Action: Lessons from a New Accessibility Initiative (Presented by The Entertainment Software Association)Speaker: Aubrey Quinn (Entertainment Software Association), Paul Amadeus Lane (Amadeus 4th Corp), Amy Lazarus (Electronic Arts), Dara Monasch (Google), Anna Waismeyer (Microsoft/Xbox), Steven Evans (Nintendo of America), David Tisserand (Ubisoft)Date: Thursday, March 20Time: 12:15pm - 1:15pmLocation: GDC Main Stage, West Hall, Street LevelWindows Productivity Tools for Game Developers (Presented by Microsoft)Speaker: Demitrius Nelon (Microsoft), Kayla Cinnamon (Microsoft)Date: Thursday, March 20Time: 12:15pm - 1:15pmLocation: Room 2024, West HallSecuring the Joy of Gaming: Xbox's Commitment to Gaming Security and Innovation (Presented by Microsoft)Speaker: Temi Adebambo (Microsoft)Date: Thursday, March 20Time: 2:00pm - 3:00pmLocation: GDC Industry Stage, Expo Floor, South HallXbox Play Anywhere Developer Roundtable (Presented by Microsoft)Speaker: Chris Charla (Microsoft)Date: Thursday, March 20Time: 2:00pm - 3:00pmLocation: Room 2004, West HallKing: Enhancing Mobile Audio with Accessibility and InclusionSpeaker: Eduardo Broseta (King)Date:Thursday, March 20Time: 2:30pm - 3:00pmLocation: Room 3024, West HallFriday, March 21Game Career Seminar: STR, DEX and INT: A Genre-Spanning Way to Think About GameplaySpeaker: Joseph Shely (Blizzard Entertainment)Date: Friday, March 21Time: 11:50am - 12:20pmLocation: Room 3005, West HallGame Career Seminar: Killer Portfolio or Portfolio Killer Part 2: Portfolio Reviews Speakers: Date: Time: Location:

Stonewhether natural or manmadeis a top choice for kitchen countertops, but with so many options and differing opinions on which countertop material is best, the decision for your own kitchen can be overwhelming. Good news: You dont have to be a gemologist to make an informed decision about which stone countertop is best for your home! Marble and quartz, two darlings of kitchen countertops, share similarities as time-tested surfaces that add value as an investment to your house. But there are five key differencesand one major decisionto consider before making the final call about which stone countertop material is best for you. Below, we break them down and give you expert insight into the pros and cons of each material. Jump to:Lisa PertoleA pencil profile on these marble countertops is a streamlined counterpoint to the salvaged details that take center stage in this Texas kitchen designed by Grace Mitchell.Aesthetic AppealMarble: As a natural stone, marble slabs offer one-of-a-kind veining and colors, which adds instant age, history, and even a hint of romance in a home. From the most stately homes to rural countryside cottages, marble is the go-to choice for a house where natural building materials, such as wooden floorboards and clay plaster walls, are character-adding elements to a room's personality and architecture. The material also ages over time with a patina that radiates warmth and charm in the kitchen. Quartz: Quartz surfaces also have timeless appeal with looks that mimic nature in a man-made product, which equates to endless color combinations and finishes. Quartz, engineered with ground quartz, polymer resins, and pigments, is also the favorite countertop material in home renovations, according to the 2025 U.S. Houzz Kitchen Trends Study that found 39 percent of homeowners favored the material as a countertop (versus just 4 percent who chose marble). Among the quartz brands favored with kitchen and interior designers are Caesarstone, Cambria, and Silestone, which offer a fantastic selection with a mix of styles, says designer Paula Dixon of Paula Dixon Design. Calacatta Gold for marble is a nice neutral with various hues to work with many design styles. For a bolder, darker choice, we like to use Nero Marquina [black marble] in a honed finish. FOR MORE:Rikki Snyder for Country LivingIn this Hudson Valley fixer upper, designer Christina Salway installed an ogee-edged Carrara marble to surround her sink and range.DurabilityMarble: Marbles smooth surface makes it an ideal choice to spread out dough and prepare baked goods. It also withstands heat, unlike quartz. But marble is also soft and porous, so it can more easily scratch, stain, crack, and chip. Acidic liquids such as wine, citrus, vinegar, and tomato juice can also cause discoloration. But, just like other finishes that patina over time, marbles natural aging qualities add character over time. And even with the wear and tear, marble can last some 20 to 50 years. Quartz: Quartz countertops are a hardier material, making them more difficult to damage. Quartz surfaces are also naturally bacteria resistant because of its non-porous surface. Since the countertops arent easily damaged, some manufacturers offer a longer extended warranty, anywhere from 15 to 25 years.Keep in mind that quartz and quartzite are not the same thing. Unlike engineered quartz, quartzite is a natural stone formed from sandstone and quartz. Like marble, quartzite is heat-resistant and requires regular sealing to prevent staining. Quartzite is also more porous than quartz. FOR MORE:Marta Xochilt Perez for Country LivingIn this Minnesota lake house, the large kitchen island and surrounding counters were topped with Calacatta Laza Quartz.MaintenanceMarble: Marble requires regular upkeep, such as sealing every six to 12 months, to prevent bacteria build-up. Also, be sure to clean up spills from wine or acidic juices immediately to avoid staining. For regular upkeep, its best to clean marble with a mixture of mild dish soap and warm water. Quartz: Quartz counters are low maintenance. The surface does not require sealing and standard household cleaners are all thats needed for regular upkeep.ZIO AND SONSReclaimed or salvaged marble pieces, which tops this New York cabins kitchen island, are a great choice for those on a budget.PriceMarble: Marble typically costs more than quartz because its a natural stone, whereas quartz is engineered and easier to manufacture. Also, since marble requires more maintenance, it can be more costly over time. The quality of marble is a variable in its price. The thickness of the slab and rare patterns and colors drive elevate the price, and custom cuts, edge designs, and the complexity of the installation are other contributing factors. But in general, marble costs about $100 per square foot, with installation averaging about $3,000. Quartz: Quartz surfaces vary widely in price, depending on customization, anywhere from $50 to $200 per square foot, with countertop installation averaging $4,500.Becky Luigart-Stayner for Country LivingDesigner Trinity Holmes chose a simple Carrara quartz for this pattern-filled farmhouse kitchen.Home ValueThe good news is that both quartz and marble countertops add value to your home, as both are considered high-quality materials. Design pros offer these tips for scoring more affordable marble and quartz. Consider prefabricated quartz that comes in standard sizes and styles, which reduces labor costs. Check out architectural salvage yards and re-use stores for marble remnants that can be retrofit for your kitchen. Repurpose leftover pieces of marble and quartz (from your larger kitchen project or someone elses) in smaller areas around the home, such as on laundry room counters or bathroom vanity tops. Mix materials to stretch your budget and to create a more personalized look. Instead of using marble throughout the kitchen, create zones for specific functions. For example, carve out a smaller counter space as the baking area where marble is best suited, then use quartz around the perimeter of hard-working surfaces that are subject to spills and more everyday wear and tear. FOR MORE:Brian Woodcock for Country LivingA light gray quartz, London Gray by Caesarstone, covers this Alabama lake houses stained pecky cypress island.Whats the biggest deciding factor? Your lifestyle.The first step I consider is the homeowners lifestyle, says Paula Dixon. For families with children, quartz is often the choice for the durability and low maintenance. If the kitchen gets a lot of use with cooking and potential spillsquartz is the better option. For homeowners who want a natural stone and are OK with etching and staining, marble is the design choice.But for others, especially those who prefer a natural, perfectly imperfect look, marble stands the test of time. Marble has a timeless, luxurious look, Paula says. If youre looking for a high-end feel and are OK with maintenance, marble will be the way to go. FOR MORE COUNTERTOP OPTIONS:Kelly Ryan KegansKelly Ryan Kegans is a Minneapolis-based writer, editor, and photo stylist with more than 25 years of experience producing home design content for brands including Country Living, Better Homes & Gardens, and HGTV Magazine. Her own home is populated with more books than shelves, a few too many scrubbed pine tables, and moody photos of gray day landscapes, which are her happy place.

Peruse real estate listings for country homes from the 18th and 19th centuries, and youll likely notice a frequently cited feature: wide-plank hardwood floors. Popular with Americas early settlers thanks to a wealth of vast and untouched old-growth forests, these floorboardsranging from five to 30 incheswere born out of practicality.Eric Piasecki / OTTOReclaimed heart-pine floors feel right at home in a South Carolina carriage house designed by Schafer Buccellato Architects.Felling enormous trees was laborious, so the fewer cuts made to a tree, the better. Once felled, the trunks were often cut into quarters, and then the planks were cut at a 45-degree angle from those quarters, creating what is referred to as quarter-sawn wood. (This technique helps prevent boards from bowing upward.) Nicks and scratches are the architectural equivalent of hard-earned wrinkles and laugh lines.Courtesy of Christopher Horwood/Artichoke Ltd.Wide plank floors add soul to a kitchen designed by Artichoke. As the countrys timber supply depleted and building practices became more refined, hand-hewn boards became harder to come by. Today, theyre prized for their humble history, old-school craftsmanship, and the sense of character that comes from those who plodded their planks beforeso much so that theres a growing number of suppliers of salvage, including Evolutia (Alabama), StoriedBoards (New York), and Antique Beams and Boards (Ohio), to help homeowners create a well trodden look. Rikki Snyder for Country LivingWide plank floors up the charm factor in this old home designed by Christina Salway.Related StoriesRachel BarrettRachel Barrett is the Editor-in-Chief of Country Living. She can't pass up a vintage seascape, drives an '89 Woody Wagoneer (that is, when it'll start), and hopes to buy you a lemonade at a future Country Living Fair.