Identifying the exact location of a software issue—such as a bug or feature request—remains one of the most labor-intensive tasks in the development lifecycle.
Despite advances in automated patch generation and code assistants, the process of pinpointing where in the codebase a change is needed often consumes more time than determining how to fix it.
Agent-based approaches powered by large language models (LLMs) have made headway by simulating developer workflows through iterative tool use and reasoning.
However, these systems are typically slow, brittle, and expensive to operate, especially when built on closed-source models.
In parallel, existing code retrieval models—while faster—are not optimized for the verbosity and behavioral focus of real-world issue descriptions.
This misalignment between natural language inputs and code search capability presents a fundamental challenge for scalable automated debugging.
SWERank — A Practical Framework for Precise Localization
To address these limitations, Salesforce AI has introduced SWERank, a lightweight and effective retrieve-and-rerank framework tailored for software issue localization.
SWERank is designed to bridge the gap between efficiency and precision by reframing localization as a code ranking task.
The framework consists of two key components:
SWERankEmbed, a bi-encoder retrieval model that encodes GitHub issues and code snippets into a shared embedding space for efficient similarity-based retrieval.
SWERankLLM, a listwise reranker built on instruction-tuned LLMs that refines the ranking of retrieved candidates using contextual understanding.
To train this system, the research team curated SWELOC, a large-scale dataset extracted from public GitHub repositories, linking real-world issue reports with corresponding code changes.
SWELOC introduces contrastive training examples using consistency filtering and hard-negative mining to ensure data quality and relevance.
Architecture and Methodological Contributions
At its core, SWERank follows a two-stage pipeline.
First, SWERankEmbed maps a given issue description and candidate functions into dense vector representations.
Using a contrastive InfoNCE loss, the retriever is trained to increase the similarity between an issue and its true associated function while reducing its similarity to unrelated code snippets.
Notably, the model benefits from carefully mined hard negatives—code functions that are semantically similar but not relevant—which improve the model’s discriminative capability.
The reranking stage leverages SWERankLLM, a listwise LLM-based reranker that processes an issue description along with top-k code candidates and generates a ranked list where the relevant code appears at the top.
Importantly, the training objective is adapted to settings where only the true positive is known.
The model is trained to output the identifier of the relevant code snippet, maintaining compatibility with listwise inference while simplifying the supervision process.
Together, these components allow SWERank to offer high performance without requiring multiple rounds of interaction or costly agent orchestration.
Insights
Evaluations on SWE-Bench-Lite and LocBench—two standard benchmarks for software localization—demonstrate that SWERank achieves state-of-the-art results across file, module, and function levels.
On SWE-Bench-Lite, SWERankEmbed-Large (7B) attained a function-level accuracy@10 of 82.12%, outperforming even LocAgent running with Claude-3.5.
When coupled with SWERankLLM-Large (32B), performance further improved to 88.69%, establishing a new benchmark for this task.
In addition to performance gains, SWERank offers substantial cost benefits.
Compared to Claude-powered agents, which average around $0.66 per example, SWERankLLM’s inference cost is $0.011 for the 7B model and $0.015 for the 32B variant—delivering up to 6x better accuracy-to-cost ratio.
Moreover, the 137M parameter SWERankEmbed-Small model achieves competitive results, demonstrating the framework’s scalability and efficiency even on lightweight architectures.
Beyond benchmark performance, experiments also show that SWELOC data improves a broad class of embedding and reranking models.
Models pre-trained for general-purpose retrieval exhibited significant accuracy gains when fine-tuned with SWELOC, validating its utility as a training resource for issue localization tasks.
Conclusion
SWERank introduces a compelling alternative to traditional agent-based localization approaches by modeling software issue localization as a ranking problem.
Through its retrieve-and-rerank architecture, SWERank delivers state-of-the-art accuracy while maintaining low inference cost and minimal latency.
The accompanying SWELOC dataset provides a high-quality training foundation, enabling robust generalization across various codebases and issue types.
By decoupling localization from agentic multi-step reasoning and grounding it in efficient neural retrieval, Salesforce AI demonstrates that practical, scalable solutions for debugging and code maintenance are not only possible—but well within reach using open-source tools.
SWERank sets a new bar for accuracy, efficiency, and deployability in automated software engineering.
Check out the Paper and Project Page. All credit for this research goes to the researchers of this project.
Also, feel free to follow us on Twitter and don’t forget to join our 90k+ ML SubReddit.
Here’s a brief overview of what we’re building at Marktechpost:
ML News Community – r/machinelearningnews (92k+ members)
Newsletter– airesearchinsights.com/(30k+ subscribers)
miniCON AI Events – minicon.marktechpost.com
AI Reports & Magazines – magazine.marktechpost.com
AI Dev & Research News – marktechpost.com (1M+ monthly readers)
Partner with us
Asif RazzaqWebsite |  + postsBioAsif Razzaq is the CEO of Marktechpost Media Inc..
As a visionary entrepreneur and engineer, Asif is committed to harnessing the potential of Artificial Intelligence for social good.
His most recent endeavor is the launch of an Artificial Intelligence Media Platform, Marktechpost, which stands out for its in-depth coverage of machine learning and deep learning news that is both technically sound and easily understandable by a wide audience.
The platform boasts of over 2 million monthly views, illustrating its popularity among audiences.Asif Razzaqhttps://www.marktechpost.com/author/6flvq/A" style="color: #0066cc;">https://www.marktechpost.com/author/6flvq/A Step-by-Step Guide to Build a Fast Semantic Search and RAG QA Engine on Web-Scraped Data Using Together AI Embeddings, FAISS Retrieval, and LangChainAsif Razzaqhttps://www.marktechpost.com/author/6flvq/A" style="color: #0066cc;">https://www.marktechpost.com/author/6flvq/A Step-by-Step Guide to Deploy a Fully Integrated Firecrawl-Powered MCP Server on Claude Desktop with Smithery and VeryaXAsif Razzaqhttps://www.marktechpost.com/author/6flvq/OpenAI" style="color: #0066cc;">https://www.marktechpost.com/author/6flvq/OpenAI Releases HealthBench: An Open-Source Benchmark for Measuring the Performance and Safety of Large Language Models in HealthcareAsif Razzaqhttps://www.marktechpost.com/author/6flvq/PrimeIntellect" style="color: #0066cc;">https://www.marktechpost.com/author/6flvq/PrimeIntellect Releases INTELLECT-2: A 32B Reasoning Model Trained via Distributed Asynchronous Reinforcement Learning

Source: https://www.marktechpost.com/2025/05/13/agent-based-debugging-gets-a-cost-effective-alternative-salesforce-ai-presents-swerank-for-accurate-and-scalable-software-issue-localization/">https://www.marktechpost.com/2025/05/13/agent-based-debugging-gets-a-cost-effective-alternative-salesforce-ai-presents-swerank-for-accurate-and-scalable-software-issue-localization/">https://www.marktechpost.com/2025/05/13/agent-based-debugging-gets-a-cost-effective-alternative-salesforce-ai-presents-swerank-for-accurate-and-scalable-software-issue-localization/
#agentbased #debugging #gets #costeffective #alternative #salesforce #presents #swerank #for #accurate #and #scalable #software #issue #localization

It comes as no surprise that online scraper bots are scouring the web looking for content to train generative AI (genAI) models, causing massive bandwidth charges to enterprises who told them not to crawl their sites.
What is surprising is the world of large language model (LLM) makers’ use of unattributed browsers and other means of escaping responsibility.
As bad as that situation is, something worse lies below it.
And it’s an inequity that’s been around for decades, starting in the earliest days of the web.
The problem is simple, but the answer is not: enterprises have had business reasons to ignore the issue for years. 
Since the earliest days of the web, hosting companies have charged enterprises for bandwidth based on usage.
That seems fair enough.
The problem is that those same companies have limited control over their bandwidth use — and limited finite budgets. 
In other words, corporate budgets for bandwidth are based on typical activity.
But then someone says something on social media that post goes viral, readers flock to a site in a massive way, and bandwidth costs soar.
Are enterprises really now on the hook for an infinite amount of money?
Here’s where things get complicated.
Businesses of all types tolerated this situation with the expectation that a big jump in traffic would generate big jump in revenue.
So, they didn’t object to bandwidth cost increases.
Then came search engine spiders.
(Note: Spiders, browsers and crawlers are interchangeable.
They are also all bots.) Sure, they ate up bandwidth, but again, the assumption was that search traffic would be beneficial — it brought in customers and new prospects. 
For the most part, search spiders respected robots.txt instructions about which sites they could visit and which pages on those sites they could crawl.
Because search providers knew most sites welcomed their visits, they more or less respected the restrictions. 
That brings us to today, when we find that the companies behind LLMs — through various sneaky mechanisms — do not respect those do not enter signs. And their crawlers don’t deliver the perceived value of human visitors or even search engine spiders.
Instead of bringing with them new prospects to an enterprise site, they steal data, use it for their own apps and then sell it to others. 
Website owners get no meaningful benefit and higher costs from increased bandwidth use.
Most of the major model makers deny they do this, but that’s because they are using undeclared crawlers to do most of their dirty work.
And, we detailed recently, they’re done in a way designed to cleverly avoid legal consequences. 
There have been some efforts to address the problem.
Cloudflare makes a popular one that essentially creates an attractive honey pot to keep unauthorized crawlers at bay.
But, to reiterate, the real problem is that companies generally have agreed to pay an infinite amount of money for bandwidth they can’t control. So, it’s hard now to fight something you’ve knowingly tolerated for decades.
If unauthorized crawlers were forced to pay those costs, the situation would likely resolve itself quickly. Or perhaps cloud vendors could charge for the bandwidth.
Conveniently, many of the large cloud companies — think Amazon, Google and Microsoft — also happen to own the operations sending out cowboy crawlers.
Isn’t that special? 
More importantly, doesn’t that create a massive conflict of interest?
The problem will be difficult to fix.
Most of the obvious mechanisms are untenable.
A site could, for example, say they are willing to spend X number of dollars on bandwidth and no more.
But what happens when a site hits that number? Would Walmart or Chase Bank really say, “Turn off the bandwidth hose until next month?” 
Of course not.
That brings us to an attribution problem.
An enterprise knows that its bandwidth numbers are soaring by a certain percent above normal.
But during that time, they were visited by millions of humans and a greater number of bots from all kinds of companies, including search and genAI crawlers. 
Most sites’ analytics struggle to attribute specific bandwidth increases to specific visitors.
And even for those that do, the biggest violators are going to be undeclared bots, or bots not easily identified with a specific company.
Sometimes the bots come from countries such as China, Russia and North Korea that rarely play nice with US laws.
Still, enterprise IT needs to have some serious conversations with hosting vendors — or with business partners that handle those arrangements — about getting unauthorized bandwidth charges under control.
Given various reports that bots represent more traffic than humans today, that conversation needs to happen soon.

Source: https://www.computerworld.com/article/3983386/genai-crawler-problem-highlights-a-bigger-issue-the-cloud-bandwidth-nightmare.html">https://www.computerworld.com/article/3983386/genai-crawler-problem-highlights-a-bigger-issue-the-cloud-bandwidth-nightmare.html">https://www.computerworld.com/article/3983386/genai-crawler-problem-highlights-a-bigger-issue-the-cloud-bandwidth-nightmare.html
#genai #crawler #problem #highlights #bigger #issue #the #cloud #bandwidth #nightmare

Time stands still for no one, yet some watchmakers have mastered the art of transcending it.
Bulova marks an extraordinary milestone this year with 150 years of uninterrupted watchmaking excellence originating from New York City.
The iconic American brand commemorates this sesquicentennial achievement with the release of two exceptional limited-edition timepieces that resurrect the brand’s Art Deco heritage.
These anniversary pieces don’t merely replicate historical designs; they reimagine them for contemporary collectors while preserving the essence that made them revolutionary in their time.
Designer: Bulova
The Limited-Edition 150 Art Deco Collection features two distinct timepieces: the elegant Miss America ladies’ watch and a meticulously crafted pocket watch.
Each piece carries individual numbering and features case backs adorned with the 150th Anniversary logo, presented in custom-designed cases accompanied by detailed storybooks chronicling Bulova’s rich Art Deco legacy.
Art Deco represented a transformative period for Bulova.
This artistic movement of the 1920s and 1930s coincided with the brand’s expansion and cemented design principles that continue to influence its aesthetic approach today.
“With these limited-edition timepieces, we’re bringing the past into the present, reimagining timeless design for the modern collector,” explains Michael Benavente, Bulova’s brand managing director.
This philosophy guides the entire collection, balancing historical authenticity with contemporary craftsmanship.
Miss America: Feminine Elegance Reimagined
The 150 Art Deco Miss America watch revives one of Bulova’s most celebrated feminine designs.
The original Miss America collection, launched in 1930, captured the evolving role of women during a pivotal era of social transformation.
Its influence spanned four decades, establishing Bulova as a creator of timepieces that complemented the changing fashion sensibilities of modern women.
The contemporary interpretation maintains the delicate proportions and ornate detailing of its predecessor.
A slender silver-tone stainless steel case measuring just 18.3mm creates a refined presence on the wrist.
Six deep blue synthetic sapphires adorn the case, creating striking visual contrast against the metallic surfaces.
Perhaps the most distinctive element of the Miss America is its intricately filigreed expansion bracelet.
This elaborate metalwork exemplifies the attention to detail characteristic of Art Deco jewelry, featuring a seamless buckle closure that maintains the bracelet’s visual continuity.
The craftsmanship evident in these small details demonstrates Bulova’s commitment to authentic period design.
The silver-tone dial, with its brushed surface and blue hands inspired by vintage watches, continues the vintage aesthetic.
A domed sapphire crystal protects the dial while adding visual depth to the overall design.
Together, these elements create a timepiece that functions as wearable art rather than merely a timekeeping instrument.
Despite its ornate appearance, the Miss America incorporates modern functionality.
The reliable 5Y20 quartz movement ensures accurate timekeeping, while 30-meter water resistance makes the watch suitable for everyday wear.
The distinctive tonneau case shape, a hallmark of Art Deco design, features an anti-reflective curved sapphire crystal that enhances legibility.
Production of the Miss America is limited to 600 pieces worldwide, with each watch individually numbered.
Available at $1,950, this collector’s piece launched in late March 2025, offering enthusiasts immediate access to this celebration of Bulova’s design heritage.
The Art Deco Pocket Watch: Mechanical Mastery
While wristwatches dominate contemporary timekeeping, the pocket watch represents an essential chapter in horological history.
Bulova’s 150 Art Deco Pocket Watch pays homage to this tradition, drawing inspiration from the company’s iconic 1920s designs when pocket watches represented the pinnacle of portable timekeeping technology.
The substantial 45.5mm case provides an impressive canvas for showcasing Bulova’s mechanical expertise.
Coin-edge texturing adorns the silver-tone stainless steel case, complemented by a textured bow that connects to a 15.8-inch custom link chain.
This chain features a specially designed lobster claw and spring ring closure system that balances security with period-appropriate aesthetics.
Technical excellence defines this commemorative piece.
A self-winding Swiss mechanical movement featuring 21 jewels powers the timepiece, offering an impressive 62-hour power reserve.
This sophisticated mechanism represents a significant achievement in mechanical watchmaking, providing extended autonomy between windings.
The sterling silver dial showcases intricate central engravings that pay tribute to early Bulova craftsmen.
Bold numerals set against a brushed hour ring create excellent legibility, while elegant blued minute and hour hands provide striking contrast against the silver background.
These design elements recreate the sophisticated aesthetic of the Art Deco period while maintaining practical functionality.
Limited to just 350 pieces worldwide and priced at $2,950, the pocket watch became available in early April 2025.
This exceptional timepiece connects Bulova’s mechanical watchmaking heritage with contemporary craftsmanship, offering collectors a rare opportunity to own a piece of horological history.
Cultural Legacy and Heritage Preserved
The Limited-Edition 150 Art Deco Collection transcends mere corporate celebration, acknowledging Bulova’s profound influence on American watch design during a transformative cultural period.
Jeffrey Cohen, President of Citizen Watch America, captures this significance perfectly: “The Art Deco era was a defining moment for Bulova, marked by cutting-edge technology, bold design, and pioneering marketing strategies.
With these limited-edition timepieces, we are reimagining that legacy for the modern era, honoring our past while continuing to push the boundaries of craftsmanship and innovation in our 150th year.”
By selecting Art Deco as the focal point for this anniversary, Bulova highlights an era when its design language achieved peak distinctiveness.
Founded by Joseph Bulova in 1875, the company has consistently pioneered innovations that transformed watchmaking while maintaining its position at the forefront of design and technology.
The thoughtful presentation enhances each timepiece’s significance.
Luxurious custom cases contain the watches alongside detailed storybooks providing historical context about Bulova’s Art Deco heritage.
This approach transforms the watches from products into cultural artifacts with rich narratives.
Limited production numbers (600 Miss America watches and 350 pocket watches) ensure exclusivity and collectible status.
For enthusiasts, these pieces represent an opportunity to own functional art objects embodying 150 years of continuous innovation.
They serve as wearable connections to an influential design movement that shaped American aesthetic sensibilities during a pivotal historical period.
The collection demonstrates how historical designs can successfully adapt to contemporary expectations while connecting generations of watch enthusiasts through timeless design principles.
Through these meticulously crafted timepieces, Bulova affirms Art Deco’s lasting influence and ensures this distinctive aesthetic approach will continue inspiring future generations of watchmakers and collectors alike.The post Bulova Celebrates 150 Years with Art Deco Limited-Edition Timepieces first appeared on Yanko Design.
Source: https://www.yankodesign.com/2025/05/13/bulova-celebrates-150-years-with-art-deco-limited-edition-timepieces/?utm_source=rss&utm_medium=rss&utm_campaign=bulova-celebrates-150-years-with-art-deco-limited-edition-timepieces">https://www.yankodesign.com/2025/05/13/bulova-celebrates-150-years-with-art-deco-limited-edition-timepieces/?utm_source=rss&utm_medium=rss&utm_campaign=bulova-celebrates-150-years-with-art-deco-limited-edition-timepieces">https://www.yankodesign.com/2025/05/13/bulova-celebrates-150-years-with-art-deco-limited-edition-timepieces/?utm_source=rss&utm_medium=rss&utm_campaign=bulova-celebrates-150-years-with-art-deco-limited-edition-timepieces
#bulova #celebrates #years #with #art #deco #limitededition #timepieces

Atlus’ new Persona-related teaser on social media is getting a ton of attention — but it’s not a teaser for Persona 6 (or a Persona 5 remake).
Instead, it’s a tease about its Persona 5 mobile game spinoff, Persona 5: The Phantom X.

On Monday, Atlus released a teaser on X with an image featuring The Phantom X protagonist Wonder’s glasses and a mantra from the spinoff adventure that reads, “Retake your desire!” The post also features an owl emoji, referencing the protagonist’s talking bird companion, Lufel (or Luffy), à la everyone’s favorite talking cat, Morgana.
Sega and Atlus have prepared a live stream for Thursday to show off the mobile game as the companies prepare to bring the Persona 5 mobile spinoff to a broader audience.
Atlus said on its Japanese-language YouTube channel that the P5X news stream will feature release date details and new information on the English-language version of the game.
That live stream will go down on Thursday, May 15, at 11 p.m.
JST — that’s 10 a.m.
EDT/7 a.m.
PDT.
Persona 5: The Phantom X is a spinoff of the fifth installment in Atlus’ critically acclaimed JRPG series.
The P5-inspired gacha game is being developed for PC and mobile platforms, and heavily relies on microtransactions.
The Phantom X is developed by Perfect World Games under license from Sega and Atlus, and released in open beta in April 2024 in China, followed by a release in Taiwan, Korea, Hong Kong, and Macau.
Again, this isn’t Persona 6.
But, fans will have a chance to experience another story set in the P5 universe.
Again!
Persona 5: The Phantom X is set in a universe that runs parallel to the original events of Persona 5.
Like Joker, the protagonist gains the power to summon and activate Persona.
With his new power and lovable animal companion, an owl named Luffy, the protagonist becomes Wonder and forms the Phantom Thieves.
The crew sets out on a mission to reclaim desires in their world that are being stolen and stop the root of the internal destruction.
As for Persona 6, there has been no word on the next installment in Sega and Atlus’ popular role-playing franchise.
So, fans will have to make do with Persona 5: The Phantom X for now.
Think you dropped this… Stay tuned! pic.twitter.com/OA1KGYYimU— Official ATLUS West (@Atlus_West) May 12, 2025

Source: https://www.polygon.com/gaming/598874/atlus-teaser-persona-5-phantom-x-p6">https://www.polygon.com/gaming/598874/atlus-teaser-persona-5-phantom-x-p6">https://www.polygon.com/gaming/598874/atlus-teaser-persona-5-phantom-x-p6
#atlus #new #persona #teaser #isnt #about #sorry

A former Call of Duty developer is wondering the same thing you are: if the franchise — which has released 21 mainline installments since 2003 — has run out of ideas.
“It’s almost like The Simpsons — it’s been around so long that it feels like they’ve run out of ideas at times.
It kind of wandered into left field,” Chance Glasco told an Oklahoma news station on Monday.
Glasco is one of the founders of Infinity Ward and helped co-create the franchise with 2003’s Call of Duty.
There’s a chance Glasco worked on your favorite COD game; Infinity Ward was responsible for series standouts like Call of Duty 4: Modern Warfare and Modern Warfare 2.
“I wouldn’t say it peaked at Modern Warfare 2, but that was probably the best game we made,” Glasco said.
While the series may or may not have peaked with MW2 (though anyone who misses running around with a silenced UMP45 might say it did — *raises hand*), there’s no arguing the Call of Duty of today is massively different than the Call of Duty of prior hardware generations.
You may look at Squid Game and Teenage Mutant Ninja Turtles crossovers and think they’re cool, but longtime players might see them as signs the annual franchise is running out of steam in the “fresh gameplay ideas and innovation” department.
Glasco clearly shares some of that sentiment.
Call of Duty: Black Ops 6 is the latest entry in the franchise, and it being the sixth BLOPS should tell you all you need to know about whether Call of Duty is running out of ideas or if that even matters.
Consider: the game had the best launch for the series, and was, of course, the best-selling game of 2024.
Perhaps the most innovative Call of Duty has been is with the free-to-play Call of Duty: Warzone.
The battle-royale gameplay was a slight shift from the series’ classic multiplayer gameplay, and launching in March 2020 certainly helped boost its popularity.
And yet.
“These days, I don’t play much outside of Warzone,” Glasco said.
You and plenty others, Glasco.
Just like people are still going to watch The Simpsons, regardless of its varying levels of quality, people are still going to play whatever Call of Duty launches this fall.
Regardless of its quality — or innovative ideas.
Source: https://www.polygon.com/gaming/598920/former-call-of-duty-dev-wonders-if-the-franchise-has-run-out-of-ideas" style="color: #0066cc;">https://www.polygon.com/gaming/598920/former-call-of-duty-dev-wonders-if-the-franchise-has-run-out-of-ideas
#former #call #duty #dev #wonders #the #franchise #has #run #out #ideas

While I am sympathetic to this idea, but…How have the price of games changed in the last 5 years, since it has become much more accessible for tiny dev teams to create good games and distribute them (thanks to eg Steam?)Did the best games get cheaper? (Same market forces!)Louie Bacaj: There is a real possibility the price of all software drops dramatically over time, because of LLMs.Competition will force this.
Even complex SaaS, why pay some big company with large teams, when a small team or small time dev might offer it at a fraction of the cost.
Source: https://x.com/GergelyOrosz/status/1922298383798030773" style="color: #0066cc;">https://x.com/GergelyOrosz/status/1922298383798030773
#while #sympathetic #this #idea #but #how #have #the #price #games #changed #last #years #since #has #become #much #more #accessible #for #tiny

In this tutorial, we lean hard on Together AI’s growing ecosystem to show how quickly we can turn unstructured text into a question-answering service that cites its sources.
We’ll scrape a handful of live web pages, slice them into coherent chunks, and feed those chunks to the togethercomputer/m2-bert-80M-8k-retrieval embedding model.
Those vectors land in a FAISS index for millisecond similarity search, after which a lightweight ChatTogether model drafts answers that stay grounded in the retrieved passages.
Because Together AI handles embeddings and chat behind a single API key, we avoid juggling multiple providers, quotas, or SDK dialects.
!pip -q install --upgrade langchain-core langchain-community langchain-together
faiss-cpu tiktoken beautifulsoup4 html2text
This quiet (-q) pip command upgrades and installs everything the Colab RAG needs.
It pulls core LangChain libraries plus the Together AI integration, FAISS for vector search, token-handling with tiktoken, and lightweight HTML parsing via beautifulsoup4 and html2text, ensuring the notebook runs end-to-end without additional setup.
import os, getpass, warnings, textwrap, json
if "TOGETHER_API_KEY" not in os.environ:
os.environ["TOGETHER_API_KEY"] = getpass.getpass(" Enter your Together API key: ")
We check whether the TOGETHER_API_KEY environment variable is already set; if not, it securely prompts us for the key with getpass and stores it in os.environ.
The rest of the notebook can call Together AI’s API without hard‑coding secrets or exposing them in plain text by capturing the credentials once per runtime.
from langchain_community.document_loaders import WebBaseLoader
URLS = [
"https://python.langchain.com/docs/integrations/text_embedding/together/"," style="color: #0066cc;">https://python.langchain.com/docs/integrations/text_embedding/together/",
"https://api.together.xyz/"," style="color: #0066cc;">https://api.together.xyz/",
"https://together.ai/blog"" style="color: #0066cc;">https://together.ai/blog"
]
raw_docs = WebBaseLoader(URLS).load()
WebBaseLoader fetches each URL, strips boilerplate, and returns LangChain Document objects containing the clean page text plus metadata.
By passing a list of Together-related links, we immediately collect live documentation and blog content that will later be chunked and embedded for semantic search.
from langchain.text_splitter import RecursiveCharacterTextSplitter
splitter = RecursiveCharacterTextSplitter(chunk_size=800, chunk_overlap=100)
docs = splitter.split_documents(raw_docs)
print(f"Loaded {len(raw_docs)} pages → {len(docs)} chunks after splitting.")
RecursiveCharacterTextSplitter slices every fetched page into ~800-character segments with a 100-character overlap so contextual clues aren’t lost at chunk boundaries.
The resulting list docs holds these bite-sized LangChain Document objects, and the printout shows how many chunks were produced from the original pages, essential prep for high-quality embedding.
from langchain_together.embeddings import TogetherEmbeddings
embeddings = TogetherEmbeddings(
model="togethercomputer/m2-bert-80M-8k-retrieval"
)
from langchain_community.vectorstores import FAISS
vector_store = FAISS.from_documents(docs, embeddings)
Here we instantiate Together AI’s 80 M-parameter m2-bert retrieval model as a drop-in LangChain embedder, then feed every text chunk into it while FAISS.from_documents builds an in-memory vector index.
The resulting vector store supports millisecond-level cosine searches, turning our scraped pages into a searchable semantic database.
from langchain_together.chat_models import ChatTogether
llm = ChatTogether(
model="mistralai/Mistral-7B-Instruct-v0.3",
temperature=0.2,
max_tokens=512,
)
ChatTogether wraps a chat-tuned model hosted on Together AI, Mistral-7B-Instruct-v0.3 to be used like any other LangChain LLM.
A low temperature of 0.2 keeps answers grounded and repeatable, while max_tokens=512 leaves room for detailed, multi-paragraph responses without runaway cost.
from langchain.chains import RetrievalQA
qa_chain = RetrievalQA.from_chain_type(
llm=llm,
chain_type="stuff",
retriever=vector_store.as_retriever(search_kwargs={"k": 4}),
return_source_documents=True,
)
RetrievalQA stitches the pieces together: it takes our FAISS retriever (returning the top 4 similar chunks) and feeds those snippets into the llm using the simple “stuff” prompt template.
Setting return_source_documents=True means each answer will return with the exact passages it relied on, giving us instant, citation-ready Q-and-A.
QUESTION = "How do I use TogetherEmbeddings inside LangChain, and what model name should I pass?"
result = qa_chain(QUESTION)
print("n Answer:n", textwrap.fill(result['result'], 100))
print("n Sources:")
for doc in result['source_documents']:
print(" •", doc.metadata['source'])
Finally, we send a natural-language query through the qa_chain, which retrieves the four most relevant chunks, feeds them to the ChatTogether model, and returns a concise answer.
It then prints the formatted response, followed by a list of source URLs, giving us both the synthesized explanation and transparent citations in one shot.
Output from the Final Cell
In conclusion, in roughly fifty lines of code, we built a complete RAG loop powered end-to-end by Together AI: ingest, embed, store, retrieve, and converse.
The approach is deliberately modular, swap FAISS for Chroma, trade the 80 M-parameter embedder for Together’s larger multilingual model, or plug in a reranker without touching the rest of the pipeline.
What remains constant is the convenience of a unified Together AI backend: fast, affordable embeddings, chat models tuned for instruction following, and a generous free tier that makes experimentation painless.
Use this template to bootstrap an internal knowledge assistant, a documentation bot for customers, or a personal research aide.
Check out the Colab Notebook here. Also, feel free to follow us on Twitter and don’t forget to join our 90k+ ML SubReddit.
Asif RazzaqWebsite |  + postsBioAsif Razzaq is the CEO of Marktechpost Media Inc..
As a visionary entrepreneur and engineer, Asif is committed to harnessing the potential of Artificial Intelligence for social good.
His most recent endeavor is the launch of an Artificial Intelligence Media Platform, Marktechpost, which stands out for its in-depth coverage of machine learning and deep learning news that is both technically sound and easily understandable by a wide audience.
The platform boasts of over 2 million monthly views, illustrating its popularity among audiences.Asif Razzaqhttps://www.marktechpost.com/author/6flvq/Agent-Based" style="color: #0066cc;">https://www.marktechpost.com/author/6flvq/Agent-Based Debugging Gets a Cost-Effective Alternative: Salesforce AI Presents SWERank for Accurate and Scalable Software Issue LocalizationAsif Razzaqhttps://www.marktechpost.com/author/6flvq/A" style="color: #0066cc;">https://www.marktechpost.com/author/6flvq/A Step-by-Step Guide to Deploy a Fully Integrated Firecrawl-Powered MCP Server on Claude Desktop with Smithery and VeryaXAsif Razzaqhttps://www.marktechpost.com/author/6flvq/OpenAI" style="color: #0066cc;">https://www.marktechpost.com/author/6flvq/OpenAI Releases HealthBench: An Open-Source Benchmark for Measuring the Performance and Safety of Large Language Models in HealthcareAsif Razzaqhttps://www.marktechpost.com/author/6flvq/PrimeIntellect" style="color: #0066cc;">https://www.marktechpost.com/author/6flvq/PrimeIntellect Releases INTELLECT-2: A 32B Reasoning Model Trained via Distributed Asynchronous Reinforcement Learning

Source: https://www.marktechpost.com/2025/05/14/step-by-step-guide-to-build-a-fast-semantic-search-and-rag-qa-engine-on-web-scraped-data-using-together-ai-embeddings-faiss-retrieval-and-langchain/" style="color: #0066cc;">https://www.marktechpost.com/2025/05/14/step-by-step-guide-to-build-a-fast-semantic-search-and-rag-qa-engine-on-web-scraped-data-using-together-ai-embeddings-faiss-retrieval-and-langchain/
#stepbystep #guide #build #fast #semantic #search #and #rag #engine #webscraped #data #using #together #embeddings #faiss #retrieval #langchain

Researchers Discover That Chimps Drum Rhythmically, Suggesting Human Musicality Originated in Our Last Common Ancestor
Not only do chimpanzees maintain a rhythm while drumming on tree roots, but two subspecies use distinct tempos and techniques, according to a new study

A new study finds chimpanzees drum against tree roots with rhythm, suggesting they share an evolutionary trait with humans passed down by a last common ancestor.
DaFranzos via Pixabay
Wild chimpanzees often drum their limbs against the large roots of giant trees, sending out loud, booming sounds that resonate through the rainforest.
Previous research identified the behavior as a form of communication and demonstrated that the animals have individual drumming styles.
Now, a new study published Friday in the journal Current Biology shows chimpanzees also follow distinct, regular and non-random rhythms—traits that are building blocks of human music.
This suggests the origin of our own musicality may have originated in a last common ancestor with chimpanzees.
“They’re actually drumming often with their feet, so they’re using their hands to hold onto those roots, and then they’re kind of dancing,” Catherine Hobaiter, a co-author of the study and a primatologist at the University of St.
Andrews in Scotland, tells NPR’s Jon Hamilton.
“And sometimes they’re jumping between the roots and getting all of those different beat structures down, throwing a hand in if you want to get a little syncopated.”In the study, Hobaiter and her colleagues analyzed 371 drumming bouts produced by eastern and western chimpanzees in 11 communities across Côte d’Ivoire, Guinea, Senegal, Tanzania and Uganda.
The drumming “had a predictability to it,” Hobaiter tells the Guardian’s Nicola Davis.
“And when you’ve got predictability, you’ve got a really strong indicator that there’s rhythm there.”
Though some earlier studies indicate that captive chimps can drum rhythmically, this new paper is the first to truly demonstrate that ability in wild chimpanzees, says Valérie Dufour, an animal cognition biologist at the University of Clermont Auvergne in France who did not participate in the research, to Science’s Rodrigo Pérez Ortega.
“Showing that chimpanzees share some of the fundamental properties of human musical rhythm in their drumming is a really exciting step in understanding when and how we evolved this skill,” Hobaiter explains in a statement.
“Our findings suggest that our ability to drum rhythmically may have existed long before we were human.”
The team’s analyses revealed striking differences in drumming rhythm between the two subspecies: Western chimps used more regular intervals, while their eastern counterparts were more likely to alternate between faster and slower beats.
The two groups also integrated the drumming into their vocalizations in different ways: Western chimps drummed more and faster, and they combined it into their vocalizations—known as pant-hoots—earlier than eastern chimps did.
These contrasts might be linked to differences in social behaviors between the subspecies, researchers say.
Eastern chimpanzees tend to be more aggressive, live in bigger groups and have more hierarchical societies than the more egalitarian western chimpanzees.
The variations between their drumming styles might reflect differences in human language, reports National Geographic’s Olivia Ferrari.“This is the kind of science that wakes us up to the fact that every single population of chimpanzees is worth conserving and preserving,” Hobaiter tells National Geographic.
“We’re starting to recognize that they might have cultures in their communication, in their rhythm, in their social behavior… if you lose a group, you lose the unique culture that goes with it.”
In a similar way, two other recent papers are also shedding light on chimp behaviors that are uncannily close to human ones.
A study published May 7 in Biology Letters suggests western chimpanzees often throw previously collected rocks against tree trunks as a form of communication.
And other research published May 9 in Science Advances shows the primates communicate complex meaning by combining vocal sounds.
Taken together with recent work detailing a headbanging sea lion that can keep a beat and a key linguistic pattern in whale song, the research suggests humans’ rhythm and language abilities might not be as unique as we once thought.
“Humans are intrinsically rhythmic creatures,” Hobaiter tells BBC Science Focus’ Hatty Willmoth.
“We have rhythm in our music and in our dance and in our song, but also in our conversations—and it’s a human universal, so it might be part of our evolutionary heritage.”
Get the latest stories in your inbox every weekday.

Source: https://www.smithsonianmag.com/smart-news/researchers-discover-that-chimps-drum-rhythmically-suggesting-human-musicality-originated-in-our-last-common-ancestor-180986607/" style="color: #0066cc;">https://www.smithsonianmag.com/smart-news/researchers-discover-that-chimps-drum-rhythmically-suggesting-human-musicality-originated-in-our-last-common-ancestor-180986607/
#researchers #discover #that #chimps #drum #rhythmically #suggesting #human #musicality #originated #our #last #common #ancestor