Blog

Learn how to scrape the web and create tools with public data.

Diagram of a LangChain agent calling a Serply search tool

Add Real-Time Search to LangChain Agents with a Serply Tool

Wrap Serply's Google Search API as a LangChain tool so your agents can answer questions about anything that happened after their training cutoff.
Split illustration comparing a tangle of scraping infrastructure against a single API call

Serply vs. Building Your Own Scraping Stack for AI Agents

Headless browsers, proxy rotation, and captcha solvers aren't free. Here's when a hosted search/scrape API beats owning that stack.
Six data streams feeding into a single AI shopping agent

Six Data Sources Every AI Shopping and Deal-Finding Agent Needs

A tour of the six Serply endpoints that turn a shopping agent from a search wrapper into something that actually finds you a good deal.
The same query returning different results from different countries

Your Agent Is Searching From the Wrong Country

Search results are geo-personalized. If your agent always queries from one region, it's giving every user the same locally-wrong answer.
Two tool schemas side by side, one clearly better described

Why Your Agent Isn't Calling the Search Tool

The problem is almost never the system prompt. It's the twelve words in your tool description.
A cache layer between an agent and a search API with varying TTLs

Caching Search Results Without Making Your Agent Stale

The whole point of a search tool is freshness, so caching feels like cheating. It isn't — if you pick TTLs by query intent instead of by convenience.
A rate limit counter approaching zero with a backoff curve

What Your Agent Should Do When the Search API Says 429

Retrying a rate limit is the wrong instinct. Here's how to build search tools that degrade gracefully instead of hammering a closed door.
A diff view comparing two versions of a competitor pricing page

A Competitive Intelligence Agent That Reads the Pricing Page

Marketing copy about competitors ages badly. An agent that re-reads their actual pages on a schedule doesn't.
A news feed being triaged into urgent and routine buckets

A Brand Monitoring Agent That Knows What's Worth Waking You For

Polling news for your company name is easy. Deciding which of the forty hits actually matters is the part that needs an agent.
A map with pinned business locations feeding a qualification pipeline

A Lead-Gen Agent That Actually Verifies the Business Exists

Google Maps results carry addresses, ratings, categories, and websites. Wire them into an agent and you get qualified leads instead of a scraped phone list.