Changelog

⚡ A major performance upgrade

We ran 100 representative query shapes (keywords, phrases, multilingual terms,
boolean logic, structured filters, aggregations) on the legacy infrastructure and
the new one, side by side, and checked that the results were identical.

• About 12x faster on a typical query (median), and up to 76x in the best cases

• 13.5x faster on full-day searches

Exports start sooner and finish faster, broad monitoring lists stop timing out,
and multi-day historical pulls are now practical.

We also raised the limits:

• Date range: 30 → 100 days per request

• Terms per keyword group: 20 → 400

• Parallel exports: 4 → 6 per customer (12 platform-wide), with up to 200 jobs
  in flight per customer

🔎 New filters

Search by what a post contains, not just its words:

• Hashtags, cashtags and @mentions as exact tags, with “any” or “all” matching

• Outbound links: filter by the host a post links to (optionally including
  subdomains) or by a pattern in the linked URL

• Collection time: bound results by when posts were collected, on top of when
  they were published

Tag and link filters work on their own, no keywords required.

🚀 Searches that got dramatically faster

• Hashtag filter: #bitcoin over a day in 0.4 s (the old keyword search took 15.6 s).
  Exact tags are stricter than keywords, so expect slightly fewer, more precise results.

• Outbound link filter: posts linking to youtube.com over a day in 0.45 s
  (the old keyword search took 69.6 s). This matches real links, not text mentions.

• Cashtags and mentions as keywords: $TSLA 17.2 s → 1.9 s, @elonmusk 62 s → 4.3 s

• Subreddits: r/france over 4 days, 35.6 s → 4.2 s

• Authors: a username over a day, 13.4 s → 0.4 s

• Non-Latin scripts and accented terms (Japanese, Korean, Arabic, Hindi, Thai…):
  typically 5–12x faster

📊 Insights API: the same engine

The Insights API (volume, sentiment and emotion time series) now runs on the same
infrastructure:

• Hourly sentiment for a keyword over a day: 14.9 s → 0.55 s

• Hourly emotions (all 27 dimensions) over a day: 29.9 s → 0.97 s

• Daily volume over 4 days: 100 s → 1.5 s

Same results and the same credit pricing. Domain, language and username filters
benefit from the new indexes, and keywords containing underscores (e.g. age_uk)
now work.

Full details are in the updated documentation:

👉 Data Export API documentation
👉 Data Insights API documentation

Questions or feedback?

For technical use cases or API usage: [email protected]
For general enquiries: [email protected]