Skip to main content
Skip table of contents

Downloading and Processing Listening Data

Once a listening query starts running, we download and process the corresponding data: (1) the listening mentions themselves and (2) data enrichments (additional information about the mentions for the analysis).

The processing rates for data and data enrichments vary; some data will be processed faster, some slower. It takes time to receive data from the social network itself, and we also process the listening data in batches, not post by post. For this reason, the new information about listening mentions will be continually updated in your feed. 

The following table shows what data is available, how often new data is downloaded, and how often existing data is updated:

Data range

Message type

New mentions collection frequency

Mentions metric update frequency

Data backfill

Twitter

all content

tweets, replies, mentions, retweets, quote tweets

real time

every 3 hours

365 days of historical data

Facebook

An extensive database of hundred of thousands profiles

+ any page of users' choice

posts, user posts and comments.

(Ads posts not included)

up to 1 hour

Comments: once a day

Posts: every 3 hours

365 days of historical data

Instagram

An extensive database of Business and Creator accounts

+ any Business or Creator account of users' choice

Posts.

(Comments not included)

up to 1 day

every 3 hours

365 days of historical data

Instagram hashtag search

Content of Business and Creator accounts and also public personal accounts using a specified hashtag in the text

Posts.

(Comments not included)

real time

no updates

n/a

YouTube

An extensive database of hundred of thousands channels

+ any channel of users' choice

videos

up to 8 hours

up to 8 hours

365 days of historical data

Web

Scans and extracts mentions from above a million of websites every day with over 10 millions of posts indexed daily.

news, blogs, forums

Ranges from 1 hour up to 24 hours for less frequentlv publishing websites.

no updates

30 days of historical data

Downloading and processing Today’s Listening data in Analytics

The delays in downloading data are apparent in Analytics when you include Today in the selected date range.

Today can be selected as a part of a broader date range and it’s also included in the following date range shortcuts:

  • Today

  • This Week

  • This Month

  • This Quarter

  • This Year

Although listening mentions are available almost immediately (per table above), it may take up to 2 hours to see advanced data such as sentiment, location, language, country, gender, topics, keywords, etc.

If you opt to see only Today’s data, you will be informed in the corresponding widget that there is still data to be loaded.

If you include Today in a more extended date range, there will typically be some data shown, but it may not include all the latest data., We will let you know that data may be missing with an alert icon and explanatory tooltip.

Community management of Listening data

When setting up a query, users can enable community management for mentions found via Listening. In other words, users decide if they want to send Listening mentions to Community feeds and allow agents to manage them the way they’re used to.

An easy way how to get to messages coming through Listening is to open Message types in the Filter panel and select Listening. Potentially, agents can save the filter set up as a feed.

Mentions that can be managed from Community

In general, Community agents will be getting mentions coming from Facebook, Twitter, Instagram and they’ll be able to assign them to other users, set statuses, apply labels and respond to them. 

However, each network works differently thus the possibilities for community management may differ as well.

Ability to respond, like and share Listening content

The option to respond, like and share Listening mentions from Community differs per each platform.

  • Facebook
    Agents will be able to like, comment and share Facebook posts and comments.
    If the account includes more than one profile, agents have to select what profile will be used for the interaction.

  • Instagram
    Agents can see Instagram posts coming via Listening, but due to technical limitations on Instagram’s side, it is not possible to react to them directly from the Emplifi Platform.
    However, agents are given the opportunity to Respond on Instagram, which is a link leading directly to the post on Instagram where a reaction is possible.

  • Twitter
    Agents will be able to like, retweet and reply to tweets and Twitter replies.
    If the account includes more than one profile, agents have to select what profile will be used for the interaction.

Once the agent responds, their message is available in the Sent feed or after opening the whole thread of the post or comment. The whole thread can be helpful when managing comments since it shows the parent post and provides agents with context.

On some occasions, the parent post may not be available, typically due to the social network's privacy policies or technical limitations. In such cases, we provide agents with a direct link to the post on the social platform.

Mentions that are not sent to Community 

Agents will not find in Community mentions to which they cannot react and respond. 

  • All mentions from the web source (Emplifi media package)

  • All mentions coming from YouTube

  • Historical data or, in other words, mentions from the past where responding has no point anymore 

Historical data

Historical data is available for the following sources:

  • Facebook

  • Instagram

  • Twitter

  • YouTube

  • Web

Once you create a query you can choose to collect historical data from up to 365 days in the past (30 days for web).

The data backfill is only available for query that starts collecting the mentions immediately; it is not available for query scheduled for the future.

By the nature of the data, the historical mentions won't appear in the Community module. Since we're talking about the past, such mentions would only make the Community cluttered, and there doesn't seem to be a good use case to show them.

In certain situations, the data backfill process can be paused or canceled:

What could happen

How does it affect data backfill

You stop collecting historical mentions while processing.

The data backfill stops. Your already collected data will be kept. 

You cannot resume the query due to technical limitations of platforms APIs.Duplicate and/or edit the query and run the job again.

Your account hits the annual limit of collected mentions.

The data backfill pauses. When the limit renews, the data download starts again from the point where it ended.

A query that you regulate hits your custom limit.

The data backfill stops. Your already collected data will be kept.

You cannot resume the query due to technical limitations on platforms APIs. Duplicate and/or edit the query and run the job again. 

Note: The custom limit is the limit (the number of mentions) that you set for your query.

A query is deleted.

The backfill is cancelled and all the already downloaded data will be removed.

A source is removed from a query.

The data backfill stops. Your already downloaded data will be kept.

You edit a query (for example, you remove or add a keyword).

The data backfill stops. Your already downloaded data will be kept.

Query is rescheduled for future.

The data backfill stops. Your already downloaded data will be kept. 

The query will continue from the new date but there will be a gap in your data (from the moment of the stop until the date when the query resumed).

Query reaches its end date but historical data has not been fully downloaded yet.

Historical data download continues until it completes.

JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.