Trends, data feeds & data processing

Last updated 4 months ago

Setting up a new data feed in Trends

If you have subscribed to our Trends service, you can request the addition of a new data feed/source by reaching out to your Business representative at Labelcamp team providing technical details or documentation, a contact in the relevant DSP team and the nature of your contract (i.e. Merlin, direct, etc.). Your request will then be reviewed our team, considering its contractual frame and technical feasibility.

If approved, you will be asked to provide your company’s credentials to access the DSP’s data API or the server directory where your data reports are uploaded.

You may also be requested to perform certain actions with your CMS account of this DSP to allow the retrieval of data by the Labelcamp’s system.

Data ingestion and processing

Daily consumption data are displayed in Trends with a limited delay period, covering the download of the DSP data reports (whose time of release may vary from one source to another), its ingestion and processing in our analytics database before being made available in the Trends user interface.

Additional delays and gaps in data can occasionally occur for various reasons beyond Labelcamp’s control (e.g. data not released by the source, unexpected variation of the format of data export, etc.).

You can flag any issue of this sort by reaching out to Labelcamp’s team at help@labelcamp.io so we can investigate the issue.

Data JSON export

It is possible for a distributor to get a daily export of its Trends data on a Google Cloud storage bucket. Please reach out to your business contact for more information.

File description

Files are exported daily in json new line format (more information here: https://jsonlines.org/).

Each day, a new export is available and available in a Google Cloud storage bucket (more information here: https://cloud.google.com/products/storage).

Files are named as is :

gs://<bucket>/<distributor>_trends_extract_<timestamp>.json_<partnumber>

partnumber - Depending on the size of the export, the files can be splitted in many parts. Customer should take care of importing all parts available.

timestamp - the timestamp refers to the day the events were indexed in our db. Events inside are always older than the timestamp so you should only refer to transaction_date to know when an event occured.

Content description

field	description
eq_track_quantity	Nb of tracks consumed for this event (ie. 10 for an album of 5 tracks with 2 quantities)
quantity	Nb of events
product_age	Age of the release at the date of the event (in days)
artists	Array of artists names
played_percent	Percent of the track played
played_seconds	Playback time of the track in seconds
gender	Gender ID
birth_year	Birth year of the listener
user_id	DSP ID of the listener
transaction_date	Date of the event
creator	Creator ID
source	Source ID
playlist_xid	DSP ID of the playlist
retail_id	Retail ID
retail_name	Retail name
company_id	Company ID
company_name	Company Name
label_id	Label ID
label_name	Label Name
product_id	Product ID
product_name	Product Name
product_upc_code	Product UPC code
track_id	Track ID
track_name	Track name
track_subtitle	Track subtitle
track_artists	Track performers as a string
isrc_code	ISRC Code
video_name	Video name
territory_id	Territory ID
territory_name	Territory Name
code_alpha_2	Territory alpha code (2 letters)
product_genre_name	Genre name
product_subgenre_name	Subgenre name
product_genre_id	Genre ID
product_subgenre_id	Subgenre ID
gender_name	Gender name (Male, Female)
creator_name	Type of context (Automated, Editorial, User)
source_name	Context name (Artist or Album, Library, Playlist, Radio, Search)
playlist_name	Playlist name
playlist_curator	Playlist curator name
use_type	Type of usage for the event (stream, download, copy_scan, content_production)
city_name	Name of the listener's city

Sample

{
   "eq_track_quantity":"1",
   "quantity":"1",
   "product_age":"68342400",
   "artists":["An Artist"],
   "played_percent":1,
   "played_seconds":"256",
   "gender":"1",
   "birth_year":"2002",
   "user_id":"a120ff8ed9752c3f73293eca44a84282e01d45b5d2e31c460c63",
   "transaction_date":"2022-07-29",
   "creator":"3",
   "source":"4",
   "playlist_xid":"discoverWeekly",
   "retail_id":"36",
   "retail_name":"Spotify",
   "company_id":"1",
   "company_name":"Some contract",
   "label_id":"1",
   "label_name":"Cool sounds",
   "product_id":"1",
   "product_name":"An album",
   "product_upc_code":"5059435687940",
   "track_id":"1",
   "track_name":"A track",
   "track_subtitle":"",
   "track_artists":"An artist",
   "isrc_code":"GBBXM7510002",
   "territory_id":"1",
   "territory_name":"New Zealand",
   "city_name": "Auckland",
   "code_alpha_2":"NZ",
   "product_genre_name":"Electronic",
   "product_subgenre_name":"Drum \u0026amp; Bass | Vocal",
   "product_genre_id":"4",
   "product_subgenre_id":"58626",
   "gender_name":"Male",
   "creator_name":"Automated",
   "source_name":"Playlist",
   "playlist_name":"Your Discover Weekly",
   "playlist_curator":"discoverweekly",
   "use_type":"stream"
}
{
   "eq_track_quantity":"1",
   "quantity":"1",
   "product_age":"121564800",
   "artists":["Moses & seaguls","Doggy"],
   "played_percent":1,
   "played_seconds":"180",
   "birth_year":"1989",
   "user_id":"985b78a17a436bfc4e08d88c1fa8ef6f04cc1d97d6e3b",
   "transaction_date":"2022-07-29",
   "creator":"1",
   "source":"4",
   "playlist_xid":"spotify:playlist:73eQUbrQJffeQ9OMXNxS6U",
   "retail_id":"36",
   "retail_name":"Spotify",
   "company_id":"1",
   "company_name":"A contract",
   "label_id":"2",
   "label_name":"Sad songs",
   "product_id":"2",
   "product_name":"We Are Venom",
   "product_upc_code":"5054960938560",
   "track_id":"2",
   "track_name":"We Are Venom",
   "track_artists":"Moses & seaguls|Doggy",
   "isrc_code":"AUBEC1832724",
   "territory_id":"1",
   "territory_name":"New Zealand",
   "city_name": "Auckland",
   "code_alpha_2":"NZ",
   "product_genre_name":"Electronic",
   "product_subgenre_name":"Electro House",
   "product_genre_id":"2",
   "product_subgenre_id":"2",
   "creator_name":"User",
   "source_name":"Playlist",
   "playlist_name":"CAR BASSBOOSTED💥🔊",
   "playlist_curator":"Ayman",
   "use_type":"stream"
}

Retention

Files are stored for 90 days on the bucket

Please get in touch with your usual business representative if you wish to subscribe to this additional service.