PulseAugur
EN
LIVE 12:58:33

5.94 Billion TikTok Videos Dataset Released Open Source

By PulseAugur Editorial · [1 sources] ·

A user has compiled and released a massive dataset containing 5.94 billion TikTok videos and 3.23 billion profiles, making it freely available on Hugging Face. The data was collected over three weeks using a reverse-engineered method of the TikTok mobile application, which accesses publicly available endpoints. While the dataset is open source, the specific code used for scraping requires a fee, and the method may violate TikTok's terms of service. AI

IMPACT Provides a large dataset that could be used for training AI models, particularly in areas related to social media analysis and content understanding.

RANK_REASON User-generated dataset release, not a product or research from a primary AI lab.

Read on r/MachineLearning →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

5.94 Billion TikTok Videos Dataset Released Open Source

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
User-generated dataset release, not a product or research from a primary AI lab.
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Same-day
Cluster formed today. Ranking reflects the current source set at time of score.

Full methodology in our editorial standards.

COVERAGE [1]

  1. r/MachineLearning TIER_1 English(EN) · /u/DataShack ·

    I scraped 5.94 billion TikTok videos and 3.23 billion profiles in 3 weeks. Uploaded full dataset to Hugging Face for free. Step by step tutorial and code below. [P]

    <!-- SC_OFF --><div class="md"><p>Just uploaded the full 5.94 billion TikTok video dataset to Hugging Face. It’s fully open source:<br /> <a href="https://huggingface.co/datasets/kuben-developer/tiktok-videos-4b">https://huggingface.co/datasets/kuben-developer/tiktok-videos-4b</a…

RELATED ENTITIES

RELATED TOPICS