Data Flow & Live Pipeline
ALL SYSTEMS OPERATIONALAutomated CRON ingestion monitor, execution history, scheduled pipelines & API consumer traffic
Last Ingest:
4 min ago
Matches in Hub
sports_soccer31,477
recordsVerified master matches (SSOT)
Job Runs Today
schedule359
99.4% OK357 success • 1 errors
API Requests Today
api312
+LiveServed to authenticated consumers
Master Ingest SSOT
verifiedOPTA (500)
ACTIVEFallback: football-data.org (300)
health_and_safety
Data Integrity & Health Checks
warning 1 LEAGUE ANOMALIES DETECTEDAutomated quota validation enforcing strict canonical team counts per league in Season 2026/2027. Flags duplicates, intruder clubs and unlinked fixtures.
Healthy:
8 / 9
Excess Anomalies:
1
Unlinked Matches:
0
🏴
HEALTHY
Premier League
England • 2026/2027
Active Clubs / Target Quota:
20
/
20
TEAM / CLUB NAME
MATCHES (26/27)
20 m
20 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
🇪🇸
EXCESS (+1)
La Liga
Spain • 2026/2027
Active Clubs / Target Quota:
21
/
20
TEAM / CLUB NAME
MATCHES (26/27)
20 m
20 m
20 m
20 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
18 m
1 m
🇮🇹
HEALTHY
Serie A
Italy • 2026/2027
Active Clubs / Target Quota:
20
/
20
TEAM / CLUB NAME
MATCHES (26/27)
20 m
20 m
20 m
20 m
20 m
20 m
20 m
20 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
19 m
🇩🇪
HEALTHY
Bundesliga
Germany • 2026/2027
Active Clubs / Target Quota:
18
/
18
TEAM / CLUB NAME
MATCHES (26/27)
21 m
20 m
19 m
19 m
18 m
18 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
🇫🇷
HEALTHY
Ligue 1
France • 2026/2027
Active Clubs / Target Quota:
18
/
18
TEAM / CLUB NAME
MATCHES (26/27)
23 m
20 m
18 m
18 m
18 m
18 m
18 m
18 m
18 m
18 m
18 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
🇵🇱
HEALTHY
Ekstraklasa
Poland • 2026/2027
Active Clubs / Target Quota:
18
/
18
TEAM / CLUB NAME
MATCHES (26/27)
18 m
18 m
18 m
18 m
18 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
🇳🇱
HEALTHY
Eredivisie
Netherlands • 2026/2027
Active Clubs / Target Quota:
18
/
18
TEAM / CLUB NAME
MATCHES (26/27)
28 m
27 m
27 m
27 m
27 m
26 m
22 m
21 m
21 m
21 m
21 m
21 m
21 m
20 m
20 m
19 m
19 m
18 m
🇵🇹
HEALTHY
Primeira Liga
Portugal • 2026/2027
Active Clubs / Target Quota:
18
/
18
TEAM / CLUB NAME
MATCHES (26/27)
18 m
18 m
18 m
18 m
18 m
18 m
18 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
🇧🇪
HEALTHY
Jupiler Pro League
Belgium • 2026/2027
Active Clubs / Target Quota:
18
/
18
TEAM / CLUB NAME
MATCHES (26/27)
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
17 m
history Jobs Execution History Log (Last 10 Runs)
Real-time log of the latest 10 automated background tasks
| Started At | Job Name | Status | Records Updated | Duration | Memory | Details / Errors |
|---|---|---|---|---|---|---|
| 2026-09-27 12:12:02 | sync_superbet_hourly | Running | 0 | — | — | OK |
| 2026-09-27 12:10:02 | settle_picks | Completed | 0 | 0.41s | 14.0 MB | OK |
| 2026-09-27 12:10:02 | opta_history_backfill | Completed | 0 | 0.16s | 10.0 MB | OK |
| 2026-09-27 12:07:02 | sync_dh_match_main | Completed | 999 open_in_new | 24.00s | 30.0 MB | OK |
| 2026-09-27 12:05:02 | settle_picks | Completed | 0 | 0.59s | 12.0 MB | OK |
| 2026-09-27 12:03:01 | understat_scrape_stats | Completed | 0 | 0.06s | 10.0 MB | OK |
| 2026-09-27 12:00:05 | settle_picks | Completed | 0 | 0.52s | 14.0 MB | OK |
| 2026-09-27 12:00:05 | opta_history_backfill | Completed | 0 | 0.18s | 12.0 MB | OK |
| 2026-09-27 12:00:02 | opta_fixtures | Completed | 0 | 2.72s | 12.0 MB | OK |
| 2026-09-27 11:55:02 | settle_picks | Completed | 0 | 0.43s | 12.0 MB | OK |
swap_calls Spider Scraper & Remote API Traffic Stream (IN / OUT) Last 10 Events
Sequential API event stream: Ingestion from scrapers (IN) & data reads (OUT) • Zaloguj się, aby przeglądać pełną historię zdarzeń.
IN (Write)
OUT (Read)
| Timestamp | Direction | Node / Sender | Method & Endpoint | Operation Summary | Resp. Time | HTTP Status |
|---|---|---|---|---|---|---|
| 2026-09-27 10:10:15 | download IN | Spider Web Engine Key |
POST
/datahub/api/db_admin.php?action=migrate
|
Opta • 4 mecze • 310 statystyk (Backfill 2025/2026) (part 9/9) | 2 ms | 200 OK |
| 2026-09-27 10:10:14 | download IN | Spider Web Engine Key |
POST
/datahub/api/db_admin.php?action=migrate
|
Opta • 4 mecze • 310 statystyk (Backfill 2025/2026) (part 8/9) | 7 ms | 200 OK |
| 2026-09-27 10:10:14 | download IN | Spider Web Engine Key |
POST
/datahub/api/db_admin.php?action=migrate
|
Opta • 4 mecze • 310 statystyk (Backfill 2025/2026) (part 7/9) | 5 ms | 200 OK |
| 2026-09-27 10:10:14 | download IN | Spider Web Engine Key |
POST
/datahub/api/db_admin.php?action=migrate
|
Opta • 4 mecze • 310 statystyk (Backfill 2025/2026) (part 6/9) | 6 ms | 200 OK |
| 2026-09-27 10:10:14 | download IN | Spider Web Engine Key |
POST
/datahub/api/db_admin.php?action=migrate
|
Opta • 4 mecze • 310 statystyk (Backfill 2025/2026) (part 5/9) | 5 ms | 200 OK |
| 2026-09-27 10:10:13 | download IN | Spider Web Engine Key |
POST
/datahub/api/db_admin.php?action=migrate
|
Opta • 4 mecze • 310 statystyk (Backfill 2025/2026) (part 4/9) | 6 ms | 200 OK |
| 2026-09-27 10:10:13 | download IN | Spider Web Engine Key |
POST
/datahub/api/db_admin.php?action=migrate
|
Opta • 4 mecze • 310 statystyk (Backfill 2025/2026) (part 3/9) | 6 ms | 200 OK |
| 2026-09-27 10:10:13 | download IN | Spider Web Engine Key |
POST
/datahub/api/db_admin.php?action=migrate
|
Opta • 4 mecze • 310 statystyk (Backfill 2025/2026) (part 2/9) | 6 ms | 200 OK |
| 2026-09-27 10:10:12 | download IN | Spider Web Engine Key |
POST
/datahub/api/db_admin.php?action=migrate
|
Opta • 4 mecze • 310 statystyk (Backfill 2025/2026) (part 1/9) | 6 ms | 200 OK |
| 2026-09-27 12:00:00 | upload OUT | Spider Web Engine Key |
GET
matches/to-scrape
|
Pobranie meczy do zescrapowania | 2 ms | 200 OK |
Pokazano 10 ostatnich zdarzeń (podgląd dla gości)
Zaloguj się, aby zobaczyć pełną historię API
arrow_forward
pending_actions Pending Odds Ingestion & Missing Bookmakers Queue (Top 10)
Upcoming fixtures requiring odds sync from legal bookmaker feeds (live_scraper & Android agents)
| Fixture / Match | Kickoff | Available Feeds | Missing Bookmakers (To Ingest) | Target Agent | Queue Status |
|---|---|---|---|---|---|
| No pending match odds sync required. All upcoming matches are synced. | |||||
cloud_sync Automated Ingestion Streams (Uploads)
Continuous data pipelines powering the DataHub
calendar_month
Match Schedules & Lineups
OPTA SSOTDaily fixtures, confirmed team lineups, referee appointments & metadata across 7 European leagues
schedule
Daily at 02:00 UTC
Operational
bar_chart
Post-Match Statistics & Player xG
OPTA SSOTOfficial final scores, 19 comprehensive player props metrics, advanced expected goals (xG) & timeline events
schedule
Daily at 23:30 UTC
Operational
show_chart
Live Odds & Market Movements
ODDSReal-time 1X2, Over/Under, BTTS & handicap updates pushed by spider_scraper agent (Samsung-USB) from 5 bookmakers
schedule
Every 60 minutes
Operational
sync
SSOT Master Sync & Deduplication
COREReal-time record resolution, source prioritizing (Opta Priority 500) and master catalog indexing
schedule
Every 30 minutes
Operational
cloud_download
Secondary Tier Leagues Fallback
FALLBACKSchedules and results for non-Opta leagues (Eredivisie, Primeira Liga)
schedule
Daily at 03:00 UTC
Operational
download Top Data Consumers Today
Anonymous activity leaderboard (Privacy protected)
| # | Consumer | Channel | Plan | Calls (24h) | Top Endpoint |
|---|---|---|---|---|---|
| 1 |
spider_scraper 🤖
|
terminal API | BOT | 412 |
/sync/pending
|
| 2 |
M. S.
|
terminal API | PRO | 234 |
/matches
|
| 3 |
A. K.
|
language Web | PRO | 189 |
/odds
|
| 4 |
User #7f2b
|
terminal API | FREE | 94 |
/teams
|
| 5 |
P. W.
|
language Web | FREE | 61 |
/matches/{id}
|
database Active League Coverage & Master Match Index (Top 20)
Top 20 active synchronized competitions
| Competition / League | Country | Master Matches | Latest Match Date | Ingest Engine | Status |
|---|---|---|---|---|---|
| trophy Serie A | Italy | 1,473 | 2027-05-30 | OPTA SSOT (500) | SYNCED |
| trophy La Liga | Spain | 1,339 | 2027-05-30 | OPTA SSOT (500) | SYNCED |
| trophy Premier League | England | 1,284 | 2027-05-30 | OPTA SSOT (500) | SYNCED |
| trophy Bundesliga | Germany | 1,277 | 2027-05-22 | OPTA SSOT (500) | SYNCED |
| trophy Ligue 1 | France | 1,230 | 2027-05-29 | OPTA SSOT (500) | SYNCED |
| trophy Eredivisie | Netherlands | 793 | 2027-05-23 | OPTA SSOT (500) | SYNCED |
| trophy Primeira Liga | Portugal | 627 | 2027-05-16 | FALLBACK (300) | SYNCED |
| trophy Ekstraklasa | Poland | 625 | 2027-05-22 | OPTA SSOT (500) | SYNCED |
| trophy Championship | England | 422 | 2027-05-01 | FALLBACK (300) | SYNCED |
| trophy Serie B | Brazil | 397 | 2027-05-14 | FALLBACK (300) | SYNCED |
| trophy Champions League | Europe | 347 | 2027-01-27 | FALLBACK (300) | SYNCED |
| trophy Jupiler Pro League | Belgium | 306 | 2027-05-22 | FALLBACK (300) | SYNCED |
| trophy Friendlies Clubs | Europe | 177 | 2026-07-23 | FALLBACK (300) | SYNCED |
| trophy World Cup | International | 105 | 2026-07-19 | FALLBACK (300) | SYNCED |
| trophy UEFA Europa Conference League | Europe | 49 | 2026-07-23 | FALLBACK (300) | SYNCED |
| trophy Cup | Europe | 19 | 2026-07-23 | FALLBACK (300) | SYNCED |
| trophy League Cup | England | 16 | 2026-07-22 | FALLBACK (300) | SYNCED |
| trophy Reserve League | Europe | 16 | 2026-07-23 | FALLBACK (300) | SYNCED |
| trophy Major League Soccer | USA | 15 | 2026-07-23 | FALLBACK (300) | SYNCED |
| trophy Premier Soccer League | Europe | 9 | 2026-07-23 | FALLBACK (300) | SYNCED |
smart_toy
Spyder Scraper 🤖
Real-time status of legal bookmaker odds & Opta stats scraper agent
thermostat
NO TEMP (—)
STANDBY / IDLE
Last Active Ping
schedule
2026-08-25 08:48:36
47726 min ago
Battery Temp
thermostat
—
Threshold: 42.0°C MAX
CPU Temp (SoC)
memory
—
Threshold: 45.0°C MAX
Battery Level
battery_charging_full
—
IP: 91.216.213.145
Calls Ingested Today
sync_alt
0 requests
Odds & Opta Ingestion
history
Recent Spyder Scraper Ingestion Log (Last 5 Calls)
Log recording battery, CPU temp & battery % per request
| Timestamp | Endpoint | Method | HTTP Status | Battery Temp | CPU Temp | Battery % | Response Time | Payload Summary |
|---|---|---|---|---|---|---|---|---|
| No recent Spyder Scraper ingestion log entries. | ||||||||
show_chart Device & CPU Temperature Over Time (°C per REST Request)
Device battery & CPU temperature logged on each REST API request. Dashed lines indicate thermal thresholds (38.0°C / 42.0°C). 0°C indicates missing temp header.
Battery Temp (< 38°C)
Warm (38-42°C)
High (> 42°C - Cooling required)
0°C (Missing / Error)
No recorded device temperature measurements in Spyder Scraper logs.
shield
Privacy & Cookie Preferences
We use cookies and analytical signals to ensure platform functionality, analyze traffic, and improve predictions. Under European privacy laws (GDPR/DMA), you can customize your consent for data processing and personalized features.