Skip to content

vittorioerba/Streaming-Scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

This repository contains some quite old custom code that I used to make my streaming life easier. I had one problem: the interface of streaming websites did not contain any information on the quality of a movie, so it was not possible to just log in, filter by "good movies", and pick randomly! The code in this repo scraped a list of available movies, and fetched info from https://www.themoviedb.org for quality scores.

The streaming websites supported were Italy-based, and today they may not exist and their interface is most probably different. I am keeping the repo up just for historical fun.

Original README

I found SkyOnDemand's UI really difficoult to use. I mainly want to be able to sort the available movies by online ranking (like IMDB, TMDB and so on).

sky_on_demand_scraper.py

This script retrives the movie list from the "A-Z" list page. The results are saved in a csv file, with titles, year of release and nationality.

The main problem I had was given by the inifinte scrolling feature of the pages. I tracked the network requests of the page as I scrolled down, finding the urls of all the components loaded by the page.
The script keeps on requesting these pages incrementally, until it finds a 404: Page not found error. Then it stops and moves on to the next letter.

sky_on_demand_votes.py

This script interfaces with the free API of https://www.themoviedb.org and gets ranking and description of every movie in the inut csv file.

infinity

I recently added a couple of analogous scripts for Mediaset Infinity. Main probelm was that the content in their pages is dynamically loaded after the source is sent out, so that I had to figure out which request pointed to the right data. Then it was just reading a json and stripping the titles.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages