Skip to content

Data extraction from Idealista, using their API and web scraping (python). It contains both the datasets and the extraction files.

Notifications You must be signed in to change notification settings

laurabarredaagusti/idealista_data_extraction

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 

Repository files navigation

idealista_data_extraction

This repository contains two different ways of data extraction from Idealista site, from its API and by web scraping.

It was part of a collaborative project with a UX/UI design student, with the goal of analysing the available listings for people who could afford a maximum rent of 750 euroos.

Repository structure:

-- SRC

------ api_utils - python files to extract data from the api

---------- functions.py

---------- main.py

---------- variables.py

------ data - obtained datasets

---------- rent_madrid_api_dataset.csv - obtained data from the api

------ documentation - api documentation provided by Idealista

---------- authentication_documentation.pdf - documentation about the authentication

---------- search_documentation.pdf - documentation about the data extraction

------ notebooks

---------- data_extraction_api.ipynb - data extraction from api

------ scraping_utils

---------- classes.py

---------- functions.py

---------- main.py

---------- variables.py

About

Data extraction from Idealista, using their API and web scraping (python). It contains both the datasets and the extraction files.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published