/Python/List files in http directory python

List files in http directory python

import requests
from bs4 import BeautifulSoup

def get_url_paths(url, ext='', params={}):
    response = requests.get(url, params=params)
    if response.ok:
        response_text = response.text
    else:
        return response.raise_for_status()
    soup = BeautifulSoup(response_text, 'html.parser')
    parent = [url + node.get('href') for node in soup.find_all('a') if node.get('href').endswith(ext)]
    return parent

url = 'http://cdimage.debian.org/debian-cd/8.2.0-live/i386/iso-hybrid'
ext = 'iso'
result = get_url_paths(url, ext)
print(result)

Source: stackoverflow.com

Similar codes

5 votes160 views2 answers
String to binary python
Python
1 vote165 views1 answer
Convert pandas dataframe to django queryset
Python Django
1 vote155 views1 answer
Wtf forms required
Python
10 votes158 views3 answers
Pacman 30th anniversary
Python
3 votes152 views3 answers
Pandas map
Python
0 vote174 views5 answers
Difference between cut and qcut pandas
Python
0 vote169 views1 answer
Add sign to y axis values python
Python
0 vote171 views1 answer
This figure includes axes that are not compatible with tight_layout, so results might be incorrect
Python
1 vote155 views1 answer
Add search field to django admin
Python
0 vote152 views1 answer
Django queryset group by sum
Python