/Python/List files in http directory python

List files in http directory python

import requests
from bs4 import BeautifulSoup

def get_url_paths(url, ext='', params={}):
    response = requests.get(url, params=params)
    if response.ok:
        response_text = response.text
    else:
        return response.raise_for_status()
    soup = BeautifulSoup(response_text, 'html.parser')
    parent = [url + node.get('href') for node in soup.find_all('a') if node.get('href').endswith(ext)]
    return parent

url = 'http://cdimage.debian.org/debian-cd/8.2.0-live/i386/iso-hybrid'
ext = 'iso'
result = get_url_paths(url, ext)
print(result)

Source: stackoverflow.com

Similar codes

0 vote286 views1 answer
Hpw to create related model in django rest framework logic
Python Django
7 votes207 views1 answer
Np in python
Python
0 vote213 views2 answers
Bar Charts bokeh
Python
0 vote203 views1 answer
IQR to remove outlier
Python
0 vote254 views1 answer
Pydantic numpy ndarray type
Python
3 votes263 views2 answers
Django get parameters from url
Python
0 vote191 views1 answer
Encoding read_csv
Python
15 votes200 views4 answers
Method for detect that a float number is integer in python
Python
4 votes196 views1 answer
Get file creation date py
Python
7 votes203 views4 answers
Force utf-8 encoding python
Python