Answered: Scenario: You have been tasked with…

Database System Concepts

7th Edition

ISBN:9780078022159

Author:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan

Publisher:Abraham Silberschatz Professor, Henry F. Korth, S. Sudarshan

Chapter1: Introduction

Section: Chapter Questions

Problem 1PE

See similar textbooks

Related questions

Question

100%

Scenario:

You have been tasked with building a URL file validator for a web crawler. A web crawler is an application that fetches a web page, extracts the URLs present in that page, and then recursively fetches new pages using the extracted URLs. The end goal of a web crawler is to collect text data, images, or other resources present in order to validate resource URLs or hyperlinks on a page. URL validators can be useful to validate if the extracted URL is a valid resource to fetch. In this scenario, you will build a URL validator that checks for supported protocols and file types.

What you
need to know
#example-1
student_detail =
print (student_det
["John", "25", "E
#example-2
student_detail =
print (student_det
["John", "25", "E
Validation
2/4
main.py
1 def validate_url(url):
2
valid_protocols = ["http, https, ftp"]
3 valid_fileinfo = ['.html', '.csv', '.docx']
4
5 if protocol in valid_protocols
6
valid_protocols = True
7 else:
8
if protocol
9 #test the function
10 if __name__ == '__main__':
11
12
13
14
15 https://www.technotification.com/2018/06/
16
50
17
X +
"
{
url=input("Enter an Url: ")
print(validate_url(url))
best-programming-blog.html

Expert Solution

Trending now

This is a popular solution!

Step by step

Solved in 3 steps with 2 images

SEE SOLUTION Check out a sample Q&A here

Knowledge Booster

Learn more about

Need a deep-dive on the concept behind this application? Look no further. Learn more about this topic, computer-science and related others by exploring similar questions and additional content below.

Similar questions