- \n
- What is an HTTP server?<\/a><\/li>\n
- The TCP socket address<\/a><\/li>\n
- Create a simple HTTP file<\/a><\/li>\n
- Create an HTTP web server<\/a><\/li>\n<\/ul>\n
What is an HTTP Server?<\/h2>\n
An HTTP web server is nothing but a process that is running on your machine and does exactly two things:<\/p>\n
1- Listens<\/em> for incoming http requests on a specific TCP socket address (IP address and a port number which I will talk about later)<\/p>\n
2- Handles<\/em> this request and sends a response back to the user.<\/p>\n
Let me make my point less abstract.<\/p>\n
Imagine you pull up your Chrome browser and type www.yahoo.com<\/strong> in the address bar.<\/p>\n
![\"\"](\"http:\/\/www.afternerd.com\/blog\/wp-content\/uploads\/2018\/10\/Screen-Shot-2018-10-30-at-3.39.26-PM.png\")
<\/p>\nOf course you are going to get the Yahoo home page rendered on your browser window.<\/p>\n
But what really just happened under the hood?<\/em><\/p>\n
Actually a lot of things have happened and I might dedicate a whole article to explain the magic behind how this happened.<\/p>\n
But for the sake of simplicity, I will abstract away some of the details and talk about this at a\u00a0very<\/em> high level.<\/p>\n
At a high level, when you type www.yahoo.com\u00a0<\/strong>on your browser, your browser will create a network message called an HTTP request<\/a>.<\/p>\n
This Request will travel all the way to a Yahoo computer that has a web server running on it. This web server will intercept your request, and handle it by responding back with the html of the Yahoo home page.<\/p>\n
Finally your browser renders this html on the screen and that’s what you see on your screen.<\/p>\n
![\"\"](\"http:\/\/www.afternerd.com\/blog\/wp-content\/uploads\/2018\/10\/http.png\")
<\/p>\nEvery interaction with the Yahoo home page after that (for example, when you click on a link) initiates a new request and response exactly like the first one.<\/p>\n
To reiterate, the machine that receives the http request has a software process called a web server running on it. This web server is responsible for intercepting these requests<\/strong> and handling them appropriately<\/strong>.<\/p>\n
Alright, now that you know what a web server is and what its function is exactly, you might be wondering how does the request reach that yahoo machine in the first place?<\/p>\n
Good question!<\/p>\n
In fact this is one of my favorite questions that I ask potential candidates in a coding interview<\/a>.<\/p>\n
Let me explain how, but again….at a high level.<\/p>\n
The TCP Socket Address<\/h2>\n
![\"\"](\"http:\/\/www.afternerd.com\/blog\/wp-content\/uploads\/2018\/10\/tcpsocketaddressing.png\")
<\/p>\nAny http message (whether it is a request or response) needs to know how to reach its destination.<\/p>\n
In order to reach its destination, each http message carries an address called the destination TCP address<\/em>.<\/p>\n
And each TCP address<\/em> is composed of an IP address<\/strong> and a port number<\/strong>.<\/p>\n
I know all these acronyms (TCP, IP, etc..) might be overwhelming if your networking concepts are not strong.<\/p>\n
I will try to keep it simple but if you are interested in improving your knowledge of networking concepts, I highly recommend this book by Ross and Kurose<\/a>.<\/p>\n
So where is that address when all you did was type www.yahoo.com<\/strong>\u00a0on your browser?<\/p>\n
Well, this domain name is converted into an IP address through a large distributed database called the DNS<\/a>.<\/p>\n
Do you want to check out what this IP address is?<\/em><\/p>\n
Easy! Head to your terminal and do the following:<\/p>\n
$ host yahoo.com\r\nyahoo.com has address 98.138.219.231\r\nyahoo.com has address 98.137.246.8\r\nyahoo.com has address 98.138.219.232\r\nyahoo.com has address 72.30.35.9\r\nyahoo.com has address 98.137.246.7\r\nyahoo.com has address 72.30.35.10\r\nyahoo.com has IPv6 address 2001:4998:44:41d::3\r\nyahoo.com has IPv6 address 2001:4998:c:1023::5\r\nyahoo.com has IPv6 address 2001:4998:c:1023::4\r\nyahoo.com has IPv6 address 2001:4998:58:1836::10\r\nyahoo.com has IPv6 address 2001:4998:58:1836::11\r\nyahoo.com has IPv6 address 2001:4998:44:41d::4\r\nyahoo.com mail is handled by 1 mta5.am0.yahoodns.net.\r\nyahoo.com mail is handled by 1 mta6.am0.yahoodns.net.\r\nyahoo.com mail is handled by 1 mta7.am0.yahoodns.net.<\/code><\/pre>\nAs you can see, the DNS will translate yahoo.com<\/strong> to any of the addresses above.<\/p>\n
The IP address alone will allow the HTTP message to arrive at the right machine, but you still need the port number in order for the HTTP request to arrive exactly at the web server.<\/p>\n
In other words, the web server is a regular network application that is listening on a specific port.<\/p>\n
And the http request MUST be addressed to that port.<\/p>\n
So where is the port number when you type www.yahoo.com<\/strong>?<\/p>\n
By default, the port number is 80 for http<\/strong> and 443 for https<\/strong>, so even though you haven’t explicitly specified the port number, it is still there.<\/p>\n
And if the web server is listening on a non-default port number (neither 80 nor 443), you must explicitly specify the port number like this:<\/p>\n
![\"\"](\"http:\/\/www.afternerd.com\/blog\/wp-content\/uploads\/2018\/10\/Screen-Shot-2018-10-30-at-7.07.38-PM.png\")
\nBy now you should have all the necessary information to create an http web server in Python.<\/p>\nSo without further ado, let’s get started.<\/p>\n
Create a simple HTML file<\/h2>\n
Here is what we want to do.<\/p>\n
We want to create a simple http server that serves a static html web page.<\/p>\n
Let’s create our html page.<\/p>\n
<html>\r\n <head>\r\n <title>Python is awesome!<\/title>\r\n <\/head>\r\n <body>\r\n <h1>Afternerd<\/h1>\r\n <p>Congratulations! The HTTP Server is working!<\/p>\r\n <\/body>\r\n<\/html><\/code><\/pre>\nNow go ahead and save this file as index.html<\/span><\/p>\n
With the web page that we want to serve out of the way, the next step is to create a web server that will serve this html page.<\/p>\n
Create an HTTP web server<\/h2>\n
In order to create a web server in Python 3<\/strong>, you will need to import two modules: http.server<\/span> and socketserver<\/span><\/p>\n
\nNotice that in Python 2<\/strong>, there was a module named\u00a0SimpleHTTPServer<\/a>. This module has been merged into http.server in Python 3<\/strong><\/div>\nLet’s take a look at the code to create an http server<\/p>\n
import http.server\r\nimport socketserver\r\n\r\nPORT = 8080\r\nHandler = http.server.SimpleHTTPRequestHandler\r\n\r\nwith socketserver.TCPServer((\"\", PORT), Handler) as httpd:\r\n print(\"serving at port\", PORT)\r\n httpd.serve_forever()<\/code><\/pre>\nJust like that we have a functional http server.<\/p>\n
Now let’s dissect this code line-by-line.<\/p>\n
First, as I mentioned earlier, a web server is a process that listens to incoming requests on specific TCP address.<\/p>\n
And as you know by now a TCP address is identified by an ip address<\/em> and a port number<\/em>.<\/p>\n
Second, a web server also needs to be told how to handle incoming requests.<\/p>\n
These incoming requests are handled by special handlers. You can think of a web server as a dispatcher, a request comes in, the http server inspects the request and dispatches it to a designated handler.<\/p>\n
Of course these handlers can do anything you desire.<\/p>\n
But what do you think the most basic handler is?<\/em><\/p>\n
Well, that would be a handler that just serves a static file.<\/p>\n
In other words, when I go to yahoo.com<\/strong>, the web server at the other end sends back a static html file.<\/p>\n
This is in fact what we are exactly trying to do.<\/p>\n
And that, my friend, is what the http.server.SimpleHTTPRequestHandler<\/span> is: a simple HTTP request handler that serves files from the current directory<\/strong> and any of its subdirectories<\/strong>.<\/p>\n
Now let’s talk about the socketserver.TCPServer<\/strong> class.<\/p>\n
An instance of TCPServer<\/strong> describes a server that uses the TCP protocol to send and receive messages (http is an application layer protocol on top of TCP).<\/p>\n
To instantiate a TCP Server, we need two things:<\/p>\n
1- The TCP address (IP address and a port number)<\/em><\/p>\n
2- The handler<\/em><\/p>\n
socketserver.TCPServer((\"\", PORT), Handler)<\/code><\/pre>\nAs you can see, the TCP address is passed as a tuple of (ip address, port number)<\/span><\/p>\n
Passing an empty string as the ip address means that the server will be listening on any network interface (all available IP addresses).<\/p>\n
And since PORT<\/strong> stores the value of 8080, then the server will be listening on incoming requests on that port.<\/p>\n
For the handler, we are passing the simple handler that we talked about earlier.<\/p>\n
Handler = http.server.SimpleHTTPRequestHandler\r\n<\/code><\/pre>\nWell, how about serve_forever<\/span>?<\/p>\n
serve_forever<\/strong> is a method on the TCPServer instance that starts the server and begins listening and responding to incoming requests.<\/p>\n
Cool, let’s save this file as server.py<\/strong> in the same directory<\/em> as index.html<\/strong> because by default the SimpleHTTPRequestHandler<\/strong> will look for a file named index.html<\/strong> in the current directory.<\/p>\n
In that directory, start the web server:<\/p>\n
$ python server.py\r\nserving at port 8080<\/code><\/pre>\nBy doing that, you now have an HTTP server that is listening on any interface at port 8080 waiting for incoming http requests.<\/p>\n
It’s time now for the fun stuff!<\/p>\n
Open your browser and type localhost:8080 in the address bar.<\/p>\n
![\"\"](\"http:\/\/www.afternerd.com\/blog\/wp-content\/uploads\/2018\/10\/Screen-Shot-2018-10-29-at-5.48.05-PM.png\")
<\/p>\nAwesome! Looks like everything is working fine.<\/p>\n
But hey what is localhost<\/strong>?<\/p>\n
localhost<\/b> is a host name\u00a0that means\u00a0this computer<\/i>. It is used to access the network services that are running on the host via the loopback network interface.<\/p>\n
And since the web server is listening on any<\/strong> interface, it is also listening on the loopback interface.<\/p>\n
You want to know what IP address corresponds to localhost?<\/p>\n
You got it.<\/p>\n
$ host localhost\r\nlocalhost has address 127.0.0.1\r\nlocalhost has IPv6 address ::1\r\nHost localhost not found: 3(NXDOMAIN)<\/code><\/pre>\nIn fact you can totally replace localhost<\/strong> with 127.0.0.1<\/strong> in your browser and you would still get the same result.<\/p>\n
Try it out \ud83d\ude42<\/p>\n
One Final Word<\/h2>\n
You can actually start a web server with python without even having to write any scripts.<\/p>\n
Just go to your terminal and do the following (but make sure you are on python 3)<\/p>\n
python -m http.server 8080<\/code><\/pre>\nBy default, this server will be listening on all interfaces and on port 8080.<\/p>\n
If you want to listen to a specific interface, do the following:<\/p>\n
python -m http.server 8080 --bind 127.0.0.1<\/code><\/pre>\nAlso starting from Python 3.7, you can use the –directory<\/span> flag to serve files from a directory that is not necessarily the current directory.<\/p>\n
So the question now is, why would you ever need to write a script when you can just invoke the server easily from the terminal?<\/p>\n
Well, remember that you are using the\u00a0SimpleHTTPRequestHandler<\/strong>. If you want to create your custom handlers (which you will probably want to do) then you won’t be able to do that from the terminal.<\/p>\n
Learning Python?<\/h3>\n
Check out the Courses section!<\/a><\/p>\n\n
Featured Posts<\/h2>\n
- \n
- The Python Learning Path (From Beginner to Mastery)<\/a><\/li>\n
- Learn Computer Science (From Zero to Hero)<\/a><\/li>\n
- Coding Interview Preparation Guide<\/a><\/li>\n
- The Programmer’s Guide to Stock Market Investing<\/a><\/li>\n
- How to Start Your Programming Blog?<\/a><\/li>\n<\/ul>\n
\nAre you Beginning your Programming Career?<\/h2>\n
I provide my best content for beginners in the newsletter.<\/h3>\n
- \n
- Python tips for beginners, intermediate, and advanced levels.<\/li>\n
- CS Career tips and advice.<\/li>\n
- Special discounts on my premium courses when they launch.<\/li>\n<\/ul>\n
And so much more…<\/p>\n
Subscribe now. It’s Free.<\/h3>\n
- Learn Computer Science (From Zero to Hero)<\/a><\/li>\n
- The TCP socket address<\/a><\/li>\n