Try Hack Me - Web Fundamentals

Walkthrough of the room Web Fundamentals on TryHackMe. Let’s go!

Task 1: Introduction and Objectives

No answer is needed, so just read to understand the goal of the machine made by DarkStar.

“This room is designed as a basic intro to how the web works. We’ll cover HTTP requests and responses, web servers, cookies and then put them all to use in a mini Capture the Flag at the end.”

Click on the green button and let’s continue to Task 2. Please, remember to join the room!

Task 2: How do we load websites?

Finding the server Initially, a DNS request is made. DNS is like a giant phone book that takes a URL (Like https://tryhackme.com/) and turns it into an IP address. This means that people don’t have to remember IP addresses for their favorite websites. The IP address uniquely identifies each internet connected device, like a web server or your computer. These are formed of 4 groups of numbers, each 0-255 (x.x.x.x) and called an octet. An example shown below is 100.70.172.11. Loading some content Once the browser knows the server’s IP address, it can ask the server for the web page. This is done with a HTTP GET request. GET is an example of a HTTP verb, which are the different types of request (More on these later). The server will respond to the GET request with the web page content. If the web page is loading extra resources, like JavaScript, images, or CSS files, those will be retrieved in separate GET requests. Wireshark showing the HTTP requests that load a website (neverssl.com)

For most websites now, these requests will use HTTPS. HTTPS is a secure (encrypted) version of HTTP, it works in more or less the same way. This uses TLS 1.3 (normally) encryption in order to communicate without: Other parties being able to read the data. Other parties being able to modify the data.

Imagine if someone could modify a request to your bank to send money to your friend. That’d be disastrous!

A web server is software that receives and responds to HTTP(S) requests. Popular examples are Apache, Nginx and Microsoft’s IIS. By default, HTTP runs on port 80 and HTTPS runs on port 443. Many CTFs are based around websites, so it’s useful to know that if port 80 is open, there’s likely a web server listening that you can attack and exploit.

The actual content of the web page is normally a combination of HTML, CSS and JavaScript. HTML defines the structure of the page, and the content. CSS allows you to change how the page looks and make it look fancy. JavaScript is a programming language that runs in the browser and allows you to make pages interactive or load extra content.”

To start, I’d like to talk about the first part of task 1: Finding the server.

DNS —> IP ADDRESS. Imagine if we need to go to Facebook and despite our username or password, we would need to know the IP address of Facebook. That’s how DNS works. It was made to easier let you go to a website without the need to know the IP because the DNS gets the URL and turns it into an IP address. Right?

The IP address is responsible for identifying the device like your notebook. You can form an IP using 4 groups of numbers each (0-255). For example 100.80.170.12

Now, let’s talk about the last part of task 2: Loading some content.

Most websites use HTTPS requests because are encrypted, so HTTP requests are not recommended anymore (unfortunately, some websites still use them). When do you want to go to Facebook, your browser knows the IP and asks the server to load the page (Hi Facebook, I’m here, can you open the door?). To do it, we need an HTTP GET request and that’s how the server will load the page you want to go. When you need extra resources, we need more GET requests. Early, I said that we currently use HTTPS because is encrypted, right? Do you imagine why? HTTPS uses TLS encryption to protected other parties from being able to manipulate your data that’s why is so important! Port Runs by default: HTTP = 80 HTTPS = 443 If port 80 is open, you will probably need to attack and exploit a web server. HTML = STRUCTURE CSS = STYLE/DESIGN JAVASCRIPT = FUNCTIONS, INTERACTIONS

Answer the question below 1-What request verb is used to retrieve page content? GET 2-What port do web servers normally listen on? 80 3-What’s responsible for making websites look fancy? CSS

Task 3: More HTTP – Verbs and request formats

Requests

There are 9 different HTTP “verbs”, also known as methods. Each one has a different function. We’ve mentioned GET requests already, these are used to retrieve content. POST requests are used to send data to a web server, like adding a comment or performing a login.

There are several more verbs, but these aren’t as commonly used for most web servers.

A HTTP request can be broken down into parts. The first line is a verb and a path for the server, such as GET /index.html

The next section is headers, which give the web server more information about your request. Importantly, cookies are sent in the request headers, more on those later.

Finally, body of the request. For POST requests, this is the content that’s sent to the server. For GET requests, a body is allowed but will mostly be ignored by the server.

Here’s an example for a GET request retrieving a simple JS file: GET /main.js HTTP/1.1 Host: 192.168.170.129:8081 Connection: keep-alive User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.122 Safari/537.36 Accept: / Referer: http://192.168.170.129:8081/ Accept-Encoding: gzip, deflate Accept-Language: en-GB,en-US;q=0.9,en;q=0.8

From the headers, you can tell what I performed the request from (Chrome version 80, from Windows 10). This is useful for forensics and analysing packet captures. Responses

The server should reply with a response. The response follows a similar structure to the request, but the first line describes the status rather than a verb and a path. The status will normally be a code, you’re probably already familiar with 404: Not found. A basic breakdown of the status codes is: 100-199: Information 200-299: Successes (200 OK is the “normal” response for a GET) 300-399: Redirects (the information you want is elsewhere) 400-499: Client errors (You did something wrong, like asking for something that doesn’t exist) 500-599: Server errors (The server tried, but something went wrong on their side) You can find more information about these here: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status

Response headers can be very important. They can often tell you something about the web server sending them, or give you cookies that may prove useful later on.

The response will also have a body. For GET requests, this is normally web content or information such as JSON. For POST requests, it may be a status message or similar. Here’s a response to the GET request shown above: HTTP/1.1 200 OK Accept-Ranges: bytes Content-Length: 28 Content-Type: application/javascript; charset=utf-8 Last-Modified: Wed, 12 Feb 2020 12:51:44 GMT Date: Thu, 27 Feb 2020 21:47:30 GMT console.log(“Hello, World!”)

Answer the questions below 1-What verb would be used for a login? POST 2-What verb would be used to see your bank balance once you’re logged in? GET 3-Does the body of a GET request matter? NAY 4-What’s the status code for “I’m a teapot”? You need to go to mozilla developer website and find there that the status will be 418. The server refuses the attempt to brew coffee with a teapot. 5-What status code will you get if you need to authenticate to access some content, and you’re unauthenticated? 401 Unauthorized. Although the HTTP standard specifies “unauthorized”, semantically this response means “unauthenticated”. That is, the client must authenticate itself to get the requested response.

Task 4: Cookies, tasty!

What are cookies?

Cookies are small bits of data that are stored in your browser. Each browser will store them separately, so cookies in Chrome won’t be available in Firefox. They have a huge number of uses, but the most common are either session management or advertising (tracking cookies).Cookies are normally sent with every HTTP request made to a server.

Why Cookies?

Because HTTP is stateless (Each request is independent and no state is tracked internally), cookies are used to keep track of this. They allow sites to keep track of data like what items you have in your shopping cart, who you are, what you’ve done on the website and more.

Cookies can be broken down into several parts. Cookies have a name, a value, an expiry date and a path. The name identifies the cookie, the value is where data is stored, the expiry date is when the browser will get rid of the cookie automatically and the path determines what requests the cookie will be sent with. Cookies are normally only sent with requests to the site that set them (Weird things happen with advertising/tracking).

The server is normally what sets cookies, and these come in the response headers (“Set-Cookie”). Alternatively, these can be set from JavaScript inside your browser.

Using cookies

When you log in to a web application, normally you are given a Session Token. This allows the web server to identify your requests from someone else’s. Stealing someone else’s session token can often allow you to impersonate them.

Manipulating cookies

Using your browser’s developer tools, you can view and modify cookies. In Firefox, you can open the dev tools with F12. In the Storage tab, you can see cookies that the website has set. There’s also a “+” button to allow you to create your own cookies which will come in handy in a minute. You can modify all cookies that you can see in this panel, as well as adding more.

Alternatives - useful to know

Slowly, for some uses, LocalStorage and SessionStorage are used instead. This has a similar functionality but isn’t sent with HTTP requests by default. These are HTML5 features.

More on cookies https://developer.mozilla.org/en-US/docs/Web/HTTP/Cookies

READ AND TRY TO UNDERSTAND HOW COOKIES WORK. Click on the green button to go to Task 5.

Task 5: Mini CTF

Time to put what you’ve learnt to use!

Making HTTP requests

You can make HTTP requests in many ways, including without browsers! For CTFs, you’ll sometimes need to use cURL or a programming language as this allows you to automate repetitive tasks.

Intro to cURL

By default, cURL will perform GET requests on whatever URL you supply it, such as:

curl https://tryhackme.com

This would retrieve the main page for tryhackme with a GET request. Using command line flags for cURL, we can do a lot more than just GET content. The -X flag allows us to specify the request type, eg -X POST. You can specify the data to POST with –data, which will default to plain text data. It’s worth mentioning cURL does not store cookies, and you have to manually specify any cookies and values that you would like to send with your request. If you want to send cookies from cURL, you can look up how to do this.

Remember, cookies are not shared between different browsers (I’m counting cURL as a browser here).

Tasks

There’s a web server running on http://MACHINE_IP:8081. Connect to it and get the flags! GET request. Make a GET request to the web server with path /ctf/get POST request. Make a POST request with the body “flag_please” to /ctf/post Get a cookie. Make a GET request to /ctf/getcookie and check the cookie the server gives you Set a cookie. Set a cookie with name “flagpls” and value “flagpls” in your devtools (or with curl!) and make a GET request to /ctf/sendcookie

First, you will need to start your VPN. Then, let’s start the machine. Secondly, we need to open the web server running on http://10.10.185.231:8081

As he said, to get the flags we need to send a request to the web server by adding a path.

So, let’s do it!

Answer the questions below

1-What’s the GET flag? We go to http://10.10.185.231:8081/ctf/get and we found it!

2-What’s the POST flag? Let’s use curl. So, in your command type: curl -X POST –data “flag_please” http://10.10.185.231:8081/ctf/post

3-What’s the “Get a cookie” flag? We go to http://10.10.185.231:8081/ctf/getcookie and then we need to check your cookies. So, we open the “inspect element” page and then go to “network”. You will find the GET COOKIE and see the flag on your set-cookie on the headers tab.

4-What’s the “Set a cookie” flag? Let’s use curl again. So, in your command type: curl -v –cookie ‘flagpls=flagpls’ http://10.10.89.38:8081/ctf/sendcookie

Thank you!