1 00:00:00,060 --> 00:00:02,990 So, guys, in this video, we are going to talk about these robots. 2 00:00:04,350 --> 00:00:05,720 So these are text file. 3 00:00:06,090 --> 00:00:08,610 And now I will show you one example. 4 00:00:09,210 --> 00:00:11,080 That is let's say this is Goulder. 5 00:00:11,370 --> 00:00:12,570 Yes, this will come. 6 00:00:12,750 --> 00:00:16,600 Now, let us assume that I am the owner of this Google dot com. 7 00:00:16,800 --> 00:00:21,220 OK, I know I am not, but let's assume that I'm the owner of guru.com. 8 00:00:21,240 --> 00:00:28,280 Suppose I want to I'm going to create another small application and I want to test that application 9 00:00:29,550 --> 00:00:30,660 so that application. 10 00:00:30,660 --> 00:00:32,600 But this water comes fresh. 11 00:00:33,330 --> 00:00:34,530 So my app. 12 00:00:36,090 --> 00:00:37,780 So it's just for an hour for error. 13 00:00:39,240 --> 00:00:40,290 So OK. 14 00:00:40,500 --> 00:00:47,970 My app and I get some actual data because I'm developing my app and I want to put that in my app for 15 00:00:47,970 --> 00:00:48,210 that. 16 00:00:48,240 --> 00:00:53,190 So since we do not have my application, it gave me an hour for. 17 00:00:53,250 --> 00:00:57,610 So let's assume that I have some this this is my job. 18 00:00:58,170 --> 00:01:06,590 So if there are some errors or any bugs in this webpage, it can lead to some exploitation. 19 00:01:06,900 --> 00:01:07,350 So. 20 00:01:08,270 --> 00:01:10,520 I want to take this one step further. 21 00:01:10,670 --> 00:01:20,300 I don't want any Google search search engines like Google, Yahoo, Bing, not to display my dishearteningly. 22 00:01:21,820 --> 00:01:23,930 So you can just Google. 23 00:01:24,010 --> 00:01:34,270 You can just Google about this map and that Google's browser will not display this map, but so because 24 00:01:34,630 --> 00:01:36,520 I put this map in robots. 25 00:01:37,960 --> 00:01:46,270 So whatever the content in the robots, the text file, the Web browsers so courageously Google, uh, 26 00:01:46,270 --> 00:01:53,080 like search engines, like Google, Yahoo, Bing, any other search engine will not display that in 27 00:01:53,080 --> 00:01:53,610 the results. 28 00:01:53,800 --> 00:02:04,000 So if I put my up in my, uh, robot strategy file of my, uh, this guru.com main domain, then search 29 00:02:04,000 --> 00:02:11,890 engines will not find that, uh, this directory and will not display any content from this. 30 00:02:12,160 --> 00:02:17,830 You need to manually find out because you need to guess that the reason my father is from Google or 31 00:02:17,830 --> 00:02:26,150 any other Certina you cannot find this year, because my app has been like, uh, hidden from, uh, 32 00:02:26,200 --> 00:02:26,950 search engines. 33 00:02:27,970 --> 00:02:29,380 So I will show you that one. 34 00:02:29,410 --> 00:02:32,960 So this is not a street lamp or the work. 35 00:02:32,980 --> 00:02:35,230 This is for Web practice. 36 00:02:35,380 --> 00:02:38,590 And finally, it is there is nothing on this page. 37 00:02:39,020 --> 00:02:46,990 OK, now let's continue to view the circle and you can see there is no more information leaks. 38 00:02:47,380 --> 00:02:49,480 Not even Google will find this time. 39 00:02:50,920 --> 00:02:56,620 So because, uh, Google is and will not find the item that is in reverse. 40 00:02:57,970 --> 00:02:59,200 So let me see. 41 00:02:59,210 --> 00:03:08,890 Your robot got people and you can see here there is a syntax and user agent is equal to. 42 00:03:09,310 --> 00:03:12,730 So here is a deserve, uh, search engines. 43 00:03:13,180 --> 00:03:14,760 A star means are searching. 44 00:03:14,770 --> 00:03:20,860 And so when all the search engines is going to crawl this domain, then it will see the robots. 45 00:03:22,000 --> 00:03:27,820 And since it was originally started, it applies to the Arcaro. 46 00:03:28,390 --> 00:03:34,820 So that search will not allow this part to be displayed in that resource. 47 00:03:35,230 --> 00:03:36,550 So if I take this one. 48 00:03:38,180 --> 00:03:38,750 So. 49 00:03:40,780 --> 00:03:48,070 So I have mentioned here this yellow and then this territory, that means from the root, so whenever 50 00:03:48,070 --> 00:03:51,320 the such unions see this, it will not display under those. 51 00:03:51,340 --> 00:03:56,280 So you cannot find or any hagiographies until they find this robot. 52 00:03:57,460 --> 00:04:05,680 So here the this not us guys have been, uh, put this secret for the, uh, disappear from me or hide 53 00:04:05,980 --> 00:04:06,690 it from me. 54 00:04:07,000 --> 00:04:15,130 So let me enter and you can see in the case of the secret and you can see that the password for the 55 00:04:15,130 --> 00:04:17,590 next level, that is not allowed for any to this one. 56 00:04:18,970 --> 00:04:22,830 So the main important is not the power, but the robot, right? 57 00:04:24,280 --> 00:04:31,030 So as you can see here, there will be a user that is going to Google are being or any other star in 58 00:04:31,030 --> 00:04:33,730 the sense of research and development. 59 00:04:34,420 --> 00:04:38,950 You should not call this one and you should not display that in the results. 60 00:04:39,760 --> 00:04:42,560 So that's all that's all about this robot strategy. 61 00:04:43,420 --> 00:04:51,100 So one thing you can check in the testing is to continue to watch what, if any, sense to that are 62 00:04:51,490 --> 00:04:53,580 out there in these parts. 63 00:04:53,590 --> 00:04:55,540 You can just right there, right. 64 00:04:56,740 --> 00:04:58,440 So that's what the robots are texting. 65 00:04:58,780 --> 00:04:59,950 I hope you have understood.