vBulletin Mods

The Official vBulletin Modifications Site
https://www.vbulletin.org/forum/showthread.php?t=322560

What is Perfect robots.txt for vb5?
by yarick7
07 May 2016 01:18

hello guys, im new and like title says my question is what is perfect robots.txt for vb5

i found only for vb4 and not sure if it works for vb5
https://www.vbulletin.org/forum/showthread.php?t=302483

In Omnibus 07 May 2016 01:29

There isn't one. Bad bots ignore robots.txt files.

What are you trying to accomplish?

IggyP 07 May 2016 02:49

didnt they put that functions into the software itself?

thought i read that somewhere...

yarick7 07 May 2016 03:04

Quote:

Originally Posted by ProSportsForums (Post 2570289)
There isn't one. Bad bots ignore robots.txt files.

What are you trying to accomplish?

i thought maybe i should close some areas from indexing for security & seo reasons

IggyP 07 May 2016 03:13

i believe you can do that in admincp settings
i know you can for the site, just not 100% how much you can separate in there offhand

In Omnibus 07 May 2016 04:01

Google doesn't index non-content areas in any case.

The best way to go about blocking bots is by user agent.

If security is your concern you can rename admincp and modcp but don't list them in your robots.txt file. That tells the bots where they are.

Emad ELsayed 25 Mar 2018 12:01

Quote:

Originally Posted by In Omnibus (Post 2570295)
Google doesn't index non-content areas in any case.

The best way to go about blocking bots is by user agent.

If security is your concern you can rename admincp and modcp but don't list them in your robots.txt file. That tells the bots where they are.

Can you help me how to rename admincp and modcp folder.

Best Regards

final kaoss 25 Mar 2018 22:12

This is what I use in my robots.txt


Block Disabled:      (Update License Status)  
Suspended or Unlicensed Members Cannot View Code.


Seven Skins 26 Mar 2018 22:28


Block Disabled:      (Update License Status)  
Suspended or Unlicensed Members Cannot View Code.


If it is me I would remove these lines ... because you are telling hackers where your adminCP is.


.

final kaoss 26 Mar 2018 22:35

Quote:

Originally Posted by Seven Skins (Post 2593763)
Block Disabled:      (Update License Status)  
Suspended or Unlicensed Members Cannot View Code.


If it is me I would remove these lines ... because you are telling hackers where your adminCP is.


.


That's not really too big of a deal because hackers would already know of those folders with a vbulletin exploit lookup which would tell them exactly where the location is anyways. It simply tells spiders, not to index those parts.

Seven Skins 26 Mar 2018 22:40

Usually my adminCP is name is like "dontlookhere" or something else.
If I am hiding the adminCP why advertise it?
Anyways its your choice.

Emad ELsayed 27 Mar 2018 14:42

Can you help me how to rename admincp and modcp folder.
Best Regards

final kaoss 27 Mar 2018 19:09

Rename folder, update config.php

Quote:

Originally Posted by Emad ELsayed (Post 2593784)
Can you help me how to rename admincp and modcp folder.
Best Regards


Emad ELsayed 30 Mar 2018 13:03

Quote:

Originally Posted by final kaoss (Post 2593792)
Rename folder, update config.php

There is no option to change the folder admincp to file config.php
Can more details
Best Regards

Brandon Sheley 30 Mar 2018 13:07

I don't block anything in my robots.txt files anymore, there is really no point.


All times are GMT. The time now is 19:13.

Powered by vBulletin® Version 3.8.12
Copyright © 2019, MH Sub I, LLC dba vBulletin. All Rights Reserved. vBulletin® is a registered trademark of MH Sub I, LLC
Copyright ©2001 - , vbulletin.org. All rights reserved.