 |
|
|
|
Next: CR/LF
|
| Author |
Message |
External
Since: Nov 18, 2005
Posts: 2
|
(Msg. 1) Posted: Fri Nov 18, 2005 3:35 pm
Post subject: Can search engines find all files in a Web site, even if there are no links to t
Archived from groups: alt>www>webmaster, others (more info?)
|
|
|
I use certain subdirectories (i.e., www.mydomain/proofs/) in my Web site to
put early drafts and proofs of Web pages for my clients to review. I don't
want search engines to find those Web pages, because they are drafts, and I
don't want to password protect them because my clients want quick access to
them. Thus I've made sure that I never link to those pages from my regular
site. I've been under the understanding that a search engine can't find Web
pages unless it finds a link to the Web pages, from other Web pages.
However, these pages end up in the search engines anyway. How is it that
search engines can find these pages, if nobody submits the URL to the search
engine, and no links lead to the page? Can search engines get a directory of
all the files that are within a certain domain, and then index them that
way? My Web hosting company claims that the names of files on a Web site
cannot be accessed by search engines, but that is the only way I can figure
out that the search engines are finding these pages.
How do search engines find pages that have no links going to them? Your help
is appreciated!!
--
DK |
|
| Back to top |
|
 | |
External
Since: May 17, 2005
Posts: 114
|
(Msg. 2) Posted: Fri Nov 18, 2005 3:35 pm
Post subject: Re: Can search engines find all files in a Web site, even if there are no links [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
|
|
|
"Borek" <borek.TakeThisOut@parts.bpp.to.com.remove.pl> wrote in message
news:op.s0gjaxrd584cds@borek...
> On Fri, 18 Nov 2005 22:35:16 +0100, DK <none.TakeThisOut@NoSpam.com> wrote:
>
> > How do search engines find pages that have no links going to them? Your
> > help is appreciated!!
>
> Google toolbar.
>
> OK. I will be less brief this time 
>
> It is absolutely enough that the page was visited by someone using
> Google toolbar. Toolbar asks G for a PageRank, submitting URL. At
> this moment Google knows URL and can index the page.
>
> Best,
> Borek
So, one can assume that anyone loading a page in a browser with google
toolbar, page rank on, will auto submit to google? No need for submission
sites, services or even visiting googley's own addurl page anymore. Cool.
Hmmm ... c:/allis/sites/stoopid-stuff/*.htm .... hmmmm....
Oh no!
c:/allis/remove/googletoolbar |
|
| Back to top |
|
| |
External
Since: Nov 05, 2003
Posts: 82
|
(Msg. 3) Posted: Fri Nov 18, 2005 7:55 pm
Post subject: Re: Can search engines find all files in a Web site, even if there are no links [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
|
|
|
On Fri, 18 Nov 2005 14:52:08 -0800, "Allis" <allis@allis> wrote:
>
>"Borek" <borek RemoveThis @parts.bpp.to.com.remove.pl> wrote in message
>news:op.s0gjaxrd584cds@borek...
>> On Fri, 18 Nov 2005 22:35:16 +0100, DK <none RemoveThis @NoSpam.com> wrote:
>>
>> > How do search engines find pages that have no links going to them? Your
>> > help is appreciated!!
>>
>> Google toolbar.
>>
>> OK. I will be less brief this time
>>
>> It is absolutely enough that the page was visited by someone using
>> Google toolbar. Toolbar asks G for a PageRank, submitting URL. At
>> this moment Google knows URL and can index the page.
>>
>> Best,
>> Borek
>
>So, one can assume that anyone loading a page in a browser with google
>toolbar, page rank on, will auto submit to google? No need for submission
>sites, services or even visiting googley's own addurl page anymore. Cool.
Been that way for some time.
>Hmmm ... c:/allis/sites/stoopid-stuff/*.htm .... hmmmm....
>
>Oh no!
Too late! Oh, we laughed at that one!
>c:/allis/remove/googletoolbar
Better late than never.
BB
--
www.kruse.co.uk/ seo RemoveThis @kruse.demon.co.uk
The buffalo have gone >> Stay informed about: Can search engines find all files in a Web site, even if t.. |
|
| Back to top |
|
| |
External
Since: Sep 19, 2003
Posts: 3499
|
(Msg. 4) Posted: Sat Nov 19, 2005 8:55 am
Post subject: Re: Can search engines find all files in a Web site, even if there are no links [Login to view extended thread Info.]
Archived from groups: alt>www>webmaster (more info?)
|
|
|
Writing in news:alt.www.webmaster,alt.internet.search-engines
From the safety of the Castle Amber - software development cafeteria
John Bokma <john.RemoveThis@castleamber.com> said:
Groups rearranged to protect the innocent.
> ...
> Drafts I keep on my own computer  .
It is astonishing how many folk (in this trade) do not have access to a
development server.
--
William Tasso
Virtue is its own punishment. >> Stay informed about: Can search engines find all files in a Web site, even if t.. |
|
| Back to top |
|
| |
External
Since: Nov 19, 2005
Posts: 1
|
(Msg. 5) Posted: Sat Nov 19, 2005 11:21 am
Post subject: Re: Can search engines find all files in a Web site, even if there are no links [Login to view extended thread Info.]
Archived from groups: alt>www>webmaster, others (more info?)
|
|
|
Hi,
DK wrote:
> How do search engines find pages that have no links going to them?
I do not know how your pages were found by search engines, but...
maybe you can get some idea from your access logs, to see if/what bots
accessed your drafts pages.
Some web statistics for some websites are on public access pages
and your pages could have been found from stats like these,
from your website
or from other websites (with your pages as referrers if they have
click-able and click-ed links).
If you do not want your draft pages to have restricted access (password
protected),
then you can hope for the best by disallowing access to compliant
robots from the robots.txt file,
also you can put big titles or markings on the pages
indicating that they are drafts, temporary etc. >> Stay informed about: Can search engines find all files in a Web site, even if t.. |
|
| Back to top |
|
| |
External
Since: Nov 20, 2005
Posts: 1
|
(Msg. 6) Posted: Sun Nov 20, 2005 6:48 pm
Post subject: Re: Can search engines find all files in a Web site, even if there are no links [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
|
|
|
Els wrote:
>I don't know about other developers, but I don't put external
>links on drafts for clients' viewing. That would be plain
>stupid if you ask me...
Why? If I am a customer and I am looking at a draft in order to
approve it, I would want to check that any external links are
error-free before giving my approval. I might also send a link
to others for comments. and I wouldn't consider the URL to be
particlarly sensitive/secret information. Then again, every web
developer I have ever hired protected drafts with passwords, not
with security through obsurity. >> Stay informed about: Can search engines find all files in a Web site, even if t.. |
|
| Back to top |
|
| |
External
Since: Nov 18, 2005
Posts: 2
|
(Msg. 7) Posted: Mon Nov 21, 2005 10:14 am
Post subject: Re: Can search engines find all files in a Web site, even if there are no links [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)
|
|
|
|
|
| Back to top |
|
| |
| Related Topics: | search engines dont find my website photos despite....... - Hi... I know Im not doing something correctly.. any help much apreciated. I run a fairly successfull travel advice website. Much of this is devoted to photo galleries of various locations. Many of the jpgs are named but even after months, an image search...
Search engines - Hello The search engines dosn't find mij site. Why not ???? (MY SQL - PHP) -- www.elektronica-online.com Kind Regards, Jacq, Elektronica Online. e-mail info@elektronica-online.com website www.elektronica-online.com
[OT] Search engines - Hi, Just wondering what search engines you guys are using? And for what topics? I have found that I am always using google for everything. Surely there are different ones for different specialty topics?? eg. medical, sporting, scientific, people,..
How do search engines work? - On my site (which uses shared hosting) I've set up a special 404 page - ie, if a 404 'page not found' error is generated, the user is sent this page instead. I'm able to log the IPs of the visitors that hit this page and - surprise, surprise - they're...
Submitting to Search Engines - Hello again, I have this submission software. It's easy to use, and one can really pump out some pages to search engines. However, I suspect that there are drawbacks if misused. Currently, I'm only submitting my homepage to search engines every 30 days... |
|
You can post new topics in this forum
You can reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
|
|
|
|
|
FAQ
Profile
Private Messages
Log in
