Hi,

I have made my web site solely stored in a SQL database...that will say if I need to load a page I take it our from the data base and then display it.

My question is: is any searcg engine able to ``crawl'' into my web site content?


I would appreciate some info so that I can change the way my web works.

Provided this is what you mean, yes.

So I gather you've stored everything in a database and using PHP to get a part of it and show it, just like a CMS?

PHP is server side, it does everything on the server and then displays it to the user as normal HTML, which if a search engine finds, it will show. If you're not using search engine friendly URLs though then it probably wouldn't find it since it's only picking up the index.php page.

By the way, pages needing passwords cannot be crawled, because the robots cannot guess your passwords.
So, pages you protected or scripts needing you to login before entering make the things not searchable by robots.

Thats my point. The database table has an user/pass so it might not be accessible for a bot or it might be...I think they ``crawl'' a particular site by ``virtually opening'' it and then check the content...at least this is my experience...as I really need to know this I'm making some crawling around too to become an expert... see how if I'll share it ...

here are the advises given by G:

http://www.google.com/support/webmasters/b...py?answer=40349

Hi, RockaRolla,
When I do crawling for fun, it simply opens the php scripts, so I get files named somehthing.php down to my PC, nothing more. For instance, in 4gallery photo galleries, I don't have the pictures.
However, I have the php scripts, so I can re-create the website. But of course I cannot connect to the database (for instance at asta it's your database so, even guessing the passwords I could not connect) so I cannot reach dynamic pages which are displayed using a particular user's rights and name and passwords.

Well, if your pages are dynamic, it would be very good for you to send the right headers to the bot/crawler and even to the browser, due to when apache or as I know any other http server sends a simple html file with the right content length and etc. but when a PHP file is generated/parsed apache can't really know the length of it, but it can be done with some php output buffering and sending the header with php, I think google is full of these kind of suggestions.