Die TYPO3 Mailingliste - nicht fragen: lesen!
[TYPO3] crawler extension & external non-typo3 sites
This is a discussion on [TYPO3] crawler extension & external non-typo3 sites within the typo3-english@lists.netfielders.de forums, part of the TYPO3-Mailinglists: ENGLISH category; Hi, It seems that the typo3 crawler could only go through similar cached typo3 sites (pls correct me if I'...
|
|||||||
![[TYPO3] crawler extension & external non-typo3 sites](http://www.typo3-jack.net/iconimages/typo3-english-lists-netfielders-de/typo3-crawler-extension-external-non-typo3-sites_ltr.gif)
| Registrieren | Hilfe | Benutzerliste | Kalender | Suchen | Heutige Beiträge | Alle Foren als gelesen markieren |
|
#1
08.01.2008, 16:07
|
|||
|
|||
Hi,
It seems that the typo3 crawler could only go through similar cached typo3 sites (pls correct me if I'm wrong) but what about other dynamic non-typo3 sites? I've just tested it on one external non-typo3 link and made it crawl through 3 levels and it only fetched the top level link and never went through the links. But while testing it on a cached typo3 site it traversed through the page tree nicely. Elijah _______________________________________________ TYPO3-english mailing list TYPO3-english (AT) lists (DOT) netfielders.de http://lists.netfielders.de/cgi-bin/.../typo3-english         |
[TYPO3] crawler extension & external non-typo3 sites
|
#2
08.01.2008, 16:14
|
|||
|
|||
Hi!
Elijah wrote: > It seems that the typo3 crawler could only go through similar cached > typo3 sites (pls correct me if I'm wrong) but what about other dynamic > non-typo3 sites? > > I've just tested it on one external non-typo3 link and made it crawl > through 3 levels and it only fetched the top level link and never went > through the links. But while testing it on a cached typo3 site it > traversed through the page tree nicely. I went to typo3.org and read the very beginning of the manual for crawler. It contains the answer to your question. Did you bother RTFM before asking?  -- Dmitry Dulepov TYPO3 core team Web: http://typo3bloke.net/ Skype: callto:liels_bugs "Nothing is impossible. There are only limits to our knowledge" _______________________________________________ TYPO3-english mailing list TYPO3-english (AT) lists (DOT) netfielders.de http://lists.netfielders.de/cgi-bin/.../typo3-english |
|
#3
08.01.2008, 17:27
|
|||
|
|||
Dmitry Dulepov [typo3] wrote:
> I went to typo3.org and read the very beginning of the manual for > crawler. It contains the answer to your question. Did you bother RTFM > before asking? > I must've missed that part  There is not much info for external urls but seeing it's 'specially designed' to request typo3 frontends I guess it just won't work. Thanks, Elijah _______________________________________________ TYPO3-english mailing list TYPO3-english (AT) lists (DOT) netfielders.de http://lists.netfielders.de/cgi-bin/.../typo3-english |
| Themen-Optionen | Thema durchsuchen |
| Ansicht | Thema bewerten |
Linear-Darstellung
|
|
|
||||
| Thema | Autor | Forum | Antworten | Letzter Beitrag |
| [TYPO3] Indexing external files with crawler | Jan HanÄiÄ | typo3-english@lists.netfielders.de | 4 | 06.08.2007 19:31 |
| [TYPO3-german] Crawler-Extension | Andreas Kiefer | typo3-german@lists.netfielders.de | 3 | 06.06.2007 20:33 |
| [TYPO3] same domain needs to be referenced by different sites | Bing Du | typo3-english@lists.netfielders.de | 0 | 04.04.2007 19:48 |
| [TYPO3-dev] Community sites different style | Patrick Broens | typo3-dev@lists.netfielders.de | 3 | 14.03.2007 09:21 |
| [TYPO3-shop] dodge sites | Dodgers | typo3-project-tt-products@lists.netfielders.de | 0 | 20.01.2007 14:14 |
Alle Zeitangaben in WEZ +1. Es ist jetzt 03:53 Uhr.
