Man page or keyword search:   man All Sections 1 - General Commands 2 - System Calls 3 - Subroutines, Functions 4 - Special Files 5 - File Formats 6 - Games and Screensavers 7 - Macros and Conventions 8 - Maintenence Commands 9 - Kernel Interface New Commands Server 4.4BSD AIX Alpinelinux Archlinux Aros BSDOS BSDi Bifrost CentOS Cygwin Darwin Debian DigitalUNIX DragonFly ElementaryOS Fedora FreeBSD Gentoo GhostBSD HP-UX Haiku Hurd IRIX Inferno JazzOS Kali Knoppix LinuxMint MacOSX Mageia Mandriva Manjaro Minix MirBSD NeXTSTEP NetBSD OPENSTEP OSF1 OpenBSD OpenDarwin OpenIndiana OpenMandriva OpenServer OpenSuSE OpenVMS Oracle PC-BSD Peanut Pidora Plan9 QNX Raspbian RedHat Scientific Slackware SmartOS Solaris SuSE SunOS Syllable Tru64 UNIXv7 Ubuntu Ultrix UnixWare Xenix YellowDog aLinux   44335 pages apropos Keyword Search (all sections) Output format html ascii pdf view pdf save postscript

ESTWAVER(3)			Hyper Estraier			   ESTWAVER(3)

NAME
       estwaver - command line interface of web crawler

SYNOPSIS
       estwaver init [-apn|-acc] [-xs|-xl|-xh] [-sv|-si|-sa] rootdir

       estwaver crawl [-restart|-revisit|-revcont] rootdir

       estwaver unittest rootdir

       estwaver fetch [-proxy hostr port] [-tout num] [-il lang] url

DESCRIPTION
       estwaver	 is an aggregation of sub commands.  The name of a sub command
       is specified by the first argument.  Other arguments are parsed accord‐
       ing  to	each  sub command.  The argument rootdir specifies the crawler
       root directory which contains configuration file and so on.

       estwaver init [-apn|-acc] [-xs|-xl|-xh] [-sv|-si|-sa] rootdir
	      Create the crawler root directory.
	      If -apn is specified, N-gram analysis is performed against Euro‐
	      pean text also.
	      If  -acc	is specified, character category analysis is performed
	      instead of N-gram analysis.
	      If -xs is specified, the index is tuned to  register  less  than
	      50000 documents.
	      If  -xl  is  specified, the index is tuned to register more than
	      300000 documents.
	      If -xh is specified, the index is tuned to  register  more  than
	      1000000 documents.
	      If -sv is specified, scores are stored as void.
	      If -si is specified, scores are stored as 32-bit integer.
	      If  -sa  is specified, scores are stored as-is and marked not to
	      be tuned when search.

       estwaver crawl [-restart|-revisit|-revcont] rootdir
	      Start crawling.
	      If -restart is specified, crawling is restarted  from  the  seed
	      documents.
	      If -revisit is specified, collected documents are revisited.
	      If  -revcont is specified, collected documents are revisited and
	      then crawling is continued.</dd>

       estwaver unittest rootdir
	      Perform unit tests.

       estwaver fetch [-proxy hostr port] [-tout num] [-il lang] url
	      Fetch a document.
	      url specifies the URL of a document.
	      -proxy specifies the host name and the port number of the	 proxy
	      server.
	      -tout specifies timeout in seconds.
	      -il  specifies  the  preferred language.	By default, it is Eng‐
	      lish.

       All sub commands return 0 if the operation is success, else  return  1.
       A  running  crawler  finishes with closing the database when it catches
       the signal 1 (SIGHUP), 2 (SIGINT), 3 (SIGQUIT), or 15 (SIGTERM).

       When crawling finishes, there is a directory _index in the crawler root
       directory.  It is an index available by estcmd and so on.

SEE ALSO
       estconfig(1),  estcmd(1),  estmaster(1), estcall(1), estraier(3), estn‐
       ode(3)

Man Page			  2007-03-06			   ESTWAVER(3)

Vote for polarhome