Typical File Listing


This section contains a listing of files that Webglimpse installs and the appropriate owner, group and permissions.

Webglimpse has two parts : Glimpse, the fast C engine which does the text indexing and pattern matching, and Webglimpse proper, the flexible Perl spider, archive manager and user interface script. When you build an index, you first specify some rules for which files should be included. You might index by directory, by following links from a starting page, or a combination of both. The indexing script first makes a complete list of all files to be indexed, and retrieves any remote links. Then it feeds this list to the glimpseindex program, which builds a keyword index for fast searching.

When a user runs a search, the webglimpse.cgi script first gets the query, checks all the options and does some pre-processing. Then it sends the query to glimpse for a fast search of the index and files. Finally, it parses the raw results, formats them nicely according to the customized format on that site, ranks them, highlights keywords and presents the results back to the user.

Webglimpse 2.X has been out for almost two years and is in wide use, with new development continuing steadily and new releases about once a month.

In the webserver's document root, the directory named 'wg2' (if you accepted the default name) will contain a listing similar to this:

./wg2:
total 100

 

 

 

 

 

 

-rwxr-xr-x

1

apache

apache

6952

Feb 17 12:54

addsearch

drwxr-xr-x

3

apache

apache

4096

Feb 27 14:38

archives

drwxr-xr-x

2

apache

apache

4096

Feb 17 12:42

dist

drwxr-xr-x

2

apache

apache

4096

Feb 14 13:26

glimpse

drwxr-xr-x

2

apache

apache

4096

Feb 17 13:25

lib

-rwxr-xr-x

1

apache

apache

1779

Feb 14 11:50

Makefile

-rwxr-xr-x

1

apache

apache

45702

Feb 17 12:51

makenh

drwxr-xr-x

14

apache

apache

4096

Feb 17 13:26

templates

drwxr-xr-x

2

apache

apache

4096

Feb 14 11:50

tests

-rwxr-xr-x

1

apache

apache

15893

Feb 14 11:50

wgcmd

 

./archives:
total 12

 

 

 

 

 

 

drwxr-xr-x

5

apache

apache

4096

Feb 28 11:28

1

-rw-r--r--

1

apache

apache

61

Feb 27 14:38

archives.list

-rw-r--r--

1

apache

apache

650

Feb 21 10:56

wgsites.conf

 

./archives/1:
total48

 

 

 

 

 

 

-rw-r--r--

1

apache

apache

82

Feb 27 13:48

.glimpse_filehash

-rw-r--r--

1

apache

apache

262144

Feb 27 13:48

.glimpse_filehash_index

-rw-r--r--

1

apache

apache

80

Feb 27 13:48

.glimpse_filenames

-rw-r--r--

1

apache

apache

4

Feb 27 13:48

.glimpse_filenames_index

-rw-r--r--

1

apache

apache

4

Feb 27 13:48

.glimpse_filetimes

-rw-r--r--

1

apache

apache

80

Feb 27 13:48

.glimpse_filetimes.index

-rw-r--r--

1

apache

apache

4590

Feb 27 13:48

.glimpse_index

-rw-r--r--

1

apache

apache

116

Feb 27 13:48

.glimpse_messages

-rw-r--r--

1

apache

apache

908

Feb 27 13:48

.glimpse_partitions

-rw-r--r--

1

apache

apache

3593

Feb 27 13:48

.glimpse_statistics

-rw-r--r--

1

apache

apache

262144

Feb 27 13:48

.glimpse_turbo

drwxr-xr-x

2

apache

apache

4096

Feb 27 13:48

.remote

-rw-r--r--

1

apache

apache

0

Feb 27 13:48

searches.log

drwxr-xr-x

2

apache

apache

4096

Feb 27 13:48

.remote.old

-rw-r--r--

1

apache

apache

0

Feb 27 13:48

searches.lastlog

-rw-r--r--

1

apache

apache

97

Feb 17 13:49

.glimpse_filters

-rw-r--r--

1

apache

apache

532

Feb 17 13:49

newquery.html

-rw-r--r--

1

apache

apache

3316

Feb 17 13:49

.tips.html

-rw-r--r--

1

apache

apache

2515

Feb 17 13:49

wgall.html

-rw-r--r--

1

apache

apache

608

Feb 17 13:49

wgbox.html

-rw-r--r--

1

apache

apache

179

Feb 17 13:49

.wgfilter-box

-rw-r--r--

1

apache

apache

648

Feb 17 13:49

.wgfilter-index

-rw-r--r--

1

apache

apache

3207

Feb 17 13:49

wgindex.html

-rw-r--r--

1

apache

apache

157

Feb 17 13:49

.wginputfields

-rw-r--r--

1

apache

apache

4096

Feb 17 13:49

.wgODP3.dbm.dir

-rw-r--r--

1

apache

apache

524288

Feb 17 13:49

.wgODP3.dbm.pag

-rw-r--r--

1

apache

apache

244

Feb 17 13:49

wgoutput.cfg

-rw-r--r--

1

apache

apache

1103

Feb 17 13:49

.wgoutputfields

-rw-r--r--

1

apache

apache

221

Feb 17 13:49

.wgrankhits.cfg

-rwxr-xr-x

1

apache

apache

2205

Feb 17 13:49

wgreindex

-rw-r--r--

1

apache

apache

1995

Feb 17 13:49

wgsimple.html

-rw-r--r--

1

apache

apache

1204

Feb 17 13:49

wgverysimple.html

-rw-r--r--

1

apache

apache

10827

Feb 17 13:49

wusage.conf

-rw-r--r--

1

apache

apache

0

Feb 17 13:46

.wg_err

-rw-r--r--

1

apache

apache

1550

Feb 17 13:46

.wg_log

-rw-r--r--

1

apache

apache

0

Feb 17 13:46

.wg_madenh

-rw-r--r--

1

apache

apache

367

Feb 17 13:46

.wgmapfile

-rw-r--r--

1

apache

apache

382

Feb 17 13:46

.wg_toindex

-rw-r--r--

1

apache

apache

334

Feb 17 13:46

archive.cfg

drwxr-xr-x

2

apache

apache

4096

Feb 17 12:52

.cache

 

./dist
:total 544

 

 

 

 

 

 

-rw-r--r--

1

apache

apache

3316

Feb1411:50

tips.html

-rw-r--r--

1

apache

apache

179

Feb1411:50

wgfilter-box

-rw-r--r--

1

apache

apache

648

Feb1712:41

wgfilter-index

-rw-r--r--

1

apache

apache

157

Feb1411:50

wginputfields

-rw-r--r--

1

apache

apache

4096

Feb1411:50

wgODP3.dbm.dir

-rw-r--r--

1

apache

apache

524288

Feb1411:50

wgODP3.dbm.pag

-rw-r--r--

1

apache

apache

1103

Feb1411:50

wgoutputfields

-rw-r--r--

1

apache

apache

2211

Feb1411:50

wgrankhits.cfg

 

./glimpse:
total 12572

 

 

 

 

 

 

-rwxr-xr-x

1

apache

apache

355211

Feb1411:50

glimpse

-rwxr-xr-x

1

apache

apache

293603

Feb1411:50

glimpseindex

-rwxr-xr-x

1

apache

apache

1062624

Feb1413:22

pdffonts

-rwxr-xr-x

1

apache

apache

1061161

Feb1413:22

pdfimages

-rwxr-xr-x

1

apache

apache

1062894

Feb1413:22

pdfinfo

-rwxr-xr-x

1

apache

apache

1135987

Feb1413:22

pdftotext

-rwxr-xr-x

1

apache

apache

235029

Feb1411:50

wgconvert

-rwxr-xr-x

1

apache

apache

7606330

Feb1413:22

xpdf

 

./lib:
total 416

 

 

 

 

 

 

-rwxr-xr-x

1

apache

apache

1342

Feb1411:50

AllowDeny.pm

-rwxr-xr-x

1

apache

apache

3050

Feb1411:50

CatTree.pm

-rwxr-xr-x

1

apache

apache

10930

Feb1411:50

CommandWeb.pm

-rwxr-xr-x

1

apache

apache

21962

Feb1411:50

CustomOutputTool.pm

-rwxr-xr-x

1

apache

apache

21397

Feb1411:50

ftplib.pl

-rwxr-xr-x

1

apache

apache

1422

Feb1411:50

glimpse-eye.jpg

-rwxr-xr-x

1

apache

apache

5038

Feb1411:50

html2txt

-rwxr-xr-x

1

apache

apache

304

Feb1411:50

html2txt.c

-rwxr-xr-x

1

apache

apache

13722

Feb1411:50

httpget

-rwxr-xr-x

1

apache

apache

15196

Feb1411:50

httpget.c

-rwxr-xr-x

1

apache

apache

52855

Feb1411:50

htuml2txt

-rwxr-xr-x

1

apache

apache

13480

Feb1411:50

htuml2txtc

-rwxr-xr-x

1

apache

apache

18301

Feb1411:50

htuml2txt.c

-rwxr-xr-x

1

apache

apache

5388

Feb1411:50

htuml2txt.pl

-rwxr-xr-x

1

apache

apache

3079

Feb1411:50

InputSyntax.pm

-rwxr-xr-x

1

apache

apache

2822

Feb1411:50

LangUtils.pm

-rwxr-xr-x

1

apache

apache

3592

Feb1411:50

OutputTool.pm

-rwxr-xr-x

1

apache

apache

807

Feb1411:50

parsefields.pl

-rwxr-xr-x

1

apache

apache

2280

Feb1411:50

PreFilter.pm

-rwxr-xr-x

1

apache

apache

14061

Feb1411:50

RankHits.pm

-r--r--r--

1

apache

apache

2356

Feb1411:50

req

-rwxr-xr-x

1

apache

apache

6058

Feb1411:50

ResultCache.pm

-rwxr-xr-x

1

apache

apache

4155

Feb1411:50

SearchFeed.pm

-rwxr-xr-x

1

apache

apache

4064

Feb1411:50

URL.pl

-rwxr-xr-x

1

apache

apache

1336

Feb1411:50

usexpdf.sh

-rwxr-xr-x

1

apache

apache

651

Feb1411:50

utils.h

-rwxr-xr-x

1

apache

apache

5120

Feb1411:50

wgAgent.pm

-rwxr-xr-x

1

apache

apache

18670

Feb1411:50

wgArch.pm

-rwxr-xr-x

1

apache

apache

5475

Feb1411:50

wgConf.pm

-rwxr-xr-x

1

apache

apache

1715

Feb1411:50

wgErrors.pm

-rwxr-xr-x

1

apache

apache

2561

Feb1411:50

wgFilter.pm

-rwxr-xr-x

1

apache

apache

5930

Feb1411:50

wgHeader.pm

-rwxr-xr-x

1

apache

apache

1373

Feb1411:50

wgLog.pm

-rwxr-xr-x

1

apache

apache

9433

Feb1411:50

wgRoot.pm

-rwxr-xr-x

1

apache

apache

17492

Feb1411:50

wgSiteConf.pm

-rwxr-xr-x

1

apache

apache

8580

Feb1411:50

wgSite.pm

-rwxr-xr-x

1

apache

apache

10855

Feb1411:50

wgStats.pm

-rwxr-xr-x

1

apache

apache

19824

Feb1411:50

wgTextMsgs.pm

 

./templates:
total208

 

 

 

 

 

 

drwxr-xr-x

2

apache

apache

4096

Feb1411:50

bulgarian

-rw-r--r--

1

apache

apache

1263

Feb1411:50

docAddBoxes.html

-rw-r--r--

1

apache

apache

1497

Feb1411:50

docAddDir.html

-rw-r--r--

1

apache

apache

1715

Feb1411:50

docAddSite.html

-rw-r--r--

1

apache

apache

3868

Feb1411:50

docAddTree.html

-rw-r--r--

1

apache

apache

1174

Feb1411:50

docCrontab.html

-rw-r--r--

1

apache

apache

1517

Feb1411:50

docEditDir.html

-rw-r--r--

1

apache

apache

2473

Feb1411:50

docEditSite.html

-rw-r--r--

1

apache

apache

3872

Feb1411:50

docEditTree.html

-rw-r--r--

1

apache

apache

1305

Feb1411:50

docFilterIndex.html

-rw-r--r--

1

apache

apache

1961

Feb1411:50

docMakeForms.html

-rw-r--r--

1

apache

apache

144

Feb1411:50

docMakeNeigh.html

-rw-r--r--

1

apache

apache

2228

Feb1411:50

docPreFilter.html

drwxr-xr-x

2

apache

apache

4096

Feb1411:50

estonian

drwxr-xr-x

2

apache

apache

4096

Feb1411:50

finnish

drwxr-xr-x

2

apache

apache

4096

Feb1411:50

french

drwxr-xr-x

2

apache

apache

4096

Feb1411:50

german

drwxr-xr-x

2

apache

apache

4096

Feb1411:50

hebrew

drwxr-xr-x

2

apache

apache

4096

Feb1411:50

italian

-rw-r--r--

1

apache

apache

529

Feb1411:50

newquery.html

drwxr-xr-x

2

apache

apache

4096

Feb1411:50

norwegian

drwxr-xr-x

2

apache

apache

4096

Feb1411:50

polish

drwxr-xr-x

2

apache

apache

4096

Feb1411:50

portuguese

drwxr-xr-x

2

apache

apache

4096

Feb1411:50

romanian

drwxr-xr-x

2

apache

apache

4096

Feb1411:50

spanish

-rw-r--r--

1

apache

apache

1053

Feb1411:50

tmplAddDir.html

-rw-r--r--

1

apache

apache

3162

Feb1411:50

tmplAddSite.html

-rw-r--r--

1

apache

apache

3582

Feb1411:50

tmplAddTree.html

-rw-r--r--

1

apache

apache

3187

Feb1411:50

tmplEditDir.html

-rw-r--r--

1

apache

apache

3537

Feb1411:50

tmplEditSite.html

-rw-r--r--

1

apache

apache

3720

Feb1411:50

tmplEditTree.html

-rw-r--r--

1

apache

apache

2714

Feb1411:50

tmplLocalDomain.html

-rw-r--r--

1

apache

apache

1033

Feb1411:50

tmplLoginPage.html

-rw-r--r--

1

apache

apache

2401

Feb1411:50

tmplManageAll.html

-rw-r--r--

1

apache

apache

6168

Feb1411:50

tmplManageArch.html

-rw-r--r--

1

apache

apache

4592

Feb1411:50

tmplNewArch.html

-rw-r--r--

1

apache

apache

758

Feb1411:50

tmplSearchFeedBox.html

-rw-r--r--

1

apache

apache

1852

Feb1411:50

tmplTestTrans.html

-rw-r--r--

1

apache

apache

611

Feb1411:50

wgbox.html

-rw-r--r--

1

apache

apache

3204

Feb1411:50

wgindex.html

-rw-r--r--

1

apache

apache

2460

Feb1411:50

wgoutput.cfg

-rw-r--r--

1

apache

apache

1646

Feb1411:50

wgreindex

-rw-r--r--

1

apache

apache

1989

Feb1411:50

wgsimple.html

-rw-r--r--

1

apache

apache

1201

Feb1411:50

wgverysimple.html

-rw-r--r--

1

apache

apache

10797

Feb1411:50

wusage.conf

 

./templates/bulgarian: total16

 

 

 

 

 

 

-rw-r--r--

1

apache

apache

3125

Feb1411:50

wgindex.html

-rw-r--r--

1

apache

apache

1842

Feb1411:50

wgoutput.cfg

-rw-r--r--

1

apache

apache

1962

Feb1411:50

wgsimple.html

-rw-r--r--

1

apache

apache

1214

Feb1411:50

wgverysimple.html

 

./templates/estonian: total12

 

 

 

 

 

 

-rw-r--r--

1

apache

apache

2998

Feb1411:50

wgindex.html

-rw-r--r--

1

apache

apache

1267

Feb1411:50

wgoutput.cfg

-rw-r--r--

1

apache

apache

1713

Feb1411:50

wgsimple.html

 

./templates/finnish: total8

 

 

 

 

 

 

-rw-r--r--

1

apache

apache

2468

Feb1411:50

wgindex.html

-rw-r--r--

1

apache

apache

1191

Feb1411:50

wgoutput.cfg

 

./templates/french: total16

 

 

 

 

 

 

-rw-r--r--

1

apache

apache

3068

Feb1411:50

wgindex.html

-rw-r--r--

1

apache

apache

1882

Feb1411:50

wgoutput.cfg

-rw-r--r--

1

apache

apache

1775

Feb1411:50

wgsimple.html

-rw-r--r--

1

apache

apache

1232

Feb1411:50

wgverysimple.html

 

./templates/german: total12

 

 

 

 

 

 

-rw-r--r--

1

apache

apache

2206

Feb1411:50

wgall.html

-rw-r--r--

1

apache

apache

2135

Feb1411:50

wgindex.html

-rw-r--r--

1

apache

apache

1907

Feb1411:50

wgoutput.cfg

 

./templates/hebrew: total12

 

 

 

 

 

 

-rw-r--r--

1

apache

apache

2429

Feb1411:50

wgall.html

-rw-r--r--

1

apache

apache

2538

Feb1411:50

wgindex.html

-rw-r--r--

1

apache

apache

1330

Feb1411:50

wgoutput.cfg

 

./templates/italian:
total24

 

 

 

 

 

 

-rw-r--r--

1

apache

apache

3173

Feb1411:50

wgany.html

-rw-r--r--

1

apache

apache

612

Feb1411:50

wgbox.html

-rw-r--r--

1

apache

apache

3003

Feb1411:50

wgindex.html

-rw-r--r--

1

apache

apache

1854

Feb1411:50

wgoutput.cfg

-rw-r--r--

1

apache

apache

1925

Feb1411:50

wgsimple.html

-rw-r--r--

1

apache

apache

1215

Feb1411:50

wgverysimple.html

 

./templates/norwegian: total8

 

 

 

 

 

 

-rw-r--r--

1

apache

apache

2398

Feb1411:50

wgindex.html

-rw-r--r--

1

apache

apache

1168

Feb1411:50

wgoutput.cfg

 

./templates/polish: total24

 

 

 

 

 

 

-rw-r--r--

1

apache

apache

589

Feb1411:50

newquery.html

-rw-r--r--

1

apache

apache

616

Feb1411:50

wgbox.html

-rw-r--r--

1

apache

apache

3170

Feb1411:50

wgindex.html

-rw-r--r--

1

apache

apache

1757

Feb1411:50

wgoutput.cfg

-rw-r--r--

1

apache

apache

2028

Feb1411:50

wgsimple.html

-rw-r--r--

1

apache

apache

1279

Feb1411:50

wgverysimple.html

 

./templates/portuguese: total 12

 

 

 

 

 

 

-rw-r--r--

1

apache

apache

2183

Feb1411:50

wgall.html

-rw-r--r--

1

apache

apache

2445

Feb1411:50

wgindex.html

-rw-r--r--

1

apache

apache

1121

Feb1411:50

wgoutput.cfg

 

./templates/romanian: total 16

 

 

 

 

 

 

-rw-r--r--

1

apache

apache

3037

Feb1411:50

wgindex.html

-rw-r--r--

1

apache

apache

1831

Feb1411:50

wgoutput.cfg

-rw-r--r--

1

apache

apache

1782

Feb1411:50

wgsimple.html

-rw-r--r--

1

apache

apache

1226

Feb1411:50

wgverysimple.html

 

./templates/spanish total8

 

 

 

 

 

 

-rw-r--r--

1

apache

apache

2208

Feb1411:50

wgall.html

-rw-r--r--

1

apache

apache

2471

Feb1411:50

wgindex.html

 

./tests:
total20

 

 

 

 

 

 

-rw-r--r--

1

apache

apache

813

Feb1411:50

Gen_T.pl

-rw-r--r--

1

apache

apache

290

Feb1411:50

URL_T.pl

-rw-r--r--

1

apache

apache

138

Feb1411:50

wgA_T.pl

-rw-r--r--

1

apache

apache

5411

Feb1411:50

wgR_T.pl


In the webserver's cgi-bin, the directory named 'wg2' (if you accepted the default name) will contain a listing similar to this:

./cgi-bin/wg2

:

 

 

 

 

 

-rwxr-xr-x

1

apache

apache

45178

Feb1713:06

webglimpse.cgi

-rwxr-xr-x

1

apache

apache

7573

Feb1411:50

mfs.cgi

-rwxr-xr-x

1

apache

apache

95

Feb1411:50

showimg.cgi

-rwxr-xr-x

1

apache

apache

28660

Feb1411:50

wgarcmin.cgi

Important Files

Under the webglimpse home directory (e.g. /var/www/html/wg2/)

wgsites.conf

Contains domain/site info, such as DocumentRoot Normally edited through the web interface

archives.list

Contains list of all archives, titles and where they are located

Under each archive directory (e.g. /var/www/html/wg2/archives/1/)

archive.cfg

Archive configuration, normally edited through the web interface

wgreindex

Script for reindexing this archive,can be placed in your crontab

wgindex.html

Sample search form, you can copy this to your website

wgall.html

Sample form to search by subdirectory

.glimpse_filters

Programs to filter non-ascii files into text for indexing You can add programs here for PDF, Word, compressed, and other file formats

wgoutput.cfg

Custom output configuration file (with commercial version only)

.wgrankhits.cfg

Custom ranking formula for ordering results (commercial only)

Under the webglimpse cgi-bin directory (e.g. /var/www/cgi-bin/wg2)

webglimpse.cgi

the cgi script to perform searches (calls glimpse)

wgarcmin.cgi

the cgi script to manage archives

The only files that you generally want to edit by hand, are the special configuration files in each archive directory, including .glimpse_filters, .wgoutput.cfg, .wgrankhits.cfg, .wginputfields, .wgoutputfields.