白舟空间

larbin与mysql连接

baizoo — Sun, 06 May 2012 10:47:12 +0800

先备份。

从src/interf/useroutput.cc 文件的保存格式对应可以看得出来，不同保存模式分别对应哪个代码

defaultuseroutput.cc 对应默认的什么都不做

mirrorsaveuseroutput.cc 对应镜像模式

statsuseroutput.cc 对应状态模式

saveuseroutput.cc 对应一般模式d*****/f*****

修改src/interf/saveuseroutput.cc

实现将网页下载到磁盘，同时将URL和本地地址记录在mysql，是实现本地快照的基础。

indexFds = creat(fileName, S_IRWXU); //creat the save/d***** index file
if (indexFds < 0) {
cerr << "cannot open file " << fileName << "\n";
exit(1);
}

这段代码是生成index文件，在save/d*****/index，这个文件中就是已经下载的网页列表，对应了id，此id就是文件夹的序号。

由于有了导入mysql功能，为了减轻系统负担，所以将此段禁掉，

ecrireBuff(indexFds, buf, s); 是在index文件中写入条目，可以禁掉

ecrireBuff(fd, page->getPage(), page->getLength()); 是在具体的/d*****/f*****文件中写入下载的html代码

数据库中可以设置ID, Html_Link,PhyLoc, Time, Saved等字段，网络URL对应本地地址。

原文地址：http://hi.baidu.com/hustwk/blog/item/8865dc2a4069fb28d42af1b6.html

另外部分修改地址：http://hi.baidu.com/hustwk/blog/item/689d2a3f007b0fe955e72373.html

为了避免文件名判断混乱，在src/types.h中，改为如下：

#define fifoFile “fifofile”
#define fifoFileWait “fifowait”

options.h 中的 defaultuseroutput.cc

#define DEFAULT_OUTPUT 对应着使用src\interf\defaultuseroutput.cc
#define SIMPLE_SAVE 对应着使用src\interf\saveuseroutput.cc
#define MIRROR_SAVE 对应着使用src\interf\mirrorsaveuseroutput.cc
/#define STATS_OUTPUT 对应着使用src\interf\statsuseroutput.cc

我实验室改的是saveuseroutput.cc，在其中加入mysql语句，保证usr/include下有mysql.h等头文件。

编译makefile的代码方面：

在src/Makefile 中加入“-L/usr/lib/mysql -lmysqlclient ” ，即为如下：

larbin: $(ABS-UTILS-OBJ) $(ABS-FETCH-OBJ) $(ABS-INTERF-OBJ) $(ABS-MAIN-OBJ)
$(CXX) $(MF) $(LIBS) -L/usr/lib/mysql -lmysqlclient \
-o larbin $(ABS-UTILS-OBJ) \
$(ABS-FETCH-OBJ) $(ABS-INTERF-OBJ) $(ABS-MAIN-OBJ) ../adns/libadns.a

在src/larbin.make 中，加入“-I/usr/include/mysql -g”，即为如下：

CXXFLAGS:= -Wno-deprecated -Wall -D_REENTRANT -I- -I$(BASEDIR) -I$(ADNSDIR) -I/usr/include/mysql -g

备份地址 “larbin与爬虫” 分类下的文章

http://hi.baidu.com/hustwk/blog/category/larbin%D3%EB%C5%C0%B3%E6/index/0

larbin 安装配置注意事项

baizoo — Fri, 20 Apr 2012 23:30:09 +0800

Larbin是国外的一个开源的高效的搜索引擎爬虫工具（crawler）

larbin官方地址： http://larbin.sourceforge.net/

在fedora或者centos编译安装时,总是出现错误。网上说是要把adns文件夹下internal.h文件568-571注释掉，其实把：adns_status adns__parse_domain(adns_state ads, int serv, adns_query qu,
vbuf *vb, parsedomain_flags flags,
const byte *dgram, int dglen, int *cbyte_io, int max);

更正为：adns_status adns__parse_domain(adns_state ads, int serv, adns_query qu,
vbuf *vb, adns_queryflags flags,
const byte *dgram, int dglen, int *cbyte_io, int max);就不会出错了。

安装过程：./configure
make
./larbin
不过在运行larbin之前需要更改一下配置。

主要该两个文件：larbin.conf和options.h
一般在larbin.conf文件里改：
StartUrl :http://www.hfut.edu.cn //爬虫开始爬的起始网址
limitToDomain: .edu .com .cn .net .com.cn //限制爬虫抓取的网址域名后缀。

在options.h里修改：（我的配置是：）//#define DEFAULT_OUTPUT // do nothing…
#define SIMPLE_SAVE // save in files named save/dxxxxxx/fyyyyyy 简单输出一个目录两千个文件，包含索引。//这个很重要，默认是do nothing ，不会有任何结果输出的。

//#define MIRROR_SAVE // save in files (respect sites hierarchy)镜像方式保存
#define STATS_OUTPUT // do some stats on pages输出统计
#define FOLLOW_LINKS　// do you want to follow links in pages
#define LINKS_INFO //是不是得到该页面的子连接
#define NO_DUP　　//不允许重复
#define EXIT_AT_END //完成时退出
#define COOKIES
#define CGILEVEL 0 处理服务器端程序，也就是但url中包含? & = 之类的querString时也处理。
#define DEPTHBYSITE
#define THREAD_OUTPUT
#define RELOAD
#define GRAPH
#define STATS
#define BIGSTATS
编辑完成后，需要注意的是如果只修改larbin.conf文件，不需要重新编译，如果修改了options.h文件，需要运行 gmake　重新进行编译。

另外，types.h中有些项也可以自行设置，如　maxUrlsBySite　，maxPageSize

Larbin的使用–安装

baizoo — Fri, 20 Apr 2012 23:09:16 +0800

1、到网上下载 larbin-2.6.3.tar.gz，然后解压。

tar zxvf larbin-2.6.3.tar.gz
2、到解压的目录，运行配置文件

./configure
却出现以下的错误:

make[2]: 正在进入目录 `/home/byd/test/larbin-2.6.3/src/utils' makedepend -f- -I.. -Y *.cc 2> /dev/null > .depend make[2]: *** [dep-in] 错误 127 make[2]:正在离开目录 `/home/byd/test/larbin-2.6.3/src/utils' make[2]: 正在进入目录 `/home/byd/test/larbin-2.6.3/src/interf' makedepend -f- -I.. -Y *.cc 2> /dev/null > .depend make[2]: *** [dep-in] 错误 127 make[2]:正在离开目录 `/home/byd/test/larbin-2.6.3/src/interf' make[2]: 正在进入目录 `/home/byd/test/larbin-2.6.3/src/fetch' makedepend -f- -I.. -Y *.cc 2> /dev/null > .depend make[2]: *** [dep-in] 错误 127 make[2]:正在离开目录 `/home/byd/test/larbin-2.6.3/src/fetch' make[1]: *** [dep] 错误 2 make[1]:正在离开目录 `/home/byd/test/larbin-2.6.3/src' make: *** [dep] 错误 2

在上面发现有makedepend，于是输入

makedepend

发现没有安装,有如下的提示

The program 'makedepend' is currently not installed. You can install it by typing: sudo apt-get install xutils-dev

于是就输入命令老老实实的安装xutils-dev了

sudo apt-get install xutils-dev

安装之后，./configure成功

3、编译

在目录下输入make进行编译。又出现了一下的错误

parse.c:113: error: conflicting types for ‘adns__parse_domain’ internal.h:569: note: previous declaration of ‘adns__parse_domain’ was here parse.c: In function ‘adns__parse_domain_more’:

于是直接到adns目录找到internal.h文件注释掉568-572行。

//adns_status adns__parse_domain(adns_state ads, int serv, adns_query qu, //vbuf *vb, parsedomain_flags flags, //const byte *dgram, int dglen, int *cbyte_io, int max);

继续make ,又出现一下的错误

sequencer.cc:5: fatal error: iostream.h: 没有那个文件或目录

代码采用的是以前C的编码方式，现在要改成iostream 了。于是将目录下的所有iostream.h 改成iostream。可以采用一下的命令

sed -i -e 's/iostream.h/iostream/g' `grep -rl iostream.h *`　

注意：后面的包含grep 的不是单引号，而是键盘左上角的符号。

继续编译,又出现错误

hashTable.cc:32: error: ‘cerr’ was not declared in this scope hashTable.cc:41: error: ‘cerr’ was not declared in this scope hashTable.cc:42: error: ‘endl’ was not declared in this scope

于是将目录下的所有cerr和 endl改成 std::cerr和std::endl。可以采用类似上面的命令。不过要注意是不是有的endl或cerr已经是std::endl和std::cerr。

sed -i -e 's/cerr/std::cerr/g' `grep -rl cerr *` sed -i -e 's/endl/std::endl/g' `grep -rl endl *`　

至此编译就没有问题了。

可以发现在目录下已经生成larbin的可执行文件。

输入./larbin就可以运行larbin了。

nginx 301 跳转给网站域名加上www

baizoo — Mon, 09 Apr 2012 14:38:29 +0800

网站seo时，如果同时存在www和无www的域名访问会造成收录负担，所以有必要对其做个跳转。

方法：在配置文件里面写两个server，第一个里面只留带www的域名
server
{
listen 80;
server_name www.baizoo.cn;
….
}

第二个给无www的域名做301跳转
server
{
server_name baizoo.cn;
rewrite ^(.*) http://www.baizoo.cn$1 permanent;
}

同理如果需要删除www
server
{
listen 80;
server_name baizoo.cn;
….
}

server
{
server_name www.baizoo.cn;
rewrite ^(.*) http://baizoo.cn$1 permanent;
}

对网站访问权限做的一些处理记录

baizoo — Fri, 02 Mar 2012 16:54:11 +0800

1、限制了部分搜索引擎爬虫的访问。
在robots.txt文件中加入
User-agent: Baiduspider
Disallow: /
User-agent: Slurp
Disallow: /
注：Slurp 是yahoo的爬虫

2、限制了国内ip段的访问权限
在nginx配置文件里，添加blockips.conf文件
然后 include blocksip.conf;

blocksip.cof 的限制ip格式
deny 58.14.0.0/15
deny 58.16.0.0/13
deny 58.24.0.0/15
deny 58.30.0.0/15

IP段注解：ip后面的数字是netmask换算成10进制
从允许访问的段位从小到大排列,如127.0.0.0/24 下面才能是10.10.0.0/16
24表示子网掩码:255.255.255.0
16表示子网掩码:255.255.0.0
8表示子网掩码:255.0.0.0

记录一段网络上的国内ip段(经测试并不全)
order allow,deny
deny from 58.14.0.0/15
deny from 58.16.0.0/13
deny from 58.24.0.0/15
deny from 58.30.0.0/15
deny from 58.32.0.0/11
deny from 58.66.0.0/15
deny from 58.68.128.0/17
deny from 58.82.0.0/15
deny from 58.87.64.0/18
deny from 58.99.128.0/17
deny from 58.100.0.0/15
deny from 58.116.0.0/14
deny from 58.128.0.0/13
deny from 58.144.0.0/16
deny from 58.154.0.0/15
deny from 58.192.0.0/11
deny from 58.240.0.0/12
deny from 59.32.0.0/11
deny from 59.64.0.0/12
deny from 59.80.0.0/14
deny from 59.107.0.0/16
deny from 59.108.0.0/14
deny from 59.151.0.0/17
deny from 59.155.0.0/16
deny from 59.172.0.0/14
deny from 59.191.0.0/17
deny from 59.191.240.0/20
deny from 59.192.0.0/10
deny from 60.0.0.0/11
deny from 60.55.0.0/16
deny from 60.63.0.0/16
deny from 60.160.0.0/11
deny from 60.194.0.0/15
deny from 60.200.0.0/13
deny from 60.208.0.0/12
deny from 60.232.0.0/15
deny from 60.235.0.0/16
deny from 60.245.128.0/17
deny from 60.247.0.0/16
deny from 60.252.0.0/16
deny from 60.253.128.0/17
deny from 60.255.0.0/16
deny from 61.4.80.0/20
deny from 61.4.176.0/20
deny from 61.8.160.0/20
deny from 61.28.0.0/17
deny from 61.29.128.0/17
deny from 61.45.128.0/18
deny from 61.47.128.0/18
deny from 61.48.0.0/13
deny from 61.87.192.0/18
deny from 61.128.0.0/10
deny from 61.232.0.0/14
deny from 61.236.0.0/15
deny from 61.240.0.0/14
deny from 114.28.0.0/16
deny from 114.54.0.0/15
deny from 114.60.0.0/14
deny from 114.64.0.0/14
deny from 114.68.0.0/16
deny from 114.80.0.0/12
deny from 116.1.0.0/16
deny from 116.2.0.0/15
deny from 116.4.0.0/14
deny from 116.8.0.0/14
deny from 116.13.0.0/16
deny from 116.16.0.0/12
deny from 116.52.0.0/14
deny from 116.56.0.0/15
deny from 116.58.128.0/20
deny from 116.58.208.0/20
deny from 116.60.0.0/14
deny from 116.66.0.0/17
deny from 116.69.0.0/16
deny from 116.70.0.0/17
deny from 116.76.0.0/14
deny from 116.89.144.0/20
deny from 116.90.184.0/21
deny from 116.95.0.0/16
deny from 116.112.0.0/14
deny from 116.116.0.0/15
deny from 116.128.0.0/10
deny from 116.192.0.0/16
deny from 116.193.16.0/20
deny from 116.193.32.0/19
deny from 116.194.0.0/15
deny from 116.196.0.0/16
deny from 116.198.0.0/16
deny from 116.199.0.0/17
deny from 116.199.128.0/19
deny from 116.204.0.0/15
deny from 116.207.0.0/16
deny from 116.208.0.0/14
deny from 116.212.160.0/20
deny from 116.213.64.0/18
deny from 116.213.128.0/17
deny from 116.214.32.0/19
deny from 116.214.64.0/20
deny from 116.214.128.0/17
deny from 116.215.0.0/16
deny from 116.216.0.0/14
deny from 116.224.0.0/12
deny from 116.242.0.0/15
deny from 116.244.0.0/14
deny from 116.248.0.0/15
deny from 116.252.0.0/15
deny from 116.254.128.0/17
deny from 116.255.128.0/17
deny from 117.8.0.0/13
deny from 117.21.0.0/16
deny from 117.22.0.0/15
deny from 117.24.0.0/13
deny from 117.32.0.0/13
deny from 117.40.0.0/14
deny from 117.44.0.0/15
deny from 117.48.0.0/14
deny from 117.53.48.0/20
deny from 117.53.176.0/20
deny from 117.57.0.0/16
deny from 117.58.0.0/17
deny from 117.59.0.0/16
deny from 117.60.0.0/14
deny from 117.64.0.0/13
deny from 117.72.0.0/15
deny from 117.74.64.0/20
deny from 117.74.128.0/17
deny from 117.75.0.0/16
deny from 117.76.0.0/14
deny from 117.80.0.0/12
deny from 117.100.0.0/15
deny from 117.103.16.0/20
deny from 117.103.128.0/20
deny from 117.106.0.0/15
deny from 117.112.0.0/13
deny from 117.120.64.0/18
deny from 117.120.128.0/17
deny from 117.121.0.0/17
deny from 117.121.128.0/18
deny from 117.121.192.0/21
deny from 117.122.128.0/17
deny from 117.124.0.0/14
deny from 117.128.0.0/10
deny from 118.24.0.0/13
deny from 118.64.0.0/15
deny from 118.66.0.0/16
deny from 118.67.112.0/20
deny from 118.72.0.0/13
deny from 118.80.0.0/15
deny from 118.84.0.0/15
deny from 118.88.32.0/19
deny from 118.88.64.0/18
deny from 118.88.128.0/17
deny from 118.89.0.0/16
deny from 118.91.240.0/20
deny from 118.102.16.0/20
deny from 118.112.0.0/13
deny from 118.120.0.0/14
deny from 118.124.0.0/15
deny from 118.126.0.0/16
deny from 118.132.0.0/14
deny from 118.144.0.0/14
deny from 118.178.0.0/16
deny from 118.180.0.0/14
deny from 118.184.0.0/13
deny from 118.192.0.0/12
deny from 118.212.0.0/15
deny from 118.224.0.0/14
deny from 118.228.0.0/15
deny from 118.230.0.0/16
deny from 118.239.0.0/16
deny from 118.242.0.0/16
deny from 118.244.0.0/14
deny from 118.248.0.0/13
deny from 119.0.0.0/15
deny from 119.2.0.0/19
deny from 119.2.128.0/17
deny from 119.3.0.0/16
deny from 119.4.0.0/14
deny from 119.8.0.0/15
deny from 119.10.0.0/17
deny from 119.15.136.0/21
deny from 119.16.0.0/16
deny from 119.18.192.0/20
deny from 119.18.208.0/21
deny from 119.18.224.0/19
deny from 119.19.0.0/16
deny from 119.20.0.0/14
deny from 119.27.64.0/18
deny from 119.27.160.0/19
deny from 119.27.192.0/18
deny from 119.28.0.0/15
deny from 119.30.48.0/20
deny from 119.31.192.0/19
deny from 119.32.0.0/13
deny from 119.40.0.0/18
deny from 119.40.64.0/20
deny from 119.40.128.0/17
deny from 119.41.0.0/16
deny from 119.42.0.0/19
deny from 119.42.136.0/21
deny from 119.42.224.0/19
deny from 119.44.0.0/15
deny from 119.48.0.0/13
deny from 119.57.0.0/16
deny from 119.58.0.0/16
deny from 119.59.128.0/17
deny from 119.60.0.0/15
deny from 119.62.0.0/16
deny from 119.63.32.0/19
deny from 119.75.208.0/20
deny from 119.78.0.0/15
deny from 119.80.0.0/15
deny from 119.84.0.0/14
deny from 119.88.0.0/14
deny from 119.96.0.0/13
deny from 119.108.0.0/15
deny from 119.112.0.0/12
deny from 119.128.0.0/12
deny from 119.144.0.0/14
deny from 119.148.160.0/20
deny from 119.161.128.0/17
deny from 119.162.0.0/15
deny from 119.164.0.0/14
deny from 119.176.0.0/12
deny from 119.232.0.0/15
deny from 119.235.128.0/18
deny from 119.248.0.0/14
deny from 119.253.0.0/16
deny from 119.254.0.0/15
deny from 120.0.0.0/12
deny from 120.24.0.0/14
deny from 120.30.0.0/15
deny from 120.32.0.0/12
deny from 120.48.0.0/15
deny from 120.52.0.0/14
deny from 120.64.0.0/13
deny from 120.72.32.0/19
deny from 120.72.128.0/17
deny from 120.76.0.0/14
deny from 120.80.0.0/13
deny from 120.90.0.0/15
deny from 120.92.0.0/16
deny from 120.94.0.0/15
deny from 120.128.0.0/13
deny from 120.136.128.0/18
deny from 120.137.0.0/17
deny from 120.192.0.0/10
deny from 121.0.16.0/20
deny from 121.4.0.0/15
deny from 121.8.0.0/13
deny from 121.16.0.0/12
deny from 121.32.0.0/13
deny from 121.40.0.0/14
deny from 121.46.0.0/15
deny from 121.48.0.0/15
deny from 121.51.0.0/16
deny from 121.52.160.0/19
deny from 121.52.208.0/20
deny from 121.52.224.0/19
deny from 121.55.0.0/18
deny from 121.56.0.0/15
deny from 121.58.0.0/17
deny from 121.58.144.0/20
deny from 121.59.0.0/16
deny from 121.60.0.0/14
deny from 121.68.0.0/14
deny from 121.76.0.0/15
deny from 121.79.128.0/18
deny from 121.89.0.0/16
deny from 121.100.128.0/17
deny from 121.101.208.0/20
deny from 121.192.0.0/13
deny from 121.201.0.0/16
deny from 121.204.0.0/14
deny from 121.224.0.0/12
deny from 121.248.0.0/14
deny from 121.255.0.0/16
deny from 122.0.64.0/18
deny from 122.0.128.0/17
deny from 122.4.0.0/14
deny from 122.8.0.0/13
deny from 122.48.0.0/16
deny from 122.49.0.0/18
deny from 122.51.0.0/16
deny from 122.64.0.0/11
deny from 122.96.0.0/15
deny from 122.102.0.0/20
deny from 122.102.64.0/19
deny from 122.112.0.0/14
deny from 122.119.0.0/16
deny from 122.136.0.0/13
deny from 122.144.128.0/17
deny from 122.152.192.0/18
deny from 122.156.0.0/14
deny from 122.192.0.0/14
deny from 122.198.0.0/16
deny from 122.200.64.0/18
deny from 122.204.0.0/14
deny from 122.224.0.0/12
deny from 122.240.0.0/13
deny from 122.248.48.0/20
deny from 123.0.128.0/18
deny from 123.4.0.0/14
deny from 123.8.0.0/13
deny from 123.49.128.0/17
deny from 123.52.0.0/14
deny from 123.56.0.0/13
deny from 123.64.0.0/11
deny from 123.96.0.0/15
deny from 123.98.0.0/17
deny from 123.99.128.0/17
deny from 123.100.0.0/19
deny from 123.101.0.0/16
deny from 123.103.0.0/17
deny from 123.108.128.0/20
deny from 123.108.208.0/20
deny from 123.112.0.0/12
deny from 123.128.0.0/13
deny from 123.136.80.0/20
deny from 123.137.0.0/16
deny from 123.138.0.0/15
deny from 123.144.0.0/12
deny from 123.160.0.0/12
deny from 123.176.80.0/20
deny from 123.177.0.0/16
deny from 123.178.0.0/15
deny from 123.180.0.0/14
deny from 123.184.0.0/13
deny from 123.196.0.0/15
deny from 123.199.128.0/17
deny from 123.206.0.0/15
deny from 123.232.0.0/14
deny from 123.242.0.0/17
deny from 123.244.0.0/14
deny from 123.249.0.0/16
deny from 123.253.0.0/16
deny from 124.6.64.0/18
deny from 124.14.0.0/15
deny from 124.16.0.0/15
deny from 124.20.0.0/14
deny from 124.28.192.0/18
deny from 124.29.0.0/17
deny from 124.31.0.0/16
deny from 124.40.112.0/20
deny from 124.40.128.0/18
deny from 124.42.0.0/16
deny from 124.47.0.0/18
deny from 124.64.0.0/15
deny from 124.66.0.0/17
deny from 124.67.0.0/16
deny from 124.68.0.0/14
deny from 124.72.0.0/13
deny from 124.88.0.0/13
deny from 124.108.8.0/21
deny from 124.108.40.0/21
deny from 124.112.0.0/13
deny from 124.126.0.0/15
deny from 124.128.0.0/13
deny from 124.147.128.0/17
deny from 124.156.0.0/16
deny from 124.160.0.0/13
deny from 124.172.0.0/14
deny from 124.192.0.0/15
deny from 124.196.0.0/16
deny from 124.200.0.0/13
deny from 124.220.0.0/14
deny from 124.224.0.0/12
deny from 124.240.0.0/17
deny from 124.240.128.0/18
deny from 124.242.0.0/16
deny from 124.243.192.0/18
deny from 124.248.0.0/17
deny from 124.249.0.0/16
deny from 124.250.0.0/15
deny from 124.254.0.0/18
deny from 125.31.192.0/18
deny from 125.32.0.0/12
deny from 125.58.128.0/17
deny from 125.61.128.0/17
deny from 125.62.0.0/18
deny from 125.64.0.0/11
deny from 125.96.0.0/15
deny from 125.98.0.0/16
deny from 125.104.0.0/13
deny from 125.112.0.0/12
deny from 125.169.0.0/16
deny from 125.171.0.0/16
deny from 125.208.0.0/18
deny from 125.210.0.0/15
deny from 125.213.0.0/17
deny from 125.214.96.0/19
deny from 125.215.0.0/18
deny from 125.216.0.0/13
deny from 125.254.128.0/17
deny from 134.196.0.0/16
deny from 159.226.0.0/16
deny from 161.207.0.0/16
deny from 162.105.0.0/16
deny from 166.111.0.0/16
deny from 167.139.0.0/16
deny from 168.160.0.0/16
deny from 169.211.1.0/24
deny from 192.83.122.0/24
deny from 192.83.169.0/24
deny from 192.124.154.0/24
deny from 192.188.170.0/24
deny from 198.17.7.0/24
deny from 202.0.110.0/24
deny from 202.0.176.0/22
deny from 202.4.128.0/19
deny from 202.4.252.0/22
deny from 202.8.128.0/19
deny from 202.10.64.0/20
deny from 202.14.88.0/24
deny from 202.14.235.0/24
deny from 202.14.236.0/23
deny from 202.14.238.0/24
deny from 202.20.120.0/24
deny from 202.22.248.0/21
deny from 202.38.0.0/20
deny from 202.38.64.0/18
deny from 202.38.128.0/21
deny from 202.38.136.0/23
deny from 202.38.138.0/24
deny from 202.38.140.0/22
deny from 202.38.146.0/23
deny from 202.38.149.0/24
deny from 202.38.150.0/23
deny from 202.38.152.0/22
deny from 202.38.156.0/24
deny from 202.38.158.0/23
deny from 202.38.160.0/23
deny from 202.38.164.0/22
deny from 202.38.168.0/21
deny from 202.38.176.0/23
deny from 202.38.184.0/21
deny from 202.38.192.0/18
deny from 202.41.152.0/21
deny from 202.41.240.0/20
deny from 202.43.144.0/20
deny from 202.46.32.0/19
deny from 202.46.224.0/20
deny from 202.60.112.0/20
deny from 202.63.248.0/22
deny from 202.69.4.0/22
deny from 202.69.16.0/20
deny from 202.70.0.0/19
deny from 202.74.8.0/21
deny from 202.75.208.0/20
deny from 202.85.208.0/20
deny from 202.90.0.0/22
deny from 202.90.224.0/20
deny from 202.90.252.0/22
deny from 202.91.0.0/22
deny from 202.91.128.0/22
deny from 202.91.176.0/20
deny from 202.91.224.0/19
deny from 202.92.0.0/22
deny from 202.92.252.0/22
deny from 202.93.0.0/22
deny from 202.93.252.0/22
deny from 202.95.0.0/19
deny from 202.95.252.0/22
deny from 202.96.0.0/12
deny from 202.112.0.0/13
deny from 202.120.0.0/15
deny from 202.122.0.0/21
deny from 202.122.32.0/21
deny from 202.122.64.0/19
deny from 202.122.112.0/21
deny from 202.122.128.0/24
deny from 202.123.96.0/20
deny from 202.124.24.0/22
deny from 202.125.176.0/20
deny from 202.127.0.0/21
deny from 202.127.12.0/22
deny from 202.127.16.0/20
deny from 202.127.40.0/21
deny from 202.127.48.0/20
deny from 202.127.112.0/20
deny from 202.127.128.0/19
deny from 202.127.160.0/21
deny from 202.127.192.0/20
deny from 202.127.208.0/23
deny from 202.127.212.0/22
deny from 202.127.216.0/21
deny from 202.127.224.0/19
deny from 202.130.0.0/19
deny from 202.130.224.0/19
deny from 202.131.16.0/21
deny from 202.131.48.0/20
deny from 202.131.208.0/20
deny from 202.136.48.0/20
deny from 202.136.208.0/20
deny from 202.136.224.0/20
deny from 202.141.160.0/19
deny from 202.142.16.0/20
deny from 202.143.16.0/20
deny from 202.148.96.0/19
deny from 202.149.160.0/19
deny from 202.149.224.0/19
deny from 202.150.16.0/20
deny from 202.152.176.0/20
deny from 202.153.48.0/20
deny from 202.158.160.0/19
deny from 202.160.176.0/20
deny from 202.164.0.0/20
deny from 202.164.25.0/24
deny from 202.165.96.0/20
deny from 202.165.176.0/20
deny from 202.165.208.0/20
deny from 202.168.160.0/19
deny from 202.170.128.0/19
deny from 202.170.216.0/21
deny from 202.173.8.0/21
deny from 202.173.224.0/19
deny from 202.179.240.0/20
deny from 202.180.128.0/19
deny from 202.181.112.0/20
deny from 202.189.80.0/20
deny from 202.192.0.0/12
deny from 203.18.50.0/24
deny from 203.79.0.0/20
deny from 203.80.144.0/20
deny from 203.81.16.0/20
deny from 203.83.56.0/21
deny from 203.86.0.0/18
deny from 203.86.64.0/19
deny from 203.88.32.0/19
deny from 203.88.192.0/19
deny from 203.89.0.0/22
deny from 203.90.0.0/22
deny from 203.90.128.0/18
deny from 203.90.192.0/19
deny from 203.91.32.0/19
deny from 203.91.96.0/20
deny from 203.91.120.0/21
deny from 203.92.0.0/22
deny from 203.92.160.0/19
deny from 203.93.0.0/16
deny from 203.94.0.0/19
deny from 203.95.0.0/21
deny from 203.95.96.0/19
deny from 203.99.16.0/20
deny from 203.99.80.0/20
deny from 203.100.32.0/20
deny from 203.100.80.0/20
deny from 203.100.96.0/19
deny from 203.100.192.0/20
deny from 203.110.160.0/19
deny from 203.118.192.0/19
deny from 203.119.24.0/21
deny from 203.119.32.0/22
deny from 203.128.32.0/19
deny from 203.128.96.0/19
deny from 203.130.32.0/19
deny from 203.132.32.0/19
deny from 203.134.240.0/21
deny from 203.135.96.0/19
deny from 203.135.160.0/20
deny from 203.142.219.0/24
deny from 203.148.0.0/18
deny from 203.152.64.0/19
deny from 203.156.192.0/18
deny from 203.158.16.0/21
deny from 203.161.192.0/19
deny from 203.166.160.0/19
deny from 203.171.224.0/20
deny from 203.174.7.0/24
deny from 203.174.96.0/19
deny from 203.175.128.0/19
deny from 203.175.192.0/18
deny from 203.176.168.0/21
deny from 203.184.80.0/20
deny from 203.187.160.0/19
deny from 203.190.96.0/20
deny from 203.191.16.0/20
deny from 203.191.64.0/18
deny from 203.191.144.0/20
deny from 203.192.0.0/19
deny from 203.196.0.0/21
deny from 203.207.64.0/18
deny from 203.207.128.0/17
deny from 203.208.0.0/20
deny from 203.208.16.0/22
deny from 203.208.32.0/19
deny from 203.209.224.0/19
deny from 203.212.0.0/20
deny from 203.212.80.0/20
deny from 203.222.192.0/20
deny from 203.223.0.0/20
deny from 210.2.0.0/19
deny from 210.5.0.0/19
deny from 210.5.144.0/20
deny from 210.12.0.0/15
deny from 210.14.64.0/19
deny from 210.14.112.0/20
deny from 210.14.128.0/17
deny from 210.15.0.0/17
deny from 210.15.128.0/18
deny from 210.16.128.0/18
deny from 210.21.0.0/16
deny from 210.22.0.0/16
deny from 210.23.32.0/19
deny from 210.25.0.0/16
deny from 210.26.0.0/15
deny from 210.28.0.0/14
deny from 210.32.0.0/12
deny from 210.51.0.0/16
deny from 210.52.0.0/15
deny from 210.56.192.0/19
deny from 210.72.0.0/14
deny from 210.76.0.0/15
deny from 210.78.0.0/16
deny from 210.79.64.0/18
deny from 210.79.224.0/19
deny from 210.82.0.0/15
deny from 210.87.128.0/18
deny from 210.185.192.0/18
deny from 210.192.96.0/19
deny from 211.64.0.0/13
deny from 211.80.0.0/12
deny from 211.96.0.0/13
deny from 211.136.0.0/13
deny from 211.144.0.0/12
deny from 211.160.0.0/13
deny from 218.0.0.0/11
deny from 218.56.0.0/13
deny from 218.64.0.0/11
deny from 218.96.0.0/14
deny from 218.104.0.0/14
deny from 218.108.0.0/15
deny from 218.185.192.0/19
deny from 218.192.0.0/12
deny from 218.240.0.0/13
deny from 218.249.0.0/16
deny from 219.72.0.0/16
deny from 219.82.0.0/16
deny from 219.128.0.0/11
deny from 219.216.0.0/13
deny from 219.224.0.0/12
deny from 219.242.0.0/15
deny from 219.244.0.0/14
deny from 220.101.192.0/18
deny from 220.112.0.0/14
deny from 220.152.128.0/17
deny from 220.154.0.0/15
deny from 220.160.0.0/11
deny from 220.192.0.0/12
deny from 220.231.0.0/18
deny from 220.231.128.0/17
deny from 220.232.64.0/18
deny from 220.234.0.0/16
deny from 220.242.0.0/15
deny from 220.248.0.0/14
deny from 220.252.0.0/16
deny from 221.0.0.0/13
deny from 221.8.0.0/14
deny from 221.12.0.0/17
deny from 221.12.128.0/18
deny from 221.13.0.0/16
deny from 221.14.0.0/15
deny from 221.122.0.0/15
deny from 221.129.0.0/16
deny from 221.130.0.0/15
deny from 221.133.224.0/19
deny from 221.136.0.0/15
deny from 221.172.0.0/14
deny from 221.176.0.0/13
deny from 221.192.0.0/14
deny from 221.196.0.0/15
deny from 221.198.0.0/16
deny from 221.199.0.0/17
deny from 221.199.128.0/18
deny from 221.199.192.0/20
deny from 221.199.224.0/19
deny from 221.200.0.0/13
deny from 221.208.0.0/12
deny from 221.224.0.0/12
deny from 222.16.0.0/12
deny from 222.32.0.0/11
deny from 222.64.0.0/11
deny from 222.125.0.0/16
deny from 222.126.128.0/17
deny from 222.128.0.0/12
deny from 222.160.0.0/14
deny from 222.168.0.0/13
deny from 222.176.0.0/12
deny from 222.192.0.0/11
deny from 222.240.0.0/13
deny from 222.248.0.0/15

批处理删除特定时间的备份文件

baizoo — Thu, 01 Mar 2012 18:08:56 +0800

服务器里有个mysql自动备份的bat
set zhou=%Date:~0,10% md "E:\mysqlback\%zhou%" "G:\Program Files\MySQL\MySQL Server 5.0\bin\mysqldump.exe" --opt -Q sbdb -root -password > G:\mysqlback\%zhou%\db.sql

然后计划任务里让这个bat每天执行。

时间久了，备份文件就会越来越多，占据了大量的服务器硬盘。所以需要删除多余的备份。
如果只需要保留最近一个星期的备份，需要如何操作？
代码：
cd /d G:\mysqlback\ for /f "skip=7" %%i in ('dir /tc /o-d /b') do rmdir /s /Q %%i

参考资料
使用for命令读取dir /tc /o-d /a的结果，可以分成4段，前两段为日期与时间，第3段为目录或文件大小，第4段为文件名或目录


名。然后根据第1段和第2段与需要的时间进行比较，决定是否删除文件 
@echo off

rem cd /d f:\temp

rem mDateTime格式: yyymmddHHmm

set mDateTime=200608161907

for /f "skip=4 tokens=1,2,3,4* delims=<>" %%i in ('dir /a /-c /tc /o-d') do call :proc %%i %%j %%k %%l

goto end

:proc

set aDate=%1

set aTime=%2

set aType=%3

set aFile=%4

set aDatetime=%aDate:~0,4%%aDate:~5,2%%aDate:~8,2%%aTime:~0,2%%aTime:~3,2%

if /i "%aDateTime%" lss "%mDateTime%" (if NOT "%aType%"=="DIR" attrib "%aFile%" -r -h -s && del "%aFile%")

:end 
但上面会有点问题，主要是因为if不能做大的数字的比较，200608161907对if来说太大了。我们可以先比较日期，再比较时间，但
if语句比较多，还是折中一下，采用两位年份：

rem mDateTime格式: ymmddHHmm

set mDateTime=0608161907

……

set aDatetime=%aDate:~2,2%%aDate:~5,2%%aDate:~8,2%%aTime:~0,2%%aTime:~3,2%

Windows2003有一个命令Forfiles，如：

Forfiles /D -30 /C "cmd /c echo @fname 是30天前的。2000下可以把2003的Forfiles.exe文件拷过来用。

另外如果保留最近n个文件，就比较简单了，如，保留最近30个bak文件： for /f "skip=30" %i in ('dir *.bak /tc /o-d /b') do del %i 批处理中，要把%i 改为%%i

(转)技术较差的站长更容易成功的秘诀——简单专注

baizoo — Mon, 30 Jan 2012 16:09:57 +0800

转自落伍。
注：不认同此文内容的，请列出自己的观点，大家互动一下，聚众人之力，总结一下简单的成功之道！
个人站长，越没有技术的，越能获得成功，这是很普遍的现象，为什么呢？我们一起分享一下。李兴平没有技术，对asp都不懂，只会静态的页面，他成功了，成为中国最大的站长，流量超过了SINA，甚至包括落伍的鱼，阿飞，都没有技术，他们甚至连做一个友情链接都不会。但是他们都获得了成功，至少在草根，在站长中都功成名就。为什么？还有很多熟悉的技术很高的朋友，例如有一个技术特牛的程序作者，包括逐浪等国内所有顶尖的小说网站程序都是他写的，但是他在做小说网站的时候，愣是突破不了5000个ip，还没有一般的小说网站一篇小说的访问量。
还有更多的技术人员和营销人员，甚至带了数百万在传统行业很精英的人来做互联网，还做网站，都是失败。难道互联网，难道个人网络世界天生给这些没有技术的人一个后门？
很多人都在纳闷一个问题：我比李兴平学历高，我比他触网早，他做的我都会，我比他更有经验，更有头脑，更有资源，为什么我就是不能成功？
一个高中的学生，也是什么都不会，网络上随便下载了一个音乐程序，做了flash音乐，后来做到20万ip一天，粗糙的页面，很慢的更新速度，为什么他们就能成功，而很多团队运营的音乐网络帝国，买广告，拉风险，最后眼巴巴的看着自己的alexa 最新网络赚钱信息公布与讨论，终于从20万爬到10万了，而年轻的个人站长，早从1万到了2000了。
为什么能成功
简单专注
如果你看到我这篇文章，好好的体味一下这4个字的价值，如果你不能体会，你就用毛笔下写来，刻下来，放在你最显眼的地方，每天去研究这4个字。
成功的奥秘
为什么要简单，很多网站自己把自己给做累死了，功能多的自己都数不过来，除了摆摆花架子和累死自己，没有什么其他的用，看看ip138 ，看看baidu，能让网友最简单的更迅速的实现自己的目标才是网友最爱。而不是要网友按照你的设计走过场，你累他也累！为什么要专注，因为你太聪明，你太有才了，所以你会失败，你太聪明了，太有才了，你才不会甘心做一个网站，你才会脚踏两只船，你才会不停的来回奔波，你才会不停的拉长战线，你才不会脚踏实地的去做一件事情，你才不会深究一个领域，你才会疲于奔命。所以你失败了，就这么简单。成功注意两点：简单专注！
附：对拒绝游泳的鱼宣谈个人网站运营和坚守精神讲座的摘录

1。实用为王，像做人一样做站。
2。剩者为王，不要轻易地卖站或者放弃。
3。用非常夸张的手法，到处用软文手法做SEO，就为了诱导一些少量的点击。
4。建议大家，去做笨的人。
5。有社会经验，有能力，懂人情事故的，才会机会。
6。现在的个人站长界，已经被弄得太浮燥了。
7。百度越来越聪明，网站已经越来越难去速成了。
8。做站卖站，这样的日子能过多久？
9。地方站或者垂直类的网站，是赚钱的。
10。还没有一个在当地几乎已经垄断的地方站？做大做全，完全是没有机会的。
11。我们要去发现的是，需求。
12。买站卖站卖链接能赚钱，但是不能当作主要目标。
13。网上，只是一个窗口。
14。如果我们要起步的话，还是得利用QQ。
15。做，就是要做共赢的事情。

16。做，就是要做实事。
17。虚假的东西，吹的东西，短期的行为，终究是长不了的，终非王道。
18。有人说，鱼，当年你是运气好，我看你也没啥能力，落伍也是一团糟，你只是运气好。但是，当年比落伍大的社区，光用手指是肯定表达不过来的，但是今天他们已经消失了。
19。愚者，就是在于坚持，我们没有啥好拼的，就是拼，谁能坚持到最后。
20。作为社区，就是要集中力量。版块多有啥用，你顾得过来吗？控制在6个左右。
21。你需要一个卖点，或者一个口号。
22。正面竞争是不太必要的，最好是共赢。
23。做资源的极难去激发荣誉感的，所谓荣誉感是社区类的比较多。
24。让用户产生荣誉感，你可以去感动他，和用户产生感情。
25。个人站，永远不要和别人比功能，比技术，人每天都会有很多想法。
26。站在巨人肩膀上比较好，也就是多去学习下同类的。
27。天气冷的时候问候下，人肉都可以。
28。无论任何类型的网站，你都需要有特点，你向别人介绍的时候，总要一句话能表达出来，你这是干什么的，能提供什么，没特点就属于泛流量站。
29。游戏门户，拼的就是资源的更新速度。基本上，游戏门户，个人是很难的。游戏门户，主要是和游戏关系好，而不是玩家。
30。很多的技巧/手法/SEO等，已经讲得非常多了。

vbs自动关机

baizoo — Wed, 19 Oct 2011 17:14:09 +0800

一个自动关机的vbs 留作备份
a=hour(now) b=weekday(now)


select case b

case 1,3,4,5,6,7

if a>=23 then

call shut_down()

end if

end select

private sub shut_down() Set colOS = GetObject("winmgmts:{(Shutdown)}").ExecQuery("Select * FROM Win32_OperatingSystem") For Each eOs In colOS eOs.Win32Shutdown(1) Next end sub
下面代码可以写启动项
set ws=createobject("wscript.shell") ws.Regwrite"HKLM\Software\Microsoft\Windows\CurrentVersion\Run\",wscript.scriptfullname

BT5破解wpa密码

baizoo — Wed, 24 Aug 2011 16:10:51 +0800

都说破解wpa密码很难，我尝试了一下，确实挺难的。

方法一、用minidwep破解wpa 见 BT5 中文版破解WPA2 WPA简单过程教程

方法二、奶牛博客里提供了命令行下破解wpa的方法 BackTrack5 (BT5)无线密码破解教程之WPA/WPA2-PSK型无线密码破解这个过程其实跟minidwep是一样的，只是上面图形化了。

方法三、用EWSA 破解该方法没试过，貌似是windows系统下运行的。

BT5破解wep无线密码

baizoo — Wed, 24 Aug 2011 16:03:04 +0800

按照前篇日志里的方法制作bt5 u盘启动盘后，进入bt5 运行startx进入图形界面。
下载一个minidwep的安装包下载

降其放置在root目录下
运行 dpkg -i minidwep-gtk.deb 安装，然后就可以执行minidwep进行wep破解了。