企业🤖AI Agent构建引擎,智能编排和调试,一键部署,支持私有化部署方案 广告
``` package main import ( articleSpider "github.com/PeterYangs/article-spider/v3" ) func main() { f := articleSpider.Form{ Host: "https://www.shouyouzhijia.net", Channel: "/xinwen_[PAGE]/", PageStart: 1, Length: 3, ListSelector: "body > div.main.newex.clearfix > div.LC_lef > div.lef_content > dl", HrefSelector: " dd > h3 > a", DetailFields: map[string]articleSpider.Field{ "title": {Types: articleSpider.Text, Selector: "body > div.Min-cent.W1200 > div.Min_L > div.Left_top > h1"}, }, HttpHeader: map[string]string{ "cookie": "xx", "user-agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.159 Safari/537.36", }, } s := articleSpider.NewSpider(f, articleSpider.Normal) s.Start() } ```