登录
首页 » C# » 网络通用采集工具 完整源码下载

网络通用采集工具 完整源码下载

于 2020-10-28 发布
0 83
下载积分: 1 下载次数: 1

代码说明:

Soukey采摘数据采集软件是一套面向个人站长、中小企业提供的一套免费开源的数据采集软件,可用于文章、论坛、博、企业信息等各种网站信息的采集,同时可 自由发布到文件、数据库,通知也支持Web在线发布功能。同时,如果您了解技术,还可在Soukey采摘基础上扩展更加丰富的功能,包括:舆情监控、RSS制作、行业化 数据采集等功能。 Soukey采摘数据采集软件使用不受任何限制,源代码使用请遵循BSD许可协议。1、多任务、多线程,支持一个任务运行多个实例; 2 、支持图片、Flash及文件下载; 3、网址配置支持参数定制,及外部字典参数; 4、支持Cookie、POST采集; 5、支持导航、自动翻页; 6 、可采集Ajax数据; 7、采集数据临时存储、断点续采; 8 、支持数据导出,文件、数据库; 9 、在线数据发布; 10 、数据采集支持采集数据加工; 11 、支持任务计划; 12 、支持任务触发器; 13、提供网址编/解码工具; 14 、提供Mini浏览器; 15、支持简体中文及英文;

下载说明:请别用迅雷下载,失败请重下,重下不扣分!

发表评论

0 个回复

  • 放大镜
    简单放大镜,生成一个放大窗口,滚轮实现倍率调节(Simple magnifier generates an enlarged window, and the roller realizes magnification regulation)
    2017-07-15 15:37:07下载
    积分:1
  • 小鸡url采集
    常用的采集url,安全检测人员常用的东西(woyebuhuiyingwenrangwoxiejiuzhinengpinyin)
    2020-06-19 11:00:02下载
    积分:1
  • c# socket 必看的实例源码下载(封装的很好)
    c# socket网络编程 必看的实例源码下载(封装的很好)
    2014-06-19下载
    积分:1
  • scara
    4轴scara机器人的正逆解代码,仅供参考!(Positive and inverse solution code of 4 axis SCARA robot.For reference only!)
    2018-01-13 10:08:43下载
    积分:1
  • VPN
    手写VPN,模拟IP in IP的VPN路由,包括服务器端和客户端(VPN Server Writen by C++)
    2020-06-25 09:40:02下载
    积分:1
  • WinInet
    vc++可视化编程,包括网络编程部分,压缩包里面的是源代码,可直接运行。(vc++ visual programming, including network programming part of the compressed packet inside the source code can be directly run.)
    2009-12-21 12:43:00下载
    积分:1
  • ConsoleApplication2
    多线程的应用,用加锁的方式来优化线程,体会加锁的重要性(Multithreading application)
    2018-05-14 18:04:12下载
    积分:1
  • AVI_Transport
    :文章介绍了在局域网有关AVI文件视频流的实时操作中如何获取AVI视 频流,利用系统压缩管理器实现视频压缩,并实现视频图像的快速显示等问题。具体 讨论了在利用UDP协议进行数据传输时平滑突发数据流、恢复接收数据包的次序 等问题。(: This paper introduces the relevant AVI file in the local area video streaming real-time operation How to obtain the AVI video stream, using System Manager to achieve compression video compression, and to achieve rapid display video images and so on. Specifically discussed the use of UDP protocol for data transmission when the unexpected smooth data flow and restore order to receive packets and so on.)
    2008-01-24 11:21:17下载
    积分:1
  • c# 扫描IP Http Header
    c# 扫描IP Http Headerusing System;using System.Collections.Generic;using System.ComponentModel;using System.Data;using System.Drawing;using System.Linq;using System.Text;using System.Windows.Forms;using System.Threading;using System.IO;namespace HScan{ public partial class Form1 : Form { int _currentThreads = 0; int _maxThreads = 100; Thread main = null; Thread mt = null; List threads = new List(); public Form1() { InitializeComponent(); Control.CheckForIllegalCrossThreadCalls = false; } private void btnStart_Click(object sender, EventArgs e) { btnStart.Enabled = false; if (txtStart.Text.Trim() == "") { MessageBox.Show("起始IP不能为空."); return; } if (txtEnd.Text.Trim() == "") { MessageBox.Show("结束IP不能为空."); return; } int ts = Convert.ToInt32(txtThreads.Text); _maxThreads = ts; string startIp = txtStart.Text; string endIp = txtEnd.Text; TParameter tp=new TParameter(); tp.StartIp=startIp; tp.EndIp=endIp; tp.ThreadCount=ts; main = new Thread(new ParameterizedThreadStart(StartMe)); main.Start(tp); } protected void ThreadManage() { Thread c=null; while (true) { System.Object lockThis = new System.Object(); lock (lockThis) { for (int i = 0; i < threads.Count; i ) { if (threads[i] != null && !threads[i].IsAlive) { c = threads[i]; break; } } if (c != null) { threads.Remove(c); } } } } protected void StartMe(object ob) { mt = new Thread(new ThreadStart(ThreadManage)); mt.Start(); TParameter p = ob as TParameter; string curIp = p.StartIp; while (true) { for (int i = 0; i < _maxThreads; i ) { if (curIp != "") { if (_currentThreads >= _maxThreads) break; System.Object lockThis = new System.Object(); lock (lockThis) { _currentThreads ; if (_currentThreads > _maxThreads) _currentThreads = _maxThreads; string tip = curIp; Thread t = new Thread(new ParameterizedThreadStart(Run)); t.Start(tip); threads.Add(t); curIp = IPUtility.getLastIp(curIp, p.EndIp, 1); } } else { break; } } } } protected void Run(object ob) { string ip = ob.ToString(); SocketGetHead h = new SocketGetHead(); string ret = h.GetHtml(ip, 80); if (ret.IndexOf("DVRDVS-Webs") > 0) { ListViewItem item = new ListViewItem(); item.SubItems[0].Text = (listView1.Items.Count 1).ToString(); ListViewItem.ListViewSubItem lvSubItem = new ListViewItem.ListViewSubItem(); lvSubItem.Text = ip; item.SubItems.Add(lvSubItem); lvSubItem = new ListViewItem.ListViewSubItem(); lvSubItem.Text = "DVRDVS-Webs"; item.SubItems.Add(lvSubItem); listView1.Items.Add(item); } System.Object lockThis = new System.Object(); lock(lockThis) { lblCurIp.Text = ip; _currentThreads--; if (_currentThreads < 0) _currentThreads = 0; } } private void tsmCopy_Click(object sender, EventArgs e) { if (listView1.SelectedItems.Count > 0) { string ip = listView1.SelectedItems[0].SubItems[1].Text; Clipboard.SetText(ip); } } private void tsmExport_Click(object sender, EventArgs e) { StreamWriter writer = new StreamWriter(AppDomain.CurrentDomain.BaseDirectory "\export.txt",true); foreach (ListViewItem item in listView1.Items) { string ip=item.SubItems[1].Text; writer.WriteLine(ip); writer.Flush(); } writer.Flush(); writer.Close(); MessageBox.Show("导出成功!"); } private void Form1_FormClosing(object sender, FormClosingEventArgs e) { try { if (mt != null) { mt.Interrupt(); mt.Abort(); } foreach (Thread t in threads) { t.Interrupt(); t.Abort(); } if (main != null) { main.Interrupt(); main.Abort(); } } catch { } Thread.Sleep(5000); } private void btnStop_Click(object sender, EventArgs e) { try { if (mt != null) { mt.Interrupt(); mt.Abort(); } foreach (Thread t in threads) { t.Interrupt(); t.Abort(); } if (main != null) { main.Interrupt(); main.Abort(); } } catch { } btnStart.Enabled = true; } }}
    2014-06-23下载
    积分:1
  • 即时通讯序源码(可传文件、聊天)
    在本机运行的时候,请将QClient.cs 中的ip地址改成自己的ip, 即这里: private string ServerHost = "192.168.1.104";   //服务器主机 网络即时通讯程序,基本要求如下:1)用户之间的同步/异步的即时文字通讯;2)用户之间的文件传输功能;3)至少支持在局域网内实现基本文字通信功能,考虑基于互联网的网络通信功能。4)附加要求:A,支持音/视频功能;(这个未完全实现,视频接收方的每一步方法都要用到委托访问控件,已放弃治疗)B,用户之间的通信参考QQ的弹窗效果;C,发送文件前,应经过接收方的允许后才发送;D,消息到达提醒功能;(用户名闪烁)
    2013-11-26下载
    积分:1
  • 696524资源总数
  • 103986会员总数
  • 80今日下载