HTTP Programming Recipes for C# Bots ebook

Discussion in '.NET' started by hardstyleBH, Oct 31, 2009.

  1. hardstyleBH

    hardstyleBH Make Money Online

    Joined:
    Oct 9, 2009
    Messages:
    105
    Likes Received:
    5
    Trophy Points:
    0
    Location:
    THe land of the richies $$$
    Description

    The Hypertext Transfer Protocol (HTTP) allows information to be exchanged between a web server and a web browser. C# allows you to program HTTP directly. HTTP programming allows you to create programs that access the web much like a human user would. These programs, which are called bots, can collect information or automate common web programming tasks. This book presents a collection of very reusable recipes for C# bot programming.
    Contents

    The .NET runtime provides a rich set of classes to allow for programmatic access to the web. Using these classes HTTP and HTTPS programs can be created that automate tasks performed by human users of the web. These programs are called bots. Chapters 1 and 2 introduce you to HTTP programming.

    Chapter 1 of this book begins by examining the structure of HTTP requests. If you are to create programs that make use of the HTTP protocol it is important to understand the structure of the HTTP protocol. This chapter explains what packets are exchanged between web servers and web browsers, as well as the makeup of these packets.

    Chapter 2 shows how to monitor the packets being transferred between a web server and web browser. Using a program, called a Network Analyzer, you can quickly see what HTTP packets are being exchanged. To create a successful bot, your bot must exchange the same packets with the web server that a user would. A Network Analyzer can help quickly create a bot by showing you

    From Chapter 3 and beyond this book is structured as a set of recipes. You are provided with short concise programming examples for many common HTTP programming tasks. Most of the chapters are organized into two parts. The first part introduces the topic of the chapter. The second part is a collection of recipes. These recipes are meant to be starting points for your own programs that will require similar functionality.

    Chapter 3 shows how to execute simple HTTP requests. A simple HTTP request is one that accesses only a single web page. All data that is needed will be on that page and no additional information must be passed to the web server.

    Chapter 4 goes beyond simple requests and shows how to make use of other features of the HTTP protocol. HTTP server and client headers are introduced. Additionally, you will be shown how to access data from basic HTML files.

    Chapter 5 shows how to use HTTPS. HTTPS is the more secure version of HTTP. Use of HTTPS is generally automatic in C#. However, you will be shown some of the HTTPS specific features that C# provides, and how to use them. You will also be introduced to HTTP authentication, which is a means by which the web server can prompt the user for an id and password.

    Chapter 6 shows how to access data from a variety of HTML sources. An HTML parser is developed that will be used with most of the remaining recipes in this book. You are shown how to use this parser to extract data from forms, lists, tables and other structures. Recipes are provided that will serve as a good starting point for any of these HTML constructs.

    Chapter 7 shows how to interact with HTML forms. HTML forms are very important to web sites that need to interact with the user. This chapter will show how to construct the appropriate response to an HTML form. You are shown how each of the control types of the form interacts with the web server.

    Chapter 8 shows how to handle ******s and sessions. You will see that the web server can track who is logged on and maintain a session using either ******s or a URL variable. A useful class will be developed that will handle ****** processing in C#.

    Chapter 9 explains the effects that JavaScript can have on a bot. JavaScript allows programs to be executed by the web browser. This can complicate matters for bots. The bot programmer must understand how JavaScript helps to shape the content of HTTP packets being produced by the browser. The bot must provide these same packets if it is to work properly.

    Chapter 10 explains the effects that AJAX can have on a bot. AJAX is based on XML and JavaScript. It has many of the same effects on a bot program as JavaScript does. However, most AJAX web sites are designed to communicate with the web server using XML. This can make creating a bot for an AJAX website easier.

    Chapter 11 introduces web services. Web services have replaced many of the functions previously performed by bots. Sites that make use of web services provide access to their data through XML. This makes it considerably easier to access their data than writing a traditional bot. Additionally, you can use web services in conjunction with regular bot programming. This produces a hybrid bot.

    Chapter 12 shows how to create bots that make use of RSS feeds. RSS is an XML format that allows quick access to the newest content on a web site. Bots can be constructed to automatically access RSS information from a web site.

    Chapter 13 introduces the Heaton Research Spider. The Heaton Research Spider is an open source implementation of a C# spider. There is also a Java version of the Heaton Research Spider. A spider is a program that is designed to access a large number of web pages. The spider does this by continuously visiting the links of web pages, and then pages found at those links. A web spider visits sites much as a biological spider crawls its web.

    The remaining chapters of the chapters of this book do not include recipes. Chapters 14 and 15 explain how the Heaton Research Spider works. Chapter 16 explains how to create well behaved bots.

    Chapter 14 explains the internals of the Heaton Research Spider. The Heaton Research Spider is open source. Because of this you can modify it to suit your needs. Chapter 14 discusses the internal structure of the Heaton Research Spider. By default the Heaton Research Spider uses computer memory to track the list of visited URLs. This chapter explains how this memory based URL tracking works. The next chapter explains how to use an SQL database instead of computer memory.

    Chapter 15 explains how the Heaton Research Spider makes use of databases. The Heaton Research Spider can use databases to track the URLs that it has visited. This allows the spider to access a much larger volume of URLs than when using computer memory to track the URL list.

    The book ends with Chapter 16 which discusses how to create "Well Behaved Bots". Bots are not welcome on all web sites. Some web sites publish files that outline how bots are to access their site. It is very important to respect the wishes of the web master when creating a bot.

    Download
    Code:
    
    http://hotfile.com/dl/28538118/817828d/C.html
    Instructions
    Code:
    The file will be presented without a format. You must download it either as a zip, by adding .zip after the file name, or download it as-is and add the .zip extension.
     
  2. zil

    zil Make Money Online

    Joined:
    Sep 19, 2009
    Messages:
    37
    Likes Received:
    0
    Trophy Points:
    0
    reupload plz
     
  3. Elf

    Elf Make Money Online

    Joined:
    Sep 25, 2009
    Messages:
    406
    Likes Received:
    4
    Trophy Points:
    18
    Code:
     [URL="http://rapidshare.com/files/142095869/CSHTTP.zip.html"][COLOR=#810081]http://rapidshare.com/files/142095869/CSHTTP.zip.html[/COLOR][/URL] 
     
  4. zil

    zil Make Money Online

    Joined:
    Sep 19, 2009
    Messages:
    37
    Likes Received:
    0
    Trophy Points:
    0
    The file could not be found. Please check the download link. :(
     
  5. Elf

    Elf Make Money Online

    Joined:
    Sep 25, 2009
    Messages:
    406
    Likes Received:
    4
    Trophy Points:
    18
    Code:
    [url=http://rapidshare.com/files/302030798/HTTPCSBot.rar.html]RapidShare: 1-CLICK Web hosting - Easy Filehosting[/url]
    
     
  6. syanide

    syanide Make Money Online

    Joined:
    Jan 7, 2010
    Messages:
    9
    Likes Received:
    0
    Trophy Points:
    0
    you find this stuff also on the oriely site for free.. basic http request and response object invokation.. good stuff though
     
  7. Bow

    Bow Make Money Online

    Joined:
    Jan 7, 2010
    Messages:
    5
    Likes Received:
    0
    Trophy Points:
    0
    Could you please reup the Ebook please!
     
  8. BillyMac856

    BillyMac856 Make Money Online

    Joined:
    Dec 9, 2009
    Messages:
    68
    Likes Received:
    0
    Trophy Points:
    0
    Location:
    Philly
    If anyone's still looking for this book I just found it on bhw,
    It's listed as: C# Bot Making E-Book
    Not as: HTTP Programming Recipes for C# Bots
    I haven't yet got into it but it's over 600 pages and looks pretty neat. I'm just getting into programming myself and fascinated with automation so this book should do me a world of good.

     
  9. blackhatmith

    blackhatmith Make Money Online Very Active Members

    Joined:
    Oct 4, 2009
    Messages:
    211
    Likes Received:
    0
    Trophy Points:
    0
    Reupload:

    Code:
    http://hotfile.com/dl/28538118/817828d/C.html
    Virustotal:

    Code:
    http://www.virustotal.com/analisis/61d56d59f15619b684abba5fcc692234d188b6400f3800fa76023d38426ec442-1250580723
     
  10. dungxvn

    dungxvn Make Money Online Very Active Members

    Joined:
    Dec 14, 2009
    Messages:
    164
    Likes Received:
    3
    Trophy Points:
    0
    could anyone tell me where to start learning programing languages?
     
  11. gorico

    gorico Make Money Online

    Joined:
    Nov 12, 2010
    Messages:
    41
    Likes Received:
    0
    Trophy Points:
    0
    Even though I don't understand C# programming,thank you for sharing.
     
  12. aweha

    aweha Make Money Online

    Joined:
    May 24, 2010
    Messages:
    25
    Likes Received:
    0
    Trophy Points:
    0
    I think this thread belongs to .net section of the forum as C# is a part of .Net.
    Anyway nice shares in here, thanks.
     
  13. hrkhan

    hrkhan New Member

    Joined:
    May 5, 2011
    Messages:
    13
    Likes Received:
    0
    Trophy Points:
    0
    dungxvn Learning a programming language is not hard. Start with just one language. You can learn c# of .net languages. It is easy, powerful and there are resources every where. You can have sharp develop free from online. then google for hello world program in c# step by step. You will see its easy to learn the language.
    What is hard part? to become a programmer you have to give time and experiences. You need to what is really oop is and how it works in a language. You also have to learn existing patterns for problem solution. Then you will become programmer. This is not as hard as it sounds. You just need to give some time and have some intel in your head. I bet you have.
    thank you
     
  14. memme

    memme New Member

    Joined:
    Aug 7, 2011
    Messages:
    22
    Likes Received:
    0
    Trophy Points:
    0
    nice book for beginners....I would suggest to use regex instead of extract...
     

Share This Page