Web Scraper

Overview

This project involves building a web scraper to extract data from web pages. The scraper fetches and processes HTML and displayed on the client side.

Features

• Fetch Data: Retrieve HTML content from specified URLs.
• Parse Data: Extract specific information using HTML parsing techniques.
• Display Data: Display the extracted data in the front-end.

Technologies Used

• Frontend: Tailwind CSS, JavaScript, CSS, HTML
• Backend: Node.js, Express, Handlebars (hbs)
• Axios: Library for making HTTP requests.
• Cheerio: Library for parsing and manipulating HTML.

Installation

Tools

• Node.js for the JavaScript runtime environment.
• Git for version control.
• Visual Studio Code for text editing. (Recommended)

1. Clone the Repository:

   git clone https://github.com/Amalkrishnanvp/Web-Scraper.git
   

2. Navigate to the project directory

   cd "Web Scraper"
   

3. Install Dependencies:

   npm install
   

4. Run the project

   node app.js
   

5. Open your web browser and go to http://localhost:1000

Usage

1. Enter the URL of page you want to scrape
2. Click the "scrap" button

Project Structure

Here’s an overview of the project structure for the Movie Search Application:

Web Scraper/
│
├── public/
│   ├── javascripts/
│   │   └── main.js         # JavaScript file for client-side functionality
│   └── stylesheets/
│       └── style.css       # CSS file for styling
│
├── routes/
│   ├── data.js             # Route handling for getting string data
│   └── index.js            # Route handling for index
│
├── src/
│   └── input.css           # Additional CSS file for styling
│
├── views/
│   ├── index.hbs           # Handlebars template for the index page
│   └── layout.hbs          # Handlebars layout template
│
├── app.js                  # Main application file
└── README.md               # Project documentation

Contributing

Feel free to submit issues or pull requests if you have suggestions or improvements.

License

This project is licensed under the MIT License..

Contact

For questions or feedback, reach out to [email protected].