Java Web Scraper Guide: Fetch Data Easily

In order to scrape web data using Java, it is common to use third-party libraries such as Jsoup. Below is a simple example code using Jsoup to scrape web data:

import org.jsoup.Jsoup;
import org.jsoup.nodes.Document;
import org.jsoup.nodes.Element;
import org.jsoup.select.Elements;

import java.io.IOException;

public class WebScraper {

    public static void main(String[] args) {
        String url = "https://www.example.com";

        try {
            Document doc = Jsoup.connect(url).get();

            Elements links = doc.select("a[href]");

            for (Element link : links) {
                System.out.println(link.attr("href"));
            }

        } catch (IOException e) {
            e.printStackTrace();
        }
    }
}

In this example, we start by defining the URL of the webpage to be fetched. We then use the connect method of Jsoup to establish a connection and retrieve the content of the webpage. Next, we use the select method to choose specific elements, in this case all tags with the href attribute. Finally, we iterate through the selected elements and output their href attribute values.