What is the method for importing a CSV file into hive?

2 years ago
Benjamin Taylor
2 minutes

The method for importing CSV files into Hive is as follows:

  1. Create a table to store the data from a CSV file. You can use the following command to create a new table:
CREATE TABLE table_name (
  column1 data_type,
  column2 data_type,
  ...
)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY ','
STORED AS TEXTFILE;

In the command above, “table_name” is the name of the table, “column1”, “column2”, etc., are the column names of the table, “data_type” is the data type of the columns, and “FIELDS TERMINATED BY ‘,'” specifies that the column delimiter for the CSV file is a comma.

  1. Use the LOAD DATA INPATH command to load a CSV file into the created table. Assume the CSV file is named data.csv, and it can be loaded into the table using the following command:
LOAD DATA INPATH '/path/to/data.csv' INTO TABLE table_name;

In the command above, ‘/path/to/data.csv’ is the path to the CSV file, and table_name is the name of the target table.

  1. After the import is complete, you can use the SELECT statement to retrieve the imported data.
SELECT * FROM table_name;

This will retrieve all data from the table.

Before importing the CSV file, make sure that the directory of the Hive table has proper permissions and the location of the CSV file is visible to the Hive server.

bannerAds