How to Access Google Cloud BigQuery API in JavaScript

Installing Necessary Libraries

• To interact with Google Cloud BigQuery in JavaScript, you'll need the `@google-cloud/bigquery` package. Install it using npm:

npm install @google-cloud/bigquery

Setting Up Authentication

• Ensure you have set up a service account in Google Cloud Platform and downloaded the JSON key file.
• Set the `GOOGLE_APPLICATION_CREDENTIALS` environment variable to the path of your JSON key file. This provides authentication for your application.

export GOOGLE_APPLICATION_CREDENTIALS="/path/to/your/service-account-file.json"

Initialize the BigQuery Client

• Start by importing the BigQuery library and initiating a BigQuery client object:

const { BigQuery } = require('@google-cloud/bigquery');

// Creates a client
const bigquery = new BigQuery();

Performing a Simple Query

• You can perform operations using SQL queries. Here's an example of a simple query execution:

async function queryStackOverflow() {
  const query = `SELECT name FROM \`bigquery-public-data.usa_names.usa_1910_2013\` WHERE state = 'TX' LIMIT 100`;

  // Runs the query
  const [rows] = await bigquery.query(query);

  console.log('Names from Texas:');
  rows.forEach(row => console.log(row.name));
}

queryStackOverflow();

Handling Query Results

• The response from a successful query will be an array of rows which you can loop over to process or display your data.
• Ensure proper error handling by catching exceptions when making requests to BigQuery.

async function executeQuery() {
  try {
    const [rows] = await bigquery.query(query);
    rows.forEach(row => console.log(row));
  } catch (error) {
    console.error('ERROR:', error);
  }
}

Inserting Data into a Table

• To insert data into a BigQuery table, use the `insert` method:

async function insertData(datasetId, tableId, rows) {
  try {
    // Inserts data into a table
    await bigquery
      .dataset(datasetId)
      .table(tableId)
      .insert(rows);

    console.log(`Inserted ${rows.length} rows`);
  } catch (error) {
    console.error('Error inserting data:', error);
  }
}

insertData('my_dataset', 'my_table', [
  { name: 'John', age: 30 },
  { name: 'Jane', age: 27 },
]);

Leveraging Query Options

• Additional query options can be used, such as setting `useLegacySql` to false for using standard SQL syntax.

const options = {
  query: 'SELECT word FROM `bigquery-public-data.samples.shakespeare` WHERE word like "%love%"',
  location: 'US',
  useLegacySql: false,
};

async function customQuery() {
  const [rows] = await bigquery.query(options);
  console.log('Found Words:');
  rows.forEach(row => console.log(row.word));
}

customQuery();

Streaming Data

• BigQuery's streaming insert feature lets you add data in real-time. The API uses HTTP POST requests, and is suitable for low-latency requirements.

async function streamData(datasetId, tableId, row) {
  await bigquery
    .dataset(datasetId)
    .table(tableId)
    .insert(row);

  console.log(`Row inserted at ${new Date().toISOString()}`);
}

streamData('my_dataset', 'my_table', { name: 'Doe', age: 45 });

Concluding Remarks

• Effective error management, using tools like try-catch blocks, is vital for debugging.
• Review use cases for different operations like querying or streaming to optimize data interaction according to project needs.
• You must ensure your Google Cloud project has the proper service permissions to interact with BigQuery.